grid as a platform for e-science: the experience of eela as e-infra-structure in latin america

FP6−2004−Infrastructures−6-SSA-026409

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

Grid as a platform for e-Science: the experience of EELA as e-Infra-structure in Latin America

Roberto BarberaUniversity of Catania and INFNREUNA e-Science ConferenceSantiago of Chile, 07.09.2006

REUNA e-Science Conference, Santiago of Chile, 07.09.2006 2FP6−2004−Infrastructures−6-SSA-026409


• Introduction• E-Infrastructures in Europe• The EELA Project• A look into the future• Summary and conclusions

Outline



The Grid: networked data processing centres and ”middleware” software as the “glue” of resources.

Researchers perform their activities regardless geographical location, interact with colleagues, share and access data

Scientific instruments and experiments provide huge amount of data

The Grid Vision for e-Science



GRID

MIDDLEWARE

Visualising

Workstation

Mobile Access

Supercomputer, PC-Cluster

Data-storage, Sensors, Experiments

Internet, networks

The Grid Metaphor



GRID

MIDDLEWARE

01011010110

-CPU - Memory-Disc - Input/Output

, the present, …The past

The Grid Revolution



…the future: The Grid!

virtual services

virtual

services

virtual

services

virtual services

virtual s

ervice

s

virtual s

ervices

The Grid Revolution



Flexible control and sharing of distributed resources

Towards a new generation of e-Infrastructures

Developer view: abstraction, effective service creation

Infrastructure-provider view: Integration, pervasive virtual organisations, streamlining and longer-term protection of investment

End-user view: “unlimited” access to ICT-resources distributed world-wide, simplification



The European Research Area

Network infrastructure

(GÉANT )O

pe

rati

on

s,

Su

pp

ort

an

d

tra

inin

g

Collaboration

Pan-European Grid



networking

specific services

joint research activ

ities

GÉANT .

INFRASTRUCTURE

networking

specific services

joint research activ

ities

GRID .

INFRASTRUCTURE

Te

ch

no

log

y

t

es

tbe

ds

Us

er

t

es

tbe

ds

research resultsEU policies

e-Infrastructures: implementation blocks

REUNA e-Science Conference, Santiago of Chile, 07.09.2006 10



SEE-GRIDA Grid infrastructure for SE-Europe

GÉANT .

INFRASTRUCTURE

GRID .

INFRASTRUCTURE

EGEE

Production quality grid, HEP, Biomed..., int. links (€35M – CERN)

GÉANTPan-European Research Network,3700 institutes, IPv6 enabled(93 M€ - DANTE)

DEISA

grid of EU supercomputers networked at Gbps, focus on global filing systems,>40 Tflop/s, several user communities

(€15M - CNRS) .

Today’s e-Infrastructure in Europe

€250M in FP6




EGEE: The Project(http://www.eu-egee.org)

• Coordinated by CERN• 12 Federations• 32 countries• 90+ partners • 35+ M€ budget




EGEE: the Infrastructure

> 24/7 service

> 192 sites, 40 countries, 11 ROCs

> 28,000 processors

~ 2,500 TB storage

> 20,000 concurrent jobs per day




High Energy Physics Applications

ATLAS CMS

LHCb

~10-15 PetaBytes /year~108 events/year

~103 concurrent users




Biomedical Applications: GATE

• Geant4 Application to Tomographic Emission (GATE)OpenGate Collaboration (http://www-lphe.epfl.ch/GATE)

GATE is an Environment for the Monte-Carlo Simulation of Particle Physics Emission in the Medical Fields:1. Simulation of gamma-cameras and PET-scanners.2. Simulation of dosimetry on radiotherapy

treatments in oncology




• WISDOM (Wide In-Silico Docking Of Malaria) is a Deployment of a High-Throughput Virtual Screening Platform in the Perspective of In-Silico Drug Discovery for Neglected Diseases.

• The In-Silico Docking is Faster and Much Cheaper than the Experimental Docking, Which is Restricted to the Most Successful Ligands Obtained After the Simulation Process.

• The Initial Objective of WISDOM is the Proposition of New Inhibitors for a Family of Proteins Produced by a Protozoa Parasite (Plasmodium Falciparum ) that Causes Malaria.

• However is Being Applied to Other Diseases, such as H5N1 (Avian Flu).

Biomedical Applications: WISDOM




The “global” network coverage




The “global” grid coverage

EUIndiaGrid

EUMedGrid

SEE-GRID-2

EELA

BalticGrid

EUChinaGridOSGNAREGI

Other projects

EU projects




The EELA Project(http://www.eu-eela.org)




• Main purposes: – Build a bridge between consolidated e-Infrastructure initiatives

in Europe and emerging ones in Latin America– Reinforce collaboration between Latin America and Europe

• Objectives: – Establish a human collaboration network between Europe and

Latin America: Setting up the structure of the collaboration network Establishing adequate support mechanisms Adopting policies regarding the shared use of e-Infrastructure Evaluating new areas of collaboration and relevant partners, both

in Europe and Latin America

EELA Objectives (1/2)




– Build a pilot e-Infrastructure in Latin America: Implementing basic mechanisms for an interoperable e-

Infrastructure, adopting a security policy, establishing Certification Authorities and defining basic tools middleware

Setting up a Pilot Testbed, establishing Virtual Organizations and supporting application developers and users

Supporting advanced network services

– Promote a sustainable framework for e-Science: Identifying research communities and applications Supporting dissemination efforts Coordinating participation in possible new projects Defining a map for a future consolidated e-Infrastructure in LA

EELA Objectives (2/2)




– EUROPE Italy: INFN Portugal: LIP Spain: CIEMAT (coordinator), CSIC, RED.ES, UC, UPV

– INTERNATIONAL ORGANIZATIONS CERN CLARA

– LATIN AMERICA Argentina: UNLP Brazil: CEDERJ, RNP, UFF, UFRJ Chile: REUNA, UDEC, UTFSM Cuba: CUBAENERGIA Mexico: UNAM Peru: SENAMHI Venezuela: ULA

The EELA Consortium




EEAL Time Frame and Budget

From 01.01.2006 to 31.12.2007

• Total Budget: 2568.32 K€

• EC contribution: 1700.00 K€

• Special CIEMAT funds for LA: 400.00 K€

• Partners contribution: 468.32 K€




EELA Activities and Human Resources

WPNo

Work package titleLead

contractorPerson-months

DeliverableNo

1Project administrative and technical management

CIEMAT (E) 29 7

2Pilot Testbed Operation and Support UFRJ (BR) 297 12

3Identification and support of grid enhanced applications

CIEMAT (E) 576 8

4Dissemination activities INFN (IT) 207 11

TOTAL 1109




The Network Infrastructure in L.A.(http://alice.dante.net)




The EELA e-Infrastructure

01/2006 08/2006




EELA Usage




EELA Applications: BiG

• BLAST in Grid (BiG) is a Grid-enabled BLAST Interface.• BLAST (Basic Local Alignment Search Tool) is a

Bioinformatics Procedure Applied to Identify Compatible Protein and Nucleotide Sequences in Protein and DNA Databases.

• BLAST can be Applied, Among Other Uses, to Annotate the Estimated

Function of Unknown

Sequences.• BLAST is Computationally

Intensive.




BiG Architecture

• Users Access the Service Through a Web Portal.• Access to the EELA Grid is Performed Through the Gate-to-Grid.• Gate-to-Grid is an EELA Grid Node Which Provides a WSRF-Based

Web Interface.

WEB Environment EELA Grid InfrastructureSE aker.dsic.upv.es

WNs

CE ramses.dsic.upv.es

Bioinformatics Portal

Gate-to-Grid




Current BiG Tests on EELA

• BiG Application has Been Installed on ULA Computers.• Tests Have Been

Performed Successfully on a Dataset of Around 3000 Sequences of the Plasmodium Falciparum.

• Integration in the

Bioinformatics

Portal is

Completed.




Climate Applications in EELA

CLIMATE(SENAHMI, UNICAN, UDEC)




EELA Applications: CAM

• Create a system of stationary analysis and prediction for the rain and the cycle of water (El Niño-La Niña phenomena)

• Plus humidity, basins of main rivers and their tributaries, lakes, etc

• Project also shared with other national and international institutions (France, UK) and projects

• Lots of data concerning monthly rainings from several institutions collected and corrected with their respective errors from 1990

• From 1992, these data are daily collected (rain, temperature, wind) from 128 weather stations

• Krigging Bayesian methods for the different regions for the prediction of basins, caudals and lakes capacities

• Dynamic prediction useful to be compared with traditional approaches

• Studies will be made for different phenomena with different timescale (day to century) in order to understand them locally and their influence in the studied processes

• Hope to understand slow or quick variations in the national climate (specially for high-risk situations)




EELA Applications: CAM




e-Education Applications: VoD




EELA Applications: volcano eruption forecasting

• Currently no definitive method to predict the eruption of a volcano has been discovered or implemented (yet).

• Scientists monitor – seismic waves– number of earthquakes and the intensity of a specific type of quake

(harmonic tremors) in the run up to eruptions. – changes in the shape of the volcano or concentrations of gases emitted

from the cone. • By correlating spectra and melodies with precise stages of volcanic

activity we hope to discover a sort of “signature tune” of an imminent eruption or earthquake.

• By identifying musical patterns that warn of an eruption it would be possible to implement civil protection measures, days or even hours before the event


E-infrastructure shared between Europe and Latin America• Data audification can be considered as the acoustic counterpart of data graphic visualization, a mathematical mapping of information from data sets to sounds.

• Data audification is currently used in several fields, for different purposes: – science and engineering, – education and training, mainly as data analysis and interpretation tool.

• Although most data analysis techniques are exclusively visual in nature, data presentation and exploration systems could benefit greatly from the addition of sonification capabilities.

•Sonic representations are particularly useful when dealing with complex, high-dimensional data, or in data monitoring tasks where it is practically impossible to use the visual inspection, or for pattern detection.

• Research has shown that people are quite more confident in recognizing patterns audibly rather then visually.

• Music theorists and researchers have carried out in centuries of history lots of techniques and methods to detect, study and classify musical phrases.

• Main idea: Music as a language and music analysis as a tool to inspect scientific data.

Data Audification and its Motivations



• Sonified data were geophysical data collected by digital seismographs placed on the Etna volcano in Catania (Italy)…

… and on Tungurahua volcano in Ecuador.

•

Sound form volcanoes

Tungurahua Volcano (Picture: M. Monzier IRD/IG-EPN) Tungurahua Volcano (Picture: M. Monzier IRD/IG-EPN)

Etna VolcanoEtna Volcano




Tungurahua Waveform and Sonogram

Oscillation pattern variations are clearly visible in the pattern




Questionnaire for new applications(http://www.eu-eela.org/public/eela_application_questionnaire.php)




The Questionnaire for New Communities(http://www.eu-eela.org/private/eela_new_communities_form.php)




(Very) Preliminary Results

• 27 answers received so far:

Brazil 5

Chile 4

Colombia 3

Ecuador 3

El Salvador 1

Luxembourg 1

Mexico 1

Nicaragua 1

Peru 1

UK 1

Venezuela 2




Engineering12%

High-Energy Physics

12%Networking8%

Other sector57%

Biomedical11%

Scientific Sector

There is whole world of new disciplines!





Not heard about12%

Heard about and used12%

Heard not used76%

Have you heard about and/or used Grid technologies?

Grid uptake and use is minimal !

Grid dissemination must play a major role.





Yes, fully functional

4%

Yes, in Progress21%

I do not know71%

No4%

Is there a National Grid Initiative in your country ?

There is a lot of dis- and mis-information.

Awareness of existing NGI’s is small.





Other4%Development

12%

local Grid site84%

Are you interested in participating in a national project that involves

middleware development or local grid site installation and configuration ?

There is a big opportunity here to create/expand NGI’s in LA!





Yes86%

Do not know14%

If you are not using Grid infrastructure, would your research group benefit from it ?

There is a big opportunity here to expand e-Science in LA!





Would access to a grid infrastructure encourage you to tackle larger or more complex problems?

Yes78%

Do not know22%

There is a big opportunity here to increase the number of applications running on the EELA e-Infrastructure.





EELA Dissemination Events

• EELA Conferences:– 1st, Chile (4-5/09/2006)– 2nd, Brasil (05/2007)– 3rd , Spain (09-10/2007)

• EELA Workshops:– 1st, Venezuela (24-26 April 2006)– 2nd, Brasil (24-25 June 2006)– 3rd, Peru (December 2006)– 4th, Spain (Jan-Feb 2007)– 5th, Cuba (April 2007)– 6th, Argentina (July 2007)– 7th, Mexico (October 2007)




EELA Training Events

• EELA Tutorials– 1st, Spain (20-25 February 2006)– 2nd, Venezuela (27-29 April 2006)– 3rd, Brasil (26-30 June 2006)– 4th, Mexico (28 August – 1 September 2006)– 5th, Chile (6-7 September 2006)– 6th, Spain (16-20 October 2006)

• EELA Grid Schools

–EGRIS-1, Rio de Janero, Brasil (4-15 December 2006)

– EGRIS-2, Merida, Venezuela (July/August 2007)



E-infrastructure shared between Europe and Latin AmericaEELA Training Statistics

Tutorial participants

0,00

50,00

100,00

150,00

200,00

250,00

01/01/06

01/03/06

01/05/06

01/07/06

01/09/06

Date

To

tal N

um

ber

SysAdmins

Users

Participants x Days

0

50

100

150

200

250

01/01/06

01/02/06

01/03/06

01/04/06

01/05/06

01/06/06

01/07/06

01/08/06

01/09/06

Date

Val

ues

More than 575 participants·days delivered so far !




EELA Training Material(http://documents.eu-eela.org/?c=Training+Material&as=0&ln=en)




(Intermediate) Summary

• EELA is a concrete reality and represents the first step to bridge EU and LA in e-Science exploiting GEANT2 and RedCLARA networks and following the EGEE policies.

• The EELA workplan is very challenging but holds the promise to alleviate the digital divide in Latin America.

• EELA is open to all interested people/Institutes willing to collaborate.




GÉANT .

INFRASTRUCTURE

GRID .

INFRASTRUCTURE

e-I

nfr

as

tru

ctu

re

GÉANT2

EGEE

DEISA

…

+ a

ll e-

I pro

ject

s (E

EL

A, …

) ,

inte

rnat

ion

al, p

olic

ies,

use

r co

mm

un

itie

s

Outlook on e-Infrastructures: strategic building blocks




•European organisations could save €4.5 Billion by adopting basic Grid technologies•Industry Analysts Gartner and Giga both estimate that standardisation and consolidation can save between 8.5% and 20% of IT budgets

Changes in U.S. Industry Productivity Due to the Adoption of Grids and Web Services, 2002-2010

0%

5%

10%

15%

20%

25%

30%

Co

mp

ute

rs

Ele

c.

Co

mp

on

en

ts

Ph

arm

ace

utica

ls

Au

tos

Ae

ro

sp

ace

Fin

an

cia

l

Se

rvic

es

Ho

sp

ita

ls

Co

mm

un

ica

tio

ns

Se

rvic

es

Percen

tag

e C

han

ge o

ver F

orecast

Level

in 2

010

Economic Strategy Institute(Robert Cohen)

Full scale deployment of Grids in Japan is expected to: • Raise Japan’s GDP by 3 to 6 percent• Increase real disposable income by 2 to 3 percent • Increase aggregate productivity by 2 to 3 percent over levels that economy is expected to attain by 2010

Grid & Industry




FP7

FP6

GRID MIDDLEWARE

eHEALTHeSCIENCE

eCOMMERCE

RESOURCES

STO

RA

GE

DA

TA FILE

SH

AR

INGE

MA

IL WE

B

INTERNETGÉANT

FP5

A look into the future




Research infrastructures: 3987 M€ (54%)

Research for benefit of SMEs: 1914 M€ (25%)

Regions of knowledge: 160 M€ (2%)

Research potential: 558 M€ (7%)

Science in society: 558 M€ (7%)

International cooperation: 359 M€ (5%)

The EU FP7 (2007-2013)

Commission proposal




Summary and Conclusions

• e-Science represents one of the key enablers of the progress and sustainable development of a country.

• EU is developing programmes to stimulate and foster e-Science well outside its borders.

• ALICE and EELA are indeed considered strategic projects in Brussels for the cooperation between Europe and Latin America.

• LA (and Chile in particular) should profit of this as much as possible and build the basis now for the long term sustainability of both network and grid infrastructures in the continent (country).




Thank you very much! …Questions ?

grid as a platform for e-science: the experience of eela as e-infra-structure in latin america

Documents