long-term sustainability of e-infrastructures in la: the eela-2 model

www.eu-eela.eu

E-science grid facility forEurope and Latin America

Long-term sustainability of e-Infrastructures in LA: the EELA-2 model

Bernard Marechal (CETA-CIEMAT & UFRJ - Spain & Brazil)

Philippe Gavillet (CETA-CIEMAT & CERN)

Roberto Barbera (University of Catania and INFN - Italy)

CCICT 2009 Conference

Kingston - Jamaica, 16.03.2009

Kingston, CCICT 2009, 16.03.2009 2www.eu-eela.eu

SCIENCE & e-SCIENCE

Science is what I can teach to my son

e-Science is what he can teach me


OUTLINE

• EELA and EELA-2: a short review

• The EELA-2 model


PROJECT OBJECTIVES

• EELA (E-infrastructure shared between Europe and Latin America) under FP6 www.eu-eela.org/first-phase.php

– Bridge consolidated e-Infrastructures in Europe and emerging ones in Latin America

– Create and operate a transcontinental Grid infrastructure

– Address cost-effectively regional problems

– Enhance Research in developing counties

• EELA-2 (E-science grid facility for Europe and Latin America) under FP7 www.eu-eela.eu

– Set up a high capacity, production quality, scalable Grid Facility

– Ensure round-the-clock, worldwide access to distributed computing and storage resources

– Support a wide spectrum of applications for both European and Latin American scientific communities


RESEARCH APPROACH

• EELA– Establish scientific network– Enlarge and train (hands-on workshops) communities– Establish a pilot Grid supporting proof-of-concept applications– Close collaboration with other EC funded projects– Grid Cluster deployment, definition and enforcement of

operational schemes and policies

• EELA-2– Expand the current EELA infrastructure– Provide the full set of Grid Services needed by all types of

applications– Collaborate with NRENs and create Regional Operation Centres– Support actively the creation of National Grid Initiatives (NGI)


MAJOR OUTCOMES / RESULTS

• EELA

– Provide European researchers early access to a new, well-supported e-Infrastructure and enable them to speed up the processing of scientific data

– Strengthen scientific communities in Europe and Latin America

– Successful building of a reliable and almost “production quality” e-Infrastructure in Latin America

– Grid technology skills acquired to autonomously support the Latin American Grid on the long term

– Entrance and consolidation of Latin American communities in worldwide collaborations

– Amplification of the e-Infrastructures relevance, blazing the trail towards Latin American e-Science initiatives and/or NGIs


EELA-2 IN NUMBERS

– 16 JRU-type partners (6 from Europe, 9 from LA and 1 International Institution CLARA) in 14 countries (5 from Europe, 9 from Latin America)

– 53 institutions, most of them clustered in 9 Joint Research Units (JRU)

– EC support of about 2.1 MEuro (+ 300 KEuro from CIEMAT)

– 6 Activities (Management, Dissemination and training; Application support; Infrastructures services; Network resource provision; Development of services for applications and infrastructure)

– 30 Resource Centres; 3000 computing nodes; 700 TB of storage

– Foreseen growth over the project duration: 20 % in computing and 15% in storage

– About 50 applications selected (Biomedical, High Energy Physics, Earth Sciences, Climate, e-Learning, e-Government, e-Industry)


EELA-2 COUNTRIES / RESOURCES

FranceIrelandItalyPortugalSpain

ArgentinaBrazilChileColombia CLARA (International)CubaEcuadorMexicoPeruVenezuela

14 Countries

16 Partners (9 JRUs)

53 Members


GLOSSARY

Key words• DCI Distributed Computing Infrastructure = HPC + Grid• Local

– RC Resource Centre

• Country– NGI National Grid Initiative– GridNGI National Grid Infrastructure, supervised by NGI– GOC GridNGI Operation Centre– NREN National Research & Education Network– NOC NREN - Network Operations Centre

• International– LGI Latin American Grid Initiative– GridLGI Latin American Grid Infrastructure, supervised by LGI– GSC GridLGI Support Centre– CLARA Cooperación Latino Americana de Redes Avanzadas– RedCLARA Latin American regional backbone network, operated by CLARA– NSC RedCLARA - Network Support Centre

• Europe– EGI European Grid Initiative– EGI_DS EGI_Design Study Project


Some concepts…

Environmental protection: is the process of making sure current processes of interaction with the environment are pursued with the idea of keeping the environment as pristine as naturally possible.

Economic development: is made of three building blocks, i.e. information, integration, and participation.

Pillars of World Sustainable

Development

Social development: also known as social change, refers to:• change in social structure: the nature, the social institutions, the social behaviour or the social relations of a society, community of people, and so on;• any event or action that affects a group of individuals that have shared values or characteristics.


Real world• Social• Environment

• Economic

e-Infrastructures• Virtual Organizations• Resource Centres + Service Provi-

ders → National Grid Initiatives• Middleware services, Application

support, and Training

Key analogy: Grids are complex “ecosystems” of services

“sold” and “bought” by virtual communities.

VOs

NGIs M/W, Supp.,

Training

Sustain.e-Infra.

e-Infrastructures’

Sustainable

Development

…and analogies


Other analogies…(en.wikipedia.org/wiki/Society and links therein)

BandsTribes

ChiefdomsStates

Univs.Orgs.

NGIs

Large Grid

InitiativesJRUs

Kingston, CCICT 2009, 16.03.2009 13www.eu-eela.eu Jürgen Knobloch/CERN Slide 13

GRID 3

EGEE 1

LCG 1

EU DataGrid

GriPhyN, iVDGL, PPDG

EGEE 2

OSG

LCG 2

EGEE 3

1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

WLCG

• Partially decentralizedmodel– replicate the event data at

about five regional centres

– data transfer via network ormovable media

RC2

CERN

RC1

Inter-operation

Timeline of EU and US Grids


Testbeds

Utility Service

Routine Usage

National

Global

Ref.

: D

. K

ran

zlm

üller

pre

sem

tati

on

at

EG

EE’0

8

The system becomes sustainable only if a social change occurs.

By analogy, this m

eans a change in th

e way we consider and support V

Os

Grid Ecosystem’ evolution in EU


…and in Latin America ?

EELA

EELA-2

?

4/2008-3/20101/2006-12/2007

4/2010 →


The Latin American Grid Initiative (LGI)(http://documents.eu-eela.org/record/1119/files/)


LGI Management


A possible structure of a NGI in LA

A strong liaison with the NREN must be established.A strong liaison with the NREN must be established.Local conditions permitting, NGI and NREN can merge into a single entity.Local conditions permitting, NGI and NREN can merge into a single entity.


Strategy and Lines of Action

• Well-defined strategy needed to address all subjects and all stakeholders, in parallel.

• Mandatory interconnected lines of actions with well-defined actors and targeted people:

– Define the conditions of a sustainable e-Science Infrastructure

– Collect the largest support from the User communities

– Get full support from Decision Makers (DM) at all levels

– DCI being international by essence, develop actions in common with DCI-related projects with the same objective of long-term support.


Conditions of a sustainable GridLGI

• Establish the conditions of a sustainable GridLGI by:– Adopting a suitable architecture model; – Anticipating its implementation and evolution;– Deriving the Manpower Effort to operate and support it;– Preparing a transition strategy from EELA-2 to GridLGI.

• Status– Actions

LGI: Several contacts with CLARA

– Actors EELA-2 Management

– Targeted people EELA-2 Members, DMs, other DCI projects

– Backup documentation DSA1.3: “The Long-Term Latin American Grid Initiative: Model and

Operation Cost Estimate” WNA1.1: “Strategy towards Long-Term sustainability”


Interaction with User Communities (1)

• Interaction with User Communities to: – Progress in the dissemination of DCI need / usefulness

Use extensively the EELA-2 Infrastructure; Look for (more) Applications of interest and potential impact; Increase the amount of people promoting Grid computing; Get new Partners / Members joining EELA-2.

– Progress in the creation of NGIs 50 Members in EELA-2 but <2-4> Institutions / country. → Need support from the whole DCI community when discussing

with the Decision Makers of a given country Get a wide consensus on all beneficial aspects of Grid computing

and support to sustainable Grid Infrastructures;

– Get unanimous agreement on the LGI model


Interaction with User Communities (2)

• Status– Actions

JRU / NGI status• In place in Spain, Ireland, France, Italy, Argentina, Chile, Peru, Venezuela, Colombia,

Portugal, Brazil;• Ongoing creation in Mexico, Ecuador;• Missing: Cuba;• New Partners: Panama (JRU), Uruguay (Single partner).

Initiative of a “User survey to collect Statements of Interests”• Structured in 6 blocks of questions

o Tell us about yourselfo Your experience about DCI in your own Research worko Your perception of Distributed Computing Infrastructures (DCI)o Tell us your opinion about DCI impactso Your perception of the need and usefulness of National Grid Initiative (NGI)o Your perception of the need and usefulness of International Grid Initiatives (IGI)

• Status: Under discussion in EGI_DS This meeting

– Actors EELA-2, Belief, DCI projects

– Targeted people “Worldwide” DCI project Members, EGI_DS, e-Science communities → DMs

– Document Draft v0.1 available (WNA1.2 after EGI_DS feedback)


Interaction with Decision Makers (1)

• Interact with Decision Makers to:– Disseminate the use & uselfuness of DCI technology at all levels

of Decision making processes– Eventually convince Decision Makers that:

e-Science is the natural evolution of today’s research DCIs are useful but even more, indispensable in many fields DCIs impact goes beyond e-Science up to the social and industry

sectors DCIs operation support, as proposed, is affordable

– Present the sustainability approach via the NGI / GridLGI architecture model and the operation costing;

– Work out optimized implementation scenarii in local context. Road map with precise objectives and progressive funding


Interaction with Decision Makers (2)

• Status:– Actions

Decision Makers Days already held:• KoM: Trujillo (Spain), 20-23th Apr. 2008

• Monterrey (Mexico), 6-8th Oct. 2008

• Quito (Ecuador), 8th Dec. 2008

• Bogotá (Colombia), 24th Feb. 2009 In depth discussions (EELA-2 presentation, e-Science status in the

country, prospectives,..) Production of dissemination materials (Posters, Flyers,..) Initiative of customized fact sheets for Decision Makers Days

– Actors EELA-2 (NA1, NA2), GridTalk, DCI projects

– Targeted people DCI projects → DMs


Collaboration with Grid-related Projects (1)

• Collaboration with Grid-related projects for common actions towards sustainability:– Coordination of Grid-related projects: EGEE-III, EUAsiaGrid,

EUMedGrid, EUChinaGrid, EUIndiaGrid, EELA-2, BalticGrid-2 and SEE-GRID-SCI for actions towards: Top level: EC, EGI_DS,… LGI Ground level: User communities

– Maintain permanent concertation through regular meetings and direct contacts;

– Discussing initiatives of common interest.– Launch, follow up agreed actions


Collaboration with Grid-related Projects (2)

• Status– Actions:

Concertation meetings at EGEE’08 and ICT’08 (Belief) Follow up via mail exchanges, ICT’08 Web site comment form

– Outcomes: Comments to EC on the “Key themes for the 2010-2011 programme, in

particular the transition from the on-going projects to a proposed sustainable model for pan-European grid infrastructure”

Comments to EGI_DS on the proposed sustainable model for pan-European grid infrastructure, called EGI

Initiative of a “User survey to collect Statements of Interests” Initiative of a “Customized Fact sheets for Decision Makers Days” “Guide for NGI creation & and metrics of progress assessment” (SEE-

GRID- SCI)

– Actors Collaborative projects, Belief, GridTalk

– Targeted people All stakeholders from ground to top level


Conclusions

• EELA-2 is striving to take all measures to prepare the long-term future of its Infrastructure

– In all aspects concerned; – With all relevant partners; – In collaboration with all similar projects.

• Sustainability require that some conditions MUST be fulfilled i.e.:– The usefulness of DCI (i.e. EELA-2) has to de demonstrated by the Users communities

themselves;– A cost effective architecture model (NGI, LGI-based) is needed;– Existing JRUs should play a crucial role in NGI creation– A realistic operation costing is needed;– The transition phase to a sustainable model is to be worked out;– User communities at large must provide full support to all initiatives, taking every occasion

to discuss with local DMs;– With an open minded attitude a road map towards sustainability should be defined with

the parts concerned (User Communities ↔ DMs).

• These conditions being met, the EC 2010-2011 programme foresees SSA projects to help in the transition phase.

• The Caribbean could / should interact with us (EELA-2)


Operation Manpower Effort

Layer Type of Operation FTE Funding source

RC Operation of a RC & LAN (~10 to 100 Computing nodes)

1.5

(0.5)

RC Institution

(Support for Grid

Servic es)

NGI / GOC

GOC Operation 4 NGI

NGI / GOC

Dissemination & Training

2.5 NGI

NGI / GOC

GOC User Support 2 NGI

LGI / GSC

GSC Operation 8 LGI

LGI / GSC

Dissemination & Training

4 LGI

LGI / GSC

GSC User Support 3 LGI

LGI / NSC

NSC Operation 2 LGI


LAST BUT NOT LEAST

RESEARCH IS NOT A COST…..

RATHER AN INVESTMENT

long-term sustainability of e-infrastructures in la: the eela-2 model

Documents