SEE- eInfrastructure projects toward ERA

with Institute of Informatics participation

Margita Kon-Popovska, FINKI-UKIM

DAAD workshop on “Software Engineering”, Ohrid, August 2011

Outline

European e-Infrastructures: prospects &projects

SEE Region follow up and results

Our achievements/challenges

The e-Science paradigm shift

towards a scientific Renaissance

Wim JansenEuropean Commission -DG INFSOGéant and e-Infrastructures

ICT infrastructures for e-Science: a Communication to European Institutions

Highlighting the importance of embracing the e-Science paradigm shift

Highlighting the strategic role of e-Infrastructures as a crucial asset underpinning European research and innovation policies

Calling on Member States and the scientific communities, in cooperation with the European Commission, for a reinforced and coordinated effort to further develop world class e-Infrastructures

EC COM(2009) 108

Pan-EU e-Infrastructures vision

GEANT

EGI PRICE

The Research Network infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries’ Main Initiative: GEANT

The Research Distributed Computing Infrastructure (Grid, HPC) provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems Main Initiatives: EGI, PRACE

This integrated environment is called electronic infrastructure (eInfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (eScience)The creation of the eInfrastructure is a key objective of the European Research Area

e-Infrastructures for science…ubiquitous research environments for accessing and

sharing resources and tools…

Wim JansenEuropean Commission -DG INFSOGéant and e-Infrastructures

Actions and funding

GÉANT: reinforce policy coordination, innovate in use, extend geographical reach(GÉANT connects 40 million users in over 8,000 institutions across 40 countries) www.geant.net/pages/home.aspx

Grids (EGI-InSpire): ensure long-term sustainability, interoperability, support new governance models(56 countries, 288.000 CPUs, DISK PB 117, Tape PB 92, Jobs 28M/month, 217VOs)www.egi.eu

Supercomputing: deploy top-class ecosystem of computational resources; scale up & pool investments (PRACE) in line with a broad strategic agenda from components and SW to systems and services www.prace-project.eu

Scientific data: deploy and manage coherent ecosystem of information repositories; step up investment, define policy, share best practices, support accessibility & preservation

Global virtual research communities (GVRC): support scientific communities in optimal use of e-infrastructures

For future vision e-Infrastructure Reflection Group white papers (new is 2011) on new and on-going e-Infrastructure challenges

www.e-irg.eu/publications/white-papers.html

GEANT3

EC FP7 4 year project 95M eur Reinforce

policy coordination, innovate in use, extend geographical access

World R&E Communities Connectivity

EGI-InSpire

EU FP7 4 years project25M eurBuilding and maintaining sustainable European Grid Infrastructure

PRACE - The Partnership for Advanced Computing in Europe

Germany

FranceTier(0)

CURIE

SEE eInfrastructure activities – timeline: 8 years of close collaboration

Network Infrastructure

SEEREN1/2: regional inter-NRN connectivity and GEANT links [DGINFSO] all countries in GN3 2009 (except AL and BA)SEEFIRE: studying the feasibility of long-term solutions for dark fiber backbone in the regionSEELIGHT: implementation of the lambda facility in SEE [Greek Hiperb] sustainable regional networkResult: partly sustainable national & regional networks, EC 50% funding for GEANT

National dimension crucial: Role of NREN in MK this was UKIM/MARNET with participation of researchers from Institute of informatics

www.seeren.org

SEEREN 1&2

Funding: 3,5 M eur, Duration:4,5 year2004-2009

Services planned/implemented during the SEEREN1#2 projects and beyond

NATO NIG project

NATO funding204.000 eur1G fiber switches+ 2x32Mbps wireless network

Project proposingProjectingProcurementDeployment

GMON-Skopje Gigabit network

Austrian Gov. Grant

190.000 eur

Proposing

Projecting

Procurement

Video conferencing Educational Services ViCES

Network centre

Stip

Skopje

TetovoSkopje

Bitola

Skopje

Skopje

Serbia

Albania

TEMPUS

vices.marnet.net.mk

SEELight regional project vision

HIPERBHellenic Plan for the Economic Reconstruction

of the Balkan SEE-LIGHT: South-East European Lambda

Network Facility for R&EDeployment of an advanced regional network

infrastructure (lambda network facility) for R&E,

3 countries committed, others in progressSEENet: a management body for SEELIGHT

Current status: Project starts in Serbia & is on the way in Bulgaria

MK status: Available national 20% funds300.000 eur (expected FINKI involvement)

International & national DWDM interconnectivity

SEE Grid eInfrastructure activities – Timeline: 7 years

SEEGRID1/2: building regional Grid infrastructure within and beyond EGEE, building NGIs and user communities [DGINFSO]SEE-GRID-SCI: eInfrastructure for large-scale environmental science user communities: meteorology, seismology, environmental protection. Inclusion of Caucasus. [DGINFSO] All countries in EGI within the same timeframe as rest of EuropeResult: sustainable national Grids, EC funding for EGI like rest of EU (with 67% local funds)HP-SEE: regional HPC interconnection and 2nd generation Caucasus linkExpected result: sustainable national HPC centers, long-term sustainable model with PRACE and DEISA, mirroring GEANT/EGI?

National dimension crucial: Role of NGI In MK this is MARGI – Macedonian Grid Initiative - with leading role of researchers from Institute of informatics

www.see-grid-sci.eu

www.margi.marnet.net.mk

2004-2010 year &HP-SEE from 2010

Infrastructure deployment

Distributed responsibilities forInfrastructure management

Infrastructure operations and QoS

Core services deployed redundantly, spread out

Catch-All Certification Authority + National CAs

Operational tools as shown on previous slide

Grid Operator on Duty (GOOD), Operations manual

Fully interoperable with EGEE, overlapping

SLA definition, monitoring and enforcement and corrective actions

Overall availability of services 91.17%

Job success rate 94,27%

Key results: User communities support

Seismology (6 major applications), meteorology (2) and environmental protection (8)Cross-border user communities and beneficiariesVery clear and efficient procedures for support

Seismology VO

Seismology VO offers the researchers: Access to seismic data mirrored

from national research centers on a timely basis

Adequate computing resources close to the seismology data repositories

Collaborative working environment with both regional groups and global organizations

Core: seismic data server serving large seismic data sets from sensors (TBs) 6 ApplicationsMK Application: Automatic recognition of Earthake locations

Size of Continuous Waveform Data  2.44 TB

No. of stations 86 

Key results: National Grid Initiatives

Before SEE-GRID-SCI

During SEE-GRID-SCI

Initiating and structuring NGIsSEE-GRID pioneer of the NGI conceptSignificant developments in a number of areas: organisational stability, operational maturity, national-level support

Conclusion: we are going toward successful eInfrastructure, deployment in SEE

SEEREN1&2, SEE-LIGHT & BSI & GEANT

Comp physics,Comp chem, Life sciences

Seismology, Meteorology, Environment

SEE-GRID1 & 2 & SCI

HP-SEE

User / knowledge layer

201420132004 2005 2006 2007 2008 2009 2010 2011 2012

SEEREN 1-2 (70-80% EC) SEELIGHT (0% EC)

GEANT (EC of 50% int. interconnection)

EGI (EC 33%)

HP-SEE (50% EC)

Pan-EU HPC Initiative?

SEE eInfrastructure activities – time frame, convergence with EU projects

SEE-GRID 1-2-SCI (100% EC – only international inter-connection)

EGEE (Enabling Grid for E- Sciences)

GN3

SEERA-EI project

One step more

SEERA-EI: regional programme managers (relevant ministries) collaboration towards common eInfrastructure vision, strategy and regional funds [DGRTD]

Core Objective & Expected result: Develop and strengthen the coordination and cooperation of national eInfrastructures programmes in the region of South-East Europe.Ensuring long-term national-level funds and regional funds to complement EC funds

SEERA-EI: the project

Area: "INFRA-2008-3.1: ERA-NET supporting cooperation for research infrastructures in all S&T fields“Start: 1 April 2009Duration: 36 monthsProject type: Coordination and support actionCore Objective: Develop and strengthen the coordination and cooperation of national eInfrastructures programmes in the region of South-East Europe.

Participation of the Programme owners in the region: Ministry of Sciences & Education, Information Society, Development….

www.seera-ei.eu

Our achievements/challenges

Deploy own eInfrastructure part of the SEE/EuropeFrom beneficiary partners become equal or supportive partners in some of projects consortiums and so Part of e-Science in SEE and wider

Challenges: In education

Utilize eInfrastructure in education at all 3 levels of higher education for various target groups (in informatics/non informatics)Create relevant curricula, courses, labs, trainings for various target groups (in informatics/non informatics)Do it eventually as learning objects available on national and international level so shift towards collaborative education.

Questions

THANK YOU