Grid and High Energy Physics

Paula EerolaLunarc, 19.4.2002

Artist’s view on Grid, by Ursula Wilby, Sydsvenskan 10.2.2002

Paula EerolaLunarc, 19.4.2002

2

High Energy Physics and Grid

(108 events=3.5 PetaBytes)/year

Paula EerolaLunarc, 19.4.2002

3

High Energy Physics Computing

High Throughput ComputingData consists of independent eventsComputing in parallel – not parallel

computingUse inexpensive mass market componentsUse nationally available resourcesNeed inexpensive, distributed, scalable

systemGRIDA fully operational GRID-system has to

work when the Large Hadron Collider, LHC, starts in 2007

Paula EerolaLunarc, 19.4.2002

4

Computing Model for LHC data processing

Central Computer Center (CERN)

Regional CentreFrance

Regional CentreNordic Countries

Regional CentreUK

Regional CentreGermany

Regional CentreN.N.

Regional CentreItaly

Grid CentreSweden

Grid CentreFinland

Grid CentreNorway

Grid CentreDenmark

Grid InstituteLocalGrid Institute

LocalGrid InstituteLocalGrid Institute

LocalGrid InstituteLocal

Grid CentreGrid Centre

Grid CentreGrid Centre

Grid Centre

Grid Centre

The Grid ConceptLevel 0

Level 2

Level 1

Level 3dBdBdB

dBdB

dBdB

dBdB

dBdBdBdB

dBdBdB

Data Grid concept in high energy physics applications

Paula EerolaLunarc, 19.4.2002

5

What is Grid? A technology to join together computers at

different locations, and to provide easy access to this capacity.

User can get access to computer capacity anywhere in the Grid.

World-wide-webaccess to information World-wide-gridaccess to PC capacity

Initiated in the end-90’s in the US by physicists who wanted to connect together the US supercomputer centers. Ian Foster, Carl Kesselman, July, 1998: The GRID; Blueprint for a new Computing Infrastructure

Paula EerolaLunarc, 19.4.2002

6

Who are interested in Grid?All areas of basic research which deal

with large amounts of data and/or large computing requirements, for example biomedicine, earth sciences, space/astrophysics, particle physics, etc.

All areas of applied research which deal with large amounts of data and/or large computing requirements, for example analysis of financial markets, industrial process optimization, industrial design, etc.

Paula EerolaLunarc, 19.4.2002

7

Who are interested in Grid?

Huge commercial interests: film animation, electronic commerce etc.

IBM, Sun, Compaq, Platform Computing are some of the companies which have joined the Grid development

IBM: Grid-enable the company’s entire product portfolio. Close cooperation with the open source Globus development.

Platform Computing: Recently acnnouned the first commercial Grid software, the Platform Globus.

Paula EerolaLunarc, 19.4.2002

8

Swedish HEP Grid activitiesMarch 2000 Lund workshop: first discussion

on using Grid for basic research in particle physics

During 2000: CERN-EU DataGrid and Nordic NorduGrid projects are formed. Lund group (Elementary Particle Physics, EPF, at the Lund University) active in both projects.

Testbeds: building, testing and developing Grid in the framework of DataGrid and NorduGrid. Generic research in Grid-systems.

Paula EerolaLunarc, 19.4.2002

9

NorduGrid

NorduGrid – NordicTestbed for Wide area Computing and Data Handling

www.nordugrid.org

The pioneering Grid project in the Nordic countries

Paula EerolaLunarc, 19.4.2002

10

NorduGrid objectives

Introduce the Grid to the Nordic countries

Create a Grid infrastructure in Nordic countries

Survey and develope current Grid technologies

Operate a functional Testbed

Expose the infrastructure to end-users of different scientific communities Sites: Lund,

Copenhagen, Oslo, Bergen, Uppsala, Stockholm, Helsinki

Paula EerolaLunarc, 19.4.2002

11

NorduGrid project

The project was initiated by the Nordic High Energy Physics community

–LHC data challenge of CERN (several Petabytes / year)–Operates as part of the CERN-EU DataGrid Testbed–Physicists are among the driving forces of the World Wide Grid developement

The project is financed via the Nordunet2 programme. Project duration Jan 2001 - Nov 2002.

Continued NorduGrid is being planned under NOS-N.

Paula EerolaLunarc, 19.4.2002

12

NorduGrid progress Hardware: dedicated test clusters

at 5 sites (3-5 machines), separate test machines at 2 sites:7 Grid-connected sites

Manpower: 5 full time researchers (O. Smirnova & B.Kónya Lund, A. Wäänänen Copenhagen, M. Ellert Uppsala, A. Konstantinov Oslo)

Design and implementation of the NorduGrid Middleware Architecture

Deployment & evaluation of the first release of the CERN-EU DataGrid Middleware (Information index, Job submission interface, Broker)

Paula EerolaLunarc, 19.4.2002

13

NorduGrid status April 2002 Grid-services which are

now fully functional:Certification

Authority, NorduGrid

Information System browser

NorduGrid Virtual Organization,

Grid Data Mirroring Package GDMP and Data Replication Catalog

GridFTP. Stable software

releases and documentation

Based on the Globus Toolkit™A new jobmanager is

writtenA User Interface is

addedThe appropriate

information schema is deployed

Extensions to the Globus Resource Specification Language are made

March 28, 2002: first REAL job is submitted from Lund to Oslo and successfully returned all the expected output

Paula EerolaLunarc, 19.4.2002

14

CERN-EU DataGridSwedish participation in the EU

DataGrid project: VR (SWEGRID) is an associate partner to CERN.

WP2 Data Management (PDC), WP6 Testbeds (NorduGrid), WP8 HEP Applications (NorduGrid), WP10 Biology Applications (KI),

In total EU-IST funds different Grid projects (DataGrid, CrossGrid, DataTag, EGSO, Gridlab,…) – ranging from applications to middleware to infrastructure – for 36 MEuro

Paula EerolaLunarc, 19.4.2002

15

Planned future: Nordic Data Grid Facility

In 2004 it is foreseen that a Nordic Data Grid Facility will be created.

The Nordic Facility will be a so-called Tier-1 Centre with a capacity of about 1700 x (Dual 1 GHz Intel PIII) plus fileservers and tape robots.

Financial scope 150 MSEK (16MEuro).

The Facility will serve all interested fields of science. 0,000

1,000

2,000

3,000

4,000

5,000

6,000

7,000

2003 2004 2005 2006 2007

YearIn

vest

men

ts (M

€)

Processors

Storage media

Prototype phaseNational competence build-up

------ Nordic Data Grid facility -----

Paula EerolaLunarc, 19.4.2002

16

Nordic Data Grid FacilityWorking paper by a NOS-N working

group (April 4, 2002): road map towards the Nordic Grid Facility

2002 2003 2004 2005 2006 2007

International EvaluationRecommendations

Competition for location of Nordic Grid Facility

Competence BuildingNordic Funding for co-ordination

of Nordic co-operation

Nordic AgreementInvestments in Nordic Grid Facility

Capacity BuildingConsolidation

Prorotype period 2002-2004:continued NorduGrid. Scope 0.54 MEuro.

Capacity building 2004-2007: Scope 15 MEuro.

Paula EerolaLunarc, 19.4.2002

17

Planned future: SwedenContinued NorduGrid 2002-2004: build-

up of competence in Lund-EPF and elsewhere.

Build-up of resources: multidisciplinary project for Development of GRID testbed in Sweden in preparation.

Includes biomedical science, earth sciences, space/astrophysics, high-energy physics (incl. Lund-EPF), information sciences, computer centers (incl. Lunarc).

Could become part/first phase of the Nordic Data Grid Facility.