status of the grid in the czech republic

11 September 2007 Milos Lokajicek Institute of Physics AS CR Prague

Status of the GRID in the Czech Republic

NEC’2007

11 September 2007 NEC'2007 2

Outline

• CZ pre-grid activities

• Grid activities

• Grid status– Networking– Distributed Tier2 center and its performance

• Conclusions


CZ pre-grid activities

• Synergy of the Czech pre-grid activities in 90ties– Particle Physics– MetaCentrum Project– CESNET

• Particle physics active collaboration– DELPHI experiment on LEP at CERN– H1 experiment on HERA at DESY– Several smaller experiments– Collaboration groups

• Institutes of the Academy of Sciences of the Czech Republic• Charles University in Prague• Czech Technical University in Prague



• MetaCentrum Project– Collaboration of the Czech universities supercomputing centers– Create single computing environment for academic users– Single user login, same user interfaces and application

interfaces independent on HW or OS– Single queuing system– OpenAFS Kerberized system, same authentication credentials – Originally Masaryk University in Brno, West Bohemia University

in Plzen and Charles university in Prague– Now project of CESNET with contribution of Universities– Resources in 4 sites

• 1000 CPUs, mainly IA-32/64 architecture, • Tens of TB disk space, tape archives in Plzen and Brno

– Partner to international EGEE and EGI_DS (European Grid Initiative Design Study), national MediGRID project



• CESNETCzech scientific research network provider

• 1992 first ip line to Austria• 1993 country-wide backbone network connecting 8 cities• Member/stake holder of all important European network

activities• Today legal structure: Association of legal bodies

created by Academy of Sciences of the Czech Republic and Czech Universities

• Connects all Czech Universities with high bandwidth network

• Current charge of CESNET – Research network, novel application over network, grid activities


Grid activities

• Preparation of LHC project– Monarch project at CERN, widelly distributed hierarchical model– CHEP conference in Padova 2000

• Reached agreement in HEP community of grid – EDG (European DataGRID) from 2001

• And other parallel grid projects• Similar situation in U.S.A.

– Czech Republic (CESNET and Institute of Physics AS CR) took part from beginning

• Testbed and HEP applicaton, Logging and bookkeeping of the Workload management package

– EGEE, EGEEII, … EGEEIII, EGI Design Study, CESNET as partner

• Preparation of local NGI (National Grid Initiative) – a tough task– LCG, WLCG – participation via Institute of Physics AS CR– Distributed TIER 2 center in Prague


Grid Status• Distributed TIER 2 center in

Prague– Golias farm Institute of

Physics AS CR– Skurut farm CESNET

• EGEEII– Pre/Production services– Reengineering – logging and

bookkeeping, job provenance– VOCE – Central Europe

Federation VO• Proposed by CESNET• Running it main services• All purpose research VO for

CE– AUGER VO support


Grid Status• Networking• CESNET2

network– Integrated to

GEANT2– Highly reliable

backbone of redundant circles of dark fibers

– Cross-boarder connections


Grid Status

• Special 1 Gbps infrastructure for HEP• GLIF

– Prague – FNAL D0– Prague – Taipei ATLAS Tier1– Prague - BNL soon in production

• GN – Prague – FZK ATLAS Tier1

GLIF

GN2

• Local 10/1 Gbps infrastructure in Prague

– Collaborating groups in Academy of Sciences

– Charles and Czech Technical Universities in Prague


TIER2 distributed center performance



• End 2007 capacities

• Main usage– D0 experiment simulations and reconstruction 50%– ATLAS, ALICE, STAR, VOCE, Auger computing, solid state

physics– Support for VO: VOCE, Auger

• Preproduction and Preview testbeds

Computing capacity kSI2k

Number of cores Disk capacity TB

GOLIAS 670 458 60

SKURUT 30 38 Shared from Golias



• Contribution to the D0 experiment

• 0.5 M events per week in 2006/2007• 3rd biggest contribution to simulations


TIER2 distributed center performance• DPM transfer test Prague to Taipei

• 1 Gbps line, RTT 310ms, 50 streams per file, 10 files in parallel, size of file 1 GB, tcp buffer 100 MB

• 1 hour test, average 31 MB/s, maximum 53 MB/s• Transfer Taipei to Prague only 20 MB/s, problems with Prague servers stability, further

test ongoing



• Should be compared withFZK Karlsruhe to Prague transfer

• 1 Gbps line, 10 streams per file, 10 files in parallel, file size 1 GB, tcp buffer default value

• 5 hour test, average 48 MB/s, maximum 75 MB/s



• Monitoring – key for reliable service– both standard grid monitoring and

local HW, SW and services monitoring

• Local monitoring (Talk of Tomas Kouba)– Nagios – various plugins and workarounds– Interface for dynamic configuration of nagios

according to our HW and SW database– Reduction of nagios warning

• Critical nagios warnings – distributed immediately• Other warnings – summarized in a developed digest and

distributed 3 times per day only


Conclusions• Czech Republic – partner of EU grid projects from 2001• Activities both in grid deployment and reengineering• Middle sized distributed TIER2 center fully integrated into

EGEE/LCG environment – Delivery of well visible computing services to experiments and

projects– Data transfer services over special lines– Support of VOs VOCE and Auger– Active contribution for reengineering – logging and bookkeeping

and recently job provenance• All this is supported by excellent quality of CESNET2

network and special E2E lines both local and international

• Taking part in preparation EGEEIII and EGI projects• Big effort will be needed to create Czech NGI

status of the grid in the czech republic

Documents

czech pregrid activities

czech republic cesnet

czech universitiesconnects

masaryk university

praguenow project of

academy of sciences

west bohemia university

gbps infrastructure