status of the desy grid centre volker guelzow for the grid team desy it hamburg, october 25th, 2011

Status of the DESY Grid Centre

Volker Guelzow for the Grid TeamDESY ITHamburg, October 25th, 2011

Volker Guelzow | PRC | 25.10.2011 | Page 2

Outline

> The 2011 DESY Grid centre status

>Requests and Pledges for WLCG

> The NAF@DESY

> PRC relevant IT-Projects @DESY

> The German Tier 2 situation

> Summary

Volker Guelzow | PRC | 25.10.2011 | Page 3

DESY Grid Centre usage by VO

Volker Guelzow | PRC | 25.10.2011 | Page 4

The German T2‘s (Atlas, CMS, LHCb)

Pledges for Germany

CPU 2012 [HS]

CPU 2012 [% Tot]

Disk 2012 [TB]

Disk 2012 [% Tot]

A DESY 12000 5 1500 3C Aachen/DESY 23625 8 1950 8A Goettingen 3853 1 1000 2A Munich 11560 4 1340 3A FR/Wupp 8860 3 1566 3 L DESY 3200 7  2  10Summe CMS 23625 8 1950 8Summe Atlas 36273 13 5406 11

SumDESY 29950 2852 SumNonDESY 33346 4506

Grand Tot Atlas-T2

266000 47000

GrandTot CMS- T2

315000 26000

Volker Guelzow | PRC | 25.10.2011 | Page 5

Atlas delivered vs. pledged CPU resources@DESY

Volker Guelzow | PRC | 25.10.2011 | Page 6

CMS delivered vs pledged computing

Volker Guelzow | PRC | 25.10.2011 | Page 7

DESY T2 availability/reliability from WLCG monitoring

Volker Guelzow | PRC | 25.10.2011 | Page 8

ATLAS: DESY and German Cloud contributions (1)

>DESY (HH+ZN together) competing with ATLAS T1’s

> All jobs since 1.1.2011:

Volker Guelzow | PRC | 25.10.2011 | Page 9

ATLAS: DESY and German Cloud contributions (2)

> Excellent reliability:

> ATLAS GangaRobot hourly tests: Expect 95% reliability

Aug&Sept 2011, all ATLAS T2

Volker Guelzow | PRC | 25.10.2011 | Page 10

CMS Tier-2 Contribution

Volume of subscribed data sets at Tier-2sTB

T2_D

E_D

ESY

T2_C

H_ C

ERN

T2_U

K_ L

ondo

n_IC

T2_U

S_ V

ande

rbilt

T2_U

K_ S

Gr id

_RA

LPP

T2_U

S_ C

alt e

chT2

_US

_ Wis

cons

inT2

_US

_ Pur

d ue

T2_U

S_ F

lor id

aT2

_US

_ Neb

rask

aT2

_US

_ MIT

T2_F

R_ I

PHC

T2_U

S_ U

CS

DT2

_ES

_ CIE

MA

TT2

_BE_

IIHE

T2_F

R_ G

RIF

_IR

F UT2

_IT_

Rom

eT2

_IT_

Bar

iT2

_FR

_ CC

IN2P

3T2

_IT_

P isa

T2_B

E_U

CL

T2_F

R_ G

RIF

_LL R

T2_R

U_ J

INR

T2_I

T_L e

gnar

oT2

_IN

_ TIF

RT2

_UK

_ Lon

don_

Bru

n el

T2_A

T_V

ien n

aT2

_CH

_ CS

CS

T2_E

S_ I

FCA

T2_D

E_R

WT H

T2_C

N_ B

eij in

gT2

_EE_

Esto

nia

T2_T

W_T

aiw

anT2

_FI_

HIP

T2_B

R_ U

ERJ

T2_H

U_ B

udap

est

T2_T

R_ M

ETU

T2_R

U_ S

INP

T2_U

A_K

IPT

T2_P

L_W

arsa

wT2

_UK

_ SG

r id_B

risto

lT2

_PT_

NC

G_L

isbo

nT2

_RU

_ IN

RT2

_PK

_ NC

PT2

_PT_

LIP_

Lisb

o nT2

_RU

_ ITE

PT2

_RU

_ PN

P IT2

_PL_

Cra

c ow

0.00

100.00

200.00

300.00

400.00

500.00

600.00

700.00

800.00“Unregistered” data DESY[TB] RWTH[TB]

/store/user 290* 113

/store/group 14 78

*580TB brutto

FNALLPC=US “interactive” analysis facility

Analysis & MC production jobs since June 2011Still large failure fraction

- Wasting ~20% of resources- Mainly bad user jobs

- Very good performance- DESY is a very important CMS Tier-2

- Very good performance- DESY is a very important CMS Tier-2

Subscribed Phedex data

TB

Volker Guelzow | PRC | 25.10.2011 | Page 11

NAF usage

>NAF well utilized.

>Operation very smooth and reliable since last PRC

>UHH/CMS strong user (own purchases!)

CPU usage 15.4-15.10.2011

Lustre usage 20.10.2011

Volker Guelzow | PRC | 25.10.2011 | Page 12

NAF CPU resources

> Total (with recent purchases) 41.3 kHS06

3000 Slots

Huge contribution UniHH/CMS

>Detail on purchases in 2011 7.8 kHS06/576 cores: 0.5 replacement, 0.5

enlargement beginning 2011 (from DESY budget)

3 kHS06/192 cores: mostly replacement in Zeuthen recently (from DESY budget)

9.2 kHS06/672 cores: upgrade in Hamburg recently (from DESY budget)

9.2 kHS06/672 cores: upgrade in Hamburg recently (from UniHH/CMS group!)

> Plan for 2012 Await technology change end 2011 (AMD

Interlagos) / 2012Q1 (Intel SandyBridge), planning end of 2012Q1

In 2012: Plan for additional 10 kHS06

NAF purchases given to experiments accordingto the key 4 ATLAS / 2 CMS / 1 ILC / 1 LHCB

Volker Guelzow | PRC | 25.10.2011 | Page 13

Datatransfer from Storage Element (1 week sample)

Volker Guelzow | PRC | 25.10.2011 | Page 14

Future plans for the NAF

>Replacement of Lustre file system call for tenders ongoing

> Strengthen NAF reliability, availability and performance reduce impact on the HH-ZN WAN network connection

make two NAF parts more independent

>New features for NAF, requested by users e.g. Fast X-Connection, collaborative tools, …

>Hardware enlargement plans: See slide “NAF CPU resources”

Volker Guelzow | PRC | 25.10.2011 | Page 15

PRC relevant IT-Projects@DESY

>Helmholtz Alliance until end 2012

> Tier 1 for Icecube and Computing for CTA in Zeuthen

> LHCone: Initiative to connect T2‘s and T3‘s, needs more experience and monitoring for further decisions

> European Middleware initiative (dCache) until mid 2013

> Large Scale Datamanagement project starting in 2012

> Active role in HPC- initiative of the HGF (may end in funding)

Volker Guelzow | PRC | 25.10.2011 | Page 16

The German Tier 2 Situation

> Funding of the NAF@ DESY secured through base investment

> Funding of Tier 2‘s@DESY secured trough base&capital investment

> Funding of ½ Tier 2 @MPI secured

> Funding of Universities‘ Tier 2: Invest only secured until mid 2012

Different ideas are under debate, DESY may be asked to act as a coordinator

Volker Guelzow | PRC | 25.10.2011 | Page 17

Summary

> The DESY-Grid-Centre again was very reliable

> The DESY T2 Centre is larger than some T1‘s centres

> The DESY T2 is very attractive because of the available data

> The NAF was used intensively and nationwide

> The NAF is in the process of further development, major upgrades took place and are planned

> dCache is still the major working horse for LHC datamanagement and DESY has the lead

>DESY is very active in attracting 3rd party money

> There is still an open financing issue for the Universities‘ Tier 2 after end 2012