lcg accounting reporting update john gordon, cclrc lcg grid deployment board 5 th april 2006

14
LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

Upload: magnus-charles

Post on 28-Dec-2015

223 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCGAccounting Reporting

Update

John Gordon,CCLRC

LCG Grid Deployment Board5th April 2006

Page 2: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Tier1 Reporting

Page 3: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Background

On 22nd February I sent a list of sites who were not publishing accounting to:-

MB GDB EGEE ROC Managers

I asked them to:-a) check the list for sites in your country or supported by your Tier1/ROC.  I

think these should be obvious but if anyone has problems, let me know. 

b) approach these sites and ask why they are not publishing and report the reason back to me. I will collate the replies. If you consider that they will not be contributing to LHC computing then that is a valid reason for the MB but they may be hearing from EGEE. 

c) make them aware of the LCG policy agreed by the last MB that everyone should publish regular accounts for their LHC VOs by some method (as discussed during my MB Accounting talk)

d) if there are legal or security arguments why they cannot publish, please highlight this so that we can get a working group investigating the implications.  

e) get an estimate from them of when they can start publishing.

Very few replies (none on policies or legal issues) ~72 sites not publishing in last 3 months cf ~150 who have

published at all

Page 4: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

21 February 2006Region Site Name

AsiaPacificGOG-Singapore Taiwan-IPAS-LCG2 Taiwan-NCUCC-LCG2 TOKYO-LCG2

TW-NCUHEP

CentralEuropeBUDAPEST CYFRONET-IA64 egee.man.poznan.pl GUP-JKU SiGNET

WARSAW-EGEE

CERNALBERTA-LCG2 BEIJING-CNIC-LCG2-IA64 BEIJING-LCG2 BNL-LCG2

CARLETONU-LCG2 CERN-CIC

CERN

HPBR-LCG2 HPTC-LCG2ia64 NCP-LCG2 PAkGrid-LCG2SDU-LCG2 TORONTO-LCG2

TRIUMF-GC-LCG2 UIOWA-LCG2

France CGG-LCG2 IN2P3-SUBATECH IN2P3-LAPP

GermanySwitzerland Ekplcg2 GSI-LCG2 ITWM

Italy INFN-BOLOGNA-CMS INFN-CATANIA INFN-LNL-2 INFN-MILANO

Italy INFN-NAPOLI INFN-PADOVA INFN-PISA2 INFN-TORINO

NorthernEuropeBEgrid-KULeuven BEgrid-UGent BEgrid-ULB-VUB BelGrid-UCL HPC2N

Morpheus

NorthernEurope NIKHEF-ELPROD NSC-BLUESMOKE SARA-LISA

RussiaKharkov-KIPT-LCG2 RU-Protvino-IHEP RU-SPbSU ru-Novgorod-NOVSU-

LCG2

SouthWesternEurope UB-LCG2

UKI BITLab-LCG (x2) CAVENDISH-LCG2 UCL-HEP UKI-LT2-IC-LeSC

UKI

cpDIASie csQUBuk csTCDie csUCCie giAITie giDCUie giDITie giITCie giITTAie giITTRie giNUIMie giRCSIie giULie giWITie mpUCDie obsARMuk

Page 5: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Actions from February MB

Countries to give feedback on legal issues with LCG-wide accounting (By April) Finland only

APEL to understand gLite implications (previous talk) Tier1s to help ‘their’ associated sites to deploy and

configure APEL. (More Green sites) or to use their own accounting system to publish to LCG

Repository Sites to check their APEL logs for errors

give feedback to increase reliability and robustness Sites to compare with other sources as reality check

eg if Ganglia shows 90% average utilisation over a month then APEL numbers should agree.

Work with OSG to push/pull their LCG accounting data (Previous talk)

Page 6: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

05 March 2006Region Site Name

AsiaPacificGOG-Singapore Taiwan-IPAS-LCG2 Taiwan-NCUCC-LCG2 TOKYO-LCG2

TW-NCUHEP

CentralEuropeBUDAPEST CYFRONET-IA64 egee.man.poznan.pl GUP-JKU SiGNET

WARSAW-EGEE WARSAW-LCG2

CERNALBERTA-LCG2 BEIJING-CNIC-LCG2-IA64 BEIJING-LCG2 BNL-LCG2

CARLETONU-LCG2 CERN-CIC

CERNHPBR-LCG2 HPTC-LCG2 HPTC-LCG2ia64 NCP-LCG2 SDU-LCG2 TORONTO-

LCG2 TRIUMF-GC-LCG2 UIOWA-LCG2

France CGG-LCG2(*) IN2P3-SUBATECH IN2P3-LAPP

GermanySwitzerland Ekplcg2 GSI-LCG2 ITWM RWTH-Aachen

Italy INFN-BOLOGNA-CMS INFN-CATANIA INFN-LNL-2 INFN-MILANO

Italy INFN-NAPOLI INFN-PADOVA INFN-PISA2 INFN-TORINO

NorthernEuropeBEgrid-KULeuven BEgrid-UGent BEgrid-ULB-VUB BelGrid-UCL HPC2N

Morpheus

NorthernEurope NIKHEF-ELPROD NSC NSC-BLUESMOKE SARA-LISA

RussiaKharkov-KIPT-LCG2 RU-Protvino-IHEP RU-SPbSU ru-Novgorod-NOVSU-

LCG2

SouthEastEurope MK-01-UKIM_II

SouthWestEurope UB-LCG2

UKIBITLab-LCG (x2) CAVENDISH-LCG2 UCL-HEP UKI-LT2-IC-LeSC QMUL-

eScience

UKI

cpDIASie csQUBuk csTCDie csUCCie giAITie giDCUie giDITie giITCie giITTAie giITTRie giNUIMie giRCSIie giULie giWITie mpUCDie obsARMuk

Page 7: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

05 April 2006 (incomplete)Region Site Name

AsiaPacificGOG-Singapore Taiwan-IPAS-LCG2 Taiwan-NCUCC-LCG2 TOKYO-LCG2

TW-NCUHEP

CentralEuropeBUDAPEST CYFRONET-IA64 egee.man.poznan.pl GUP-JKU SiGNET

WARSAW-EGEE WARSAW-LCG2 AMD64.PSNC.PL

CERNALBERTA-LCG2 BEIJING-CNIC-LCG2-IA64 BEIJING-LCG2 BNL-LCG2

CARLETONU-LCG2 CERN-CIC

CERNHPBR-LCG2 HPTC-LCG2 HPTC-LCG2ia64 NCP-LCG2 SDU-LCG2 TORONTO-

LCG2 TRIUMF-GC-LCG2 UIOWA-LCG2

France CGG-LCG2(*) IN2P3-SUBATECH IN2P3-LAPP

GermanySwitzerland Ekplcg2 GSI-LCG2 ITWM RWTH-Aachen

Italy INFN-BOLOGNA-CMS INFN-CATANIA INFN-LNL-2 INFN-MILANO

Italy INFN-NAPOLI INFN-PADOVA INFN-PISA2 INFN-TORINO

NorthernEuropeBEgrid-KULeuven BEgrid-UGent BEgrid-ULB-VUB BelGrid-UCL HPC2N

Morpheus

NorthernEurope NIKHEF-ELPROD NSC NSC-BLUESMOKE SARA-LISA

RussiaKharkov-KIPT-LCG2 RU-Protvino-IHEP RU-SPbSU RRC-KI ru-Novgorod-

NOVSU-LCG2

SouthEastEurope MK-01-UKIM_II TAU-LCG2

SouthWestEurope UB-LCG2

UKIBITLab-LCG (x2) CAVENDISH-LCG2 UCL-HEP UKI-LT2-IC-LeSC QMUL-

eScience UKI-LT2-CENTRAL

UKI

cpDIASie csQUBuk csTCDie csUCCie giAITie giDCUie giDITie giITCie giITTAie giITTRie giNUIMie giRCSIie giULie giWITie mpUCDie obsARMuk

Page 8: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Comments

We have observed that the list of sites not publishing has a few false positives.

Some non-publishing sites may be publishing under another name (mainly sorted)

Some flagged sites were not yet in production. No way of flagging old that should no longer be

publishing. Type=Closed proposed NIKHEF publish from their own database and are

seeing an R-GMA problem. (??)

Page 9: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Page 10: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Page 11: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Reporting to CRRB

The OB wants the CRRB to receive monthly figures for LHC use at Tier1 Centres

to start with We have sufficient CPU reporting in APEL for T1s

but only report Grid work How many T1s run significant non-Grid LHC work?

Not ready with tape and disk reporting yet So what do we do?

How about manual reporting? Example courtesy of Manuel Delfino

Page 12: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Page 13: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Which Numbers?

What numbers are to be input? CPU easy, use APEL or your local system

Normailise to SI2K kilohours as in APEL Disk and tape are not so easy

TBdays integrated over the month? months have different numbers of days

Average TB/day ? A snapshot on the 1st (or last) day of the month? all per LHC VO allocated or used space?

Page 14: LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG

John Gordon – GDB 5 April06

Can we do better?

A simple tool could take the manually produced disk and tape numbers and publish them to the central APEL respository

The change to automatic measurement and submission would then be controlled and easily phased in.