lcg accounting/reporting john gordon, stfc mb november 9 th 2011

11
LCG Accounting/Reporting John Gordon, STFC MB meeting @CERN November 9 th 2011

Upload: jeffrey-adrian-marshall

Post on 19-Jan-2018

216 views

Category:

Documents


0 download

DESCRIPTION

LCG There are changes being made to the way the APEL infrastructure runs, and other Grids publish to it. These should be of interest to sites but not the MB. –Include ARC, Unicore, Globus –Local jobs from CERN See tomorrow’s GDB for details. 3 Changes to APEL

TRANSCRIPT

Page 1: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

Accounting/Reporting

John Gordon, STFCMB meeting @CERN November 9th 2011

Page 2: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

2

Outline

• Changes to APEL

• Changes to Accounting Portal

• Reminder of functionality

• Issues

• New Requirements?

Page 3: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

3

• There are changes being made to the way the APEL infrastructure runs, and other Grids publish to it.

• These should be of interest to sites but not the MB.– Include ARC, Unicore, Globus– Local jobs from CERN

• See tomorrow’s GDB for details.

Changes to APEL

Page 4: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

4

• The layout of graphs and the colour schemes have changed

• This was a complete internal rewrite so watch out for changes in behaviour and report them,

• More flexible graphics– Bugs have been raised about the labelling on the

graphs.• Query interface returns XML

– Allows saving query and programmatic interface– Needs documenting– See the custom interface

Changes to the Accounting Portal

Page 5: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

5

Page 6: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

6

Page 7: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

7

• Accounting records for cpu used by batch jobs are published in several ways to the central APEL Repository.

• This is the worldwide repository for the LHC VOs.

• It publishes summaries of the data to the Accounting Portal @ CESGA where it can be dynamically queried and a number of standard reports produced.

Brief Summary Of Features

Page 8: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

8

• Njobs, cpu, wallclock, normalisedcpu, normalisedwallclock, cpuefficiency,

• As a table, graphs, and download• Tables and graphs of one of above, download of all.• Any timespan of months.• Any VO, all, or a selection• Trees for Countries, NGIs, T1, T2• Display any point in the tree and below from top to

site level.• Date, VO, (Site/Region/Country) as a function of

one of the others.

Can View:

Page 9: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

9

• Reports:– T1– T2 including pledges

• Views– User – see your own jobs– VO Member – see FQAN in VO (top 10)– VO Manager – see UserDN in VO (top 10)– Site Admin – see UserDN at site, FQAN just

added.

Page 10: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

10

• T2 VOs• Ticket about a T2 reporting use by a VO to whom

they didn’t pledge. Poor efficiency a reputational risk to the VO.

• T2 Tree shows ALL VOs at T2 sites.– Can select but default is all LHC.

• T2 Report only shows pledged VOs– Did agree to show installed capacity but no progress

• Personal opinion that two views cover the use cases. Only the T2 report should reflect badly on T2 or VO.

Issues

Page 11: LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011

LCG

11

• See ALL UserDNs, not just top ten. – (VO Manager)

• See ALL FQANs, not just top ten – (VO Member)

• See ALL Users (site admin)• Select a specific UserDN• Drill down on userDN and FQAN to see

sites.• ?????????

Requirements