Nick Brook
• Current status
• Future Collaboration Plans
• Future UK plans
5th November 2001 GridPP Collab Meeting 2
Needs & Requirements
The Goals of the LHCb Data Challenge Size Date 3*106 event bursts 2000-2001 6*106 event bursts 2002-2003 107 event bursts 2004-2005
Extrapolated hardware profile for large scale MC production in UK
End 2001 Jan 2003
CPU(SI95) 5650 13200-24750
Disk (Tb) 3.5 7-14
Robotic Tape (Tb)
2-13 23-48
5th November 2001 GridPP Collab Meeting 3
Current Status
UK major external Monte Carlo production centre (RAL & MAP)
UK major i/p to formulation of LHCb Grid plans
Frank Harris (Oxford) 75% (WP8 & external computing coordination)
Nick Brook (Bristol) 50%(UK coordination & analysis model)
Glenn Patrick (RAL) 30%(analysis model & testbed)
Girish Patel (Liverpool) 20%(MAP+testbed)
Ulrik Egede (IC) 10%(analysis model)
Artur Barczyk (Edinburgh)
20%(analysis model)
Akram Khan (Edinburgh) 20%(testbed+WP2,analysis framework)
Ian McArthur(Oxford) 20%(metadata management)
A N Other (Oxford) 100%(Gaudi/Grid- WP8)
Chris Jones (Cambridge) 10%(analysis model)
5th November 2001 GridPP Collab Meeting 4
Monte Carlo Production
Centre OS Max (ave) nos. of CPUs used simultaneously
Typical weekly produced (nos. of k evts)
Percentage submitted through Grid
CERN Linux 315(60) 85 10
RAL Linux 50(30) 35 100
IN2P3 Linux 225(60) 35 100
Liverpool Linux 300(250) 150 0
Bologna Linux 20(20) 35 0
Hope to include ScotGrid & Bristol soon
5th November 2001 GridPP Collab Meeting 5
Monte Carlo Production
Execute on farmSubmit via Web
Performance monitoring via web
Update database at CERN Transfer to mass storage at
CERN
Data quality checking
5th November 2001 GridPP Collab Meeting 6
Monte Carlo Production
Execute on farmSubmit via Web
Performance monitoring via web
Update database at CERN
Transfer to mass storage at CERN, RAL, …
Data quality checking
WP1 submission tools
WP4 environment
WP1 submission tools
WP3 monitoring tools
WP2 metadata tools
WP1 tools
WP2 data replication
WP5 API for mass storage
Online histos production using
Grid pipes
5th November 2001 GridPP Collab Meeting 7
MC Production Requirements
• Production site aware scripts• Installation kits• System should be resistant crashes of:
– any share filesystem used– book-keeping database system– mass storage system– file transfer technology– job submission system– LHCb executables!
• Scalability i.e. easy to add new MC production site• Allow replication of remote datasets• Monitoring and control of the LHCb MC system
Interface to GANGA
5th November 2001 GridPP Collab Meeting 8
Installation Kit Requirements
• Production Installation Kit– Installs self-contained run time environment
• given version of executable• “call” external dynamic libraries in a “path independent” way• appropriate detector database• script to check installation
– Original format compatible with EDG WP4 i.e. RPM’s– Production on Windows platform??
• Developers Installation Kit– Installs self-contained developers environment
• Source code• Appropriate detector database• CMT, CVS, C++ installation if needed
– Supports Windows
Interface to GANGA
5th November 2001 GridPP Collab Meeting 9
What is Gaudi?
Converter
Algorithm
Event DataService
PersistencyService
DataFiles
AlgorithmAlgorithm
Transient Event Store
Detec. DataService
PersistencyService
DataFiles
Transient Detector
Store
MessageService
JobOptionsService
Particle Prop.Service
OtherServices
HistogramService
PersistencyService
DataFiles
TransientHistogram
Store
ApplicationManager
ConverterConverterEventSelector
5th November 2001 GridPP Collab Meeting 10
Gaudi & The Grid World
Converter
Algorithm
Event DataService
PersistencyService
AlgorithmAlgorithm
Detec. DataService
PersistencyService
MessageService
JobOptionsService
Particle Prop.Service
OtherServices Histogram
ServicePersistency
Service
ApplicationManager
ConverterConverterEventSelector
Analysis Program
OSMass
Storage
EventDatabasePDG
Database
DataSetDB
Other
MonitoringService
HistoPresenter
Other
JobService
Config.Service
Transient Detector
Store
TransientHistogram
Store
Transient Event Store
5th November 2001 GridPP Collab Meeting 11
GANGA: Grid And Gaudi Alliance
GAUDI Program
GANGAGU
I
JobOptionsAlgorithms
Collective&
ResourceGrid
Services
HistogramsMonitoringResults
5th November 2001 GridPP Collab Meeting 12
GANGA Requirements
• Prior to job submission– configuration of Gaudi program e.g. algorithm
selection, event data i/p, requested o/p,…– Grid services estimations of resource reqt e.g. CPU,
storage, …– user job reqts e.g. s/w needed– submitting job (or parallel sub-jobs)
• During execution– monitor progress – displaying of messages,
histograms,…• After execution
– termination status and validation– e.g. MC production – o/p files on mass storage &
updating of book-keeping database– e.g. analysis - return o/p to user
5th November 2001 GridPP Collab Meeting 13
• ATLAS & LHCb are using the same s/w framework – Athena /Gaudi
• Large part of proposed work has overlap e.g. GANGA grid interfaces
• Proposed programme has been discussed not only betweeh the 2 UK collaborations BUT also at CERN
ATLAS & LHCb
5th November 2001 GridPP Collab Meeting 14
Summary
• Proposing a challenging programme• Programme developed in conjunction with central
collaboration• Programme developed in conjunction with ATALS
as a whole & in the UK• Requesting for a minimum of 8 staff years of effort
(some will be common with ATLAS)• UK already playing a leading role in the LHCb Grid
activities• UK already leading centre(s) in producing Monte
Carlo for LHCb