computing - in2p3 events directory (indico) · 2013. 3. 18. · national institute for nuclear...
TRANSCRIPT
P-E. Macchi15 mars 2013
ComputingRestricted ECFA visit of France
1
15 mars 2013
CC-IN2P3 within the French scientific framework
Main scientific organization in
France
National Institute for Nuclear Physics and
Particle PhysicsDedicated Computing
Center
CC-IN2P3 federates the main computing resources
For :• High energy physics• Nuclear physics• Astroparticle physics
Atomic Energy Commission
+ some opening to other sciences
Manpower: 80 people – 65 IT engineersBudget: 10 -‐ 12 M€ including salaries
Resource
s Mutualisa
tion
2
15 mars 2013
LHC
HESS
Auger
Planck
AMS
ANTARESSupernovae
VIRGO
Fermi
~70 groups are using CC-IN2P3 resources
1.7 MHS06.hours this year
3
15 mars 2013
CC-IN2P3 within the global W-LCG organization
CC-IN2P3FZK
PIC
NDGF
NIKHEF
ASCC
Brookhaven
Fermilab
TRIUMF
RAL
CNAF
T1
T0T2
Île de France
Clermont
Nantes
Lyon
CC-IN2P3
CC-IN2P3
Annecy
T3
Strasbourg
Marseille
Grenoble
KISTI
4
15 mars 2013 5
15 mars 2013
LCG France
6
Role Site ALICE
ATLAS
CMS
LHCb
Tier-1 IN2P3-CC ✓ ✓ ✓ ✓
IN2P3-CC-T2 (AF) ✓ ✓ ✓ ✓
IN2P3-CPPM ✓ ✓
GRIF ✓ ✓ ✓ ✓
Tier-2
IN2P3-LPC ✓ ✓ ✓2
IN2P3-IPHC ✓ ✓
IN2P3-LAPP ✓ ✓
IN2P3-LPSC ✓ ✓IN2P3-SUBATECH ✓
Tier-3 IN2P3-IPNL ✓ ✓
15 mars 2013
Evolutions of the Computing Models
T0 T0
T1 T1
T2 T2
T2
T2 T2
T2
T2 T2
T2
T1 T1
T2 T2
T2
è LHC Open Network Environment Project
7
15 mars 2013
15 mars 2013
CC-IN2P3 resources for LCG
8 PB LHC
17 PB
~16 000 tasks en //
11 PB Total
9
15 mars 2013
CC-IN2P3 within W-LCG 2013CA#TRIUMF*
4,72%*
FR#CCIN2P3*9,96%*
DE#KIT*15,77%*
IT#INFN#CNAF*13,03%*
NL#T1*8,15%*
NDGF*4,29%*
KR#KISTI#GSDC*3,70%*
ES#PIC*4,56%*
TW#ASGC*5,01%*
UK#T1#RAL*11,29%*
US#FNAL#CMS*8,58%*
US#T1#BNL*10,95%*
Pledged*CPU* 67.3 kHS06CA#TRIUMF*
4,69%*
FR#CCIN2P3*9,37%*
DE#KIT*14,56%*
IT#INFN#CNAF*12,96%*
NL#T1*6,35%*
NDGF*3,63%*
KR#KISTI#GSDC*1,34%*
ES#PIC*4,75%*
TW#ASGC*5,72%*
UK#T1#RAL*11,03%*
US#FNAL#CMS*14,73%*
US#T1#BNL*10,85%*
Pledged*Disk*Capacity* 7 PB
CA#TRIUMF*3,80%*
FR#CCIN2P3*8,87%*
DE#KIT*15,09%*
IT#INFN#CNAF*13,98%*
NL#T1*5,61%*NDGF*
3,79%*
KR#KISTI#GSDC*1,33%*
ES#PIC*4,73%*TW#ASGC*
3,54%*
UK#T1#RAL*10,42%*
US#FNAL#CMS*21,24%*
US#T1#BNL*7,61%*
Pledged*Tape*Capacity*
10 PB10
15 mars 2013
Infrastructure evolution
The very fast increase of the computing equipments installed at CC-IN2P3 created a huge load on the infrastructure
Now stabilized around 1.6 MW with peaks ~1.8 MW
during the summer
11
Forecast : LHC to grow for 20 to 25% each year - Huge needs for upcoming astroparticles experiments like LSST
15 mars 2013
New computing room project
12
15 mars 2013
201150 racks600 kW
Redundancy N+1Minimum electrical
autonomy
2019240 racks3.2 MW
Redundancy N+1 and 2NRedundant HV Power
The electrical redundancy is provided by 2 independent HV power supplies – No diesel generator
On top of the existing 1 MW computer room
Intermediate phase80 racks 600 kW Partial electrical
redundancy
2015120-160 racks
1.5 MWRedundancy N+1
Redundant HV power
13
The new computer room with its innovative and modular design is an enormous advantage for IN2P3 scientific projects
LHC upgrades LSST - EUCLID -CTA
Academic cloud
New building : May 2011
15 mars 2013
Toward a Cloud Infrastructure
Natural Hierarchy: IaaS – PaaS – SaaS
IaaS : To provide access to a large number of on demand virtualized resources.
PaaS : A toolkit for applications development, deployment and management on a virtual
infrastructure
SaaS : The application itself can be executed on the virtual infrastructure
through a web interface
Applications
Grids will evolve in order to integrate virtualized resources
è French initiative to develop and academic Cloud at CC-IN2P3
Initially focused on IaaSFunded by the French National
Grid France Grilles
15 mars 2013
Cloud @ CC
16 DELL Poweredge C6100Ø 2 TB of local storageØ 96 GB RAM
400 cores10 Gb/s network
GPFS storage for image catalog
Attached storage made of :
- Cluster EMC Isilon IQ (GPFS,Isilon OneFS,CEPH) for VM images
- Dell R720xd for ESB
15
Based on OpenStack - Batch system integration
15 mars 2013
Partnership with DELL
GPU : LQCD – ALICE – CTA – …
Distributed file system : gLuster
Impact of LAN interconnect on performances : 1, 10 Gb/s - InfiniBand
Functionalities of specific hardware storage system : MD1200 / MD3200
Multipath access
120 k€ platform upgraded each year à +100 k€
Test new hardware / new architecturesPublish results in White Papers
16
15 mars 2013
In summary
17
• Over the last 8 years :
CPU : x27 - Storage : x128 - Electricity cost : x3
but limited growth for now 2 years due to budget cuts
• The infrastructure set up is able to let us face future challenges
15 mars 201318