1 evolving atlas computing model and requirements michael ernst, bnl with slides from borut kersevan...
TRANSCRIPT
![Page 1: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/1.jpg)
1
Evolving ATLAS Computing Model and Requirements
Michael Ernst, BNL
With slides from Borut Kersevan and Karsten Koeneke
U.S. ATLAS Distributed Facilities Meeting
UCSC
November 13, 2012
![Page 2: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/2.jpg)
2
![Page 3: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/3.jpg)
3
ATLAS Computing Mar-Aug 2012
![Page 4: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/4.jpg)
4
Computing Resource Usage in 2012, 2013-2015
![Page 5: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/5.jpg)
5
Current Resource Usage
![Page 6: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/6.jpg)
6
Resource Usage at Tier-2s
![Page 7: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/7.jpg)
7
![Page 8: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/8.jpg)
8
Contributions by Country (Production and Analysis)
Includes beyondpledge resources
![Page 9: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/9.jpg)
9
Contribution by Job Type
Production Analysis
US: 22% of available CPUused for Analysis
77% of Analysis done At Tier-2s
T1
T2
![Page 10: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/10.jpg)
10
Contribution to Simulation (Aug-Oct)
(3843)
(1867) (1762)
(1067)(896)
Avg # of fullyUtilized cores
![Page 11: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/11.jpg)
11
Contribution to Pile (Aug-Oct)
(1818)
(374)
(1128)
(526)
Avg # of fullyUtilized cores
![Page 12: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/12.jpg)
12
Contribution to Analysis (Aug-Oct)
(342)
(1024)
(590)
(720)
(395)
Avg # of fullyUtilized cores
![Page 13: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/13.jpg)
13
Contribution to Reco (Aug-Oct)
(342)
(1024)
(590)
(720)
(395)
Avg # of fullyUtilized cores
(512)
(108)
(122)(112)
![Page 14: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/14.jpg)
14
Balancing Resources across the Tier-1 and Tier-2s for cost/benefit optimization
E. Lancon (ICB Chair) at the Oct ICB Meeting
![Page 15: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/15.jpg)
15
Resource Development
![Page 16: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/16.jpg)
16
16
Evolution and Prediction of price/performance of CPU Servers
B. Panzer/CERN
In the US we have observed prices going up slightly between 2011 and 2012.Moore’s law hasn’t helped to improve price/performance ratio – Future?
![Page 17: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/17.jpg)
17
Multi-core vs. Many-core
· A typical modern compute server has 12-16 cores· Number of cores in commodity machines grows
arithmetically · Number of cores in the enterprise space still grows
geometrically · Number of cores in our datacenters grows between the
two, expected to slow down in the long run· Many-core is not multi-core
Observing memory hierarchy issues Cache coherency NUMA Memory b/w or I/O paths may be constraining
· Multiprocess is a convenient model, but it’s neither sustainable nor scalable
![Page 18: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/18.jpg)
18
18
Evolution and Prediction of Price for Disk Space
B. Panzer/CERN
Disk prices are ~1.5x compared to 2010 predictions
![Page 19: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/19.jpg)
19
Medium-term hardware trends
· Pricing follows market pressure, not technology· I/O, disk and memory not progressing at the same rate
as compute power· Bulk of improvements in x86 still comes from Moore’s
Law· Enterprise and HPC-targeted developments, where
cost-effective, trickle down to our datacenter environment
· Heterogeneous architectures Cross-platform, cross socket, hybrid CPUs,
accelerators, throughput vs. classic computing
![Page 20: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/20.jpg)
20
Non-Intel Hardware
· GPUs NVIDIA working hard but process technology lacking P2P communication improved Software getting better MIC: Tesla might be no longer competitive
· ARM Slow penetration of the server space 64-bit instruction set defined (you can buy today 32 bit CPUs) Software improvements make ARM look like a viable option
· AMD Lagging behind, recent experiments not compelling
· FPGA Still too far off for mainstream accelerators, software issues
· Upcoming: low power/micro servers
192 cores, 1 GB/core$35k
![Page 21: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/21.jpg)
21
First Projections for 2015 - 2016
![Page 22: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/22.jpg)
22
Computing Requirements vs LHC Bunch Spacing
![Page 23: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/23.jpg)
23
Computing Requirements vs LHC Bunch Spacing
S. McMahon
![Page 24: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/24.jpg)
24
Resource requests rising after LS1
![Page 25: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/25.jpg)
25
Computing Model Changes
![Page 26: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/26.jpg)
26
![Page 27: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/27.jpg)
27
OfflineCoreAnalysis
Simulation
![Page 28: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/28.jpg)
28
![Page 29: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/29.jpg)
29
![Page 30: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/30.jpg)
30
![Page 31: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/31.jpg)
31
![Page 32: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/32.jpg)
32
![Page 33: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/33.jpg)
33
![Page 34: 1 Evolving ATLAS Computing Model and Requirements Michael Ernst, BNL With slides from Borut Kersevan and Karsten Koeneke U.S. ATLAS Distributed Facilities](https://reader036.vdocuments.site/reader036/viewer/2022062500/5697bf8c1a28abf838c8bbbb/html5/thumbnails/34.jpg)
34
Summary· The Facilities have reliably delivered in all areas according to our
obligations, and in may areas beyond· The overall system, comprising facility hardware and services,
and the ATLAS software needs to evolve to improve the efficiency and to cope with sharply growing requirements after LS1
Resources were used more effectively with “Life w/o “ESDs”, PD2P, reduced # of DS replicas but the potential for more –significant- is shrinking
· A combined effort, driven by analysis and software experts, is needed to get ATLAS Computing prepared for the challenges ahead
Convinced the LHC machine will deliver … LS1 is around the corner but my impression from the last
SW&C week is, there is not much activity in the SW area to address issues