![Page 1: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/1.jpg)
The Convergence of AI and HPC: A New Hybrid Architecture for High Performance
Data Analytics
![Page 2: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/2.jpg)
3. BullSequana XH2000
4. Codex AI Suite:
5. BullExtreme Factory:
Agenda
![Page 3: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/3.jpg)
Convergence of HPC, HPDA and AI architectures
![Page 4: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/4.jpg)
Insatiable need for increasing compute power:
4
![Page 5: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/5.jpg)
▶
▶
▶
▶
▶
Increasing parallelism inevitable
![Page 6: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/6.jpg)
Factors Driving Innovation in HPC and DL
![Page 7: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/7.jpg)
Combining the strengths of HPC and Deep Learning
![Page 8: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/8.jpg)
Incorporating DL as part of the HPC WorkflowHPC Deep Learning
•
•
•
•
•
•
•
•
![Page 9: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/9.jpg)
Use of DL for uncertainty modelling
![Page 10: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/10.jpg)
Organising HPC + DL Convergence
Transformation Augmentation Modulation
Potential for Breakthroughs in Scientific Insight
![Page 11: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/11.jpg)
Exascale Deep Learning Enabled Precision Medicine for Cancer
![Page 12: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/12.jpg)
Semi-supervised Deep Learning to detect tissue abnormalities
![Page 13: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/13.jpg)
Gravitational Waves – Next steps
Max Plank Institute
Background
Challenge
Solution
![Page 14: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/14.jpg)
BullSequana XH2000HPC and DL Hybrid Architecture
![Page 15: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/15.jpg)
BullSequana XH2000
Enhanced flexibility allows to reduce TCO, from one rack up to Exascale projects
A field proven platform•
•
•
•
BullSequana XH2000 featuring Intel® Xeon® Scalable processors
![Page 16: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/16.jpg)
BullSequana XH2000
Seamlessly integrated with Codex AI Suite and Google Cloud Platform
Mix & Match Compute and AI workloads on the same platform…
Using best in class CPU/GPU/FPGA & Interconnects
![Page 17: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/17.jpg)
BullSequana XH2000
Best in class Power Usage Effectiveness (PUE)
•
•
Very high density and usage of available resources
•
•
![Page 18: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/18.jpg)
BullSequana XH2000 Blades
Volta P100/V100 NVLink2
Xeon SP Skylake / Cascadelake
ThunderX2ThunderX3 when available
New EPYC Rome
![Page 19: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/19.jpg)
BullSequana XH2000 Networking
•
•
•
•
•
![Page 20: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/20.jpg)
42U Cabinet Back Front
BullSequana XH2000
42U Cabinet Front View 42U Cabinet Rear View
![Page 21: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/21.jpg)
Entry level simulation system
BullSequana XH2000 Flexibility
![Page 22: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/22.jpg)
Entry level simulation system Deep Learning Training System
BullSequana XH2000 Flexibility
![Page 23: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/23.jpg)
BullSequana XH2000 Flexibility
Entry level simulation system AI augmented HPC SystemDeep Learning Training System
![Page 24: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/24.jpg)
BullSequana XH2000 Flexibility
Entry level simulation system AI augmented HPC SystemDeep Learning Training System Memory Bound Apps Sim. System
![Page 25: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/25.jpg)
BullSequana XH2000 Flexibility
Entry level simulation system AI augmented HPC systemDeep Learning training System Memory bound simulation System
![Page 26: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/26.jpg)
Codex AI Suite:
![Page 27: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/27.jpg)
Phase 2 : Model Prediction/RecallPhase 1 : Model Training
Codex AI Suite tackles the large-scale Deep Learning Problem
![Page 28: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/28.jpg)
Main Requirements for a Deep Learning Self Service model
![Page 29: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/29.jpg)
Codex AI Suite at a glance
STUDIO
FORGE
ComponentsBlueprints
DL frameworks
Data setsTrained models
FastML ENGINE
Application Builder FastML Engine
ORCHESTRATOR
High Level API
![Page 30: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/30.jpg)
The Codex AI Suite
Codex AI Studio is the common workbench to develop use cases
Orchestrator
![Page 31: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/31.jpg)
•
•
•
•
•
•
•
3 key Codex AI Suite benefits
01
02
03
Increases data scientist productivity
Provides a complete cognitive eco-system ready to work
Delivers optimal performance at low cost
![Page 32: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/32.jpg)
Expanding Extreme Factory for Deep Learning
![Page 33: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/33.jpg)
HPCaaS architecture
•
•
•
•
![Page 34: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/34.jpg)
HPCaaS and DLaaS architecture
•
•
•
•
•
•
![Page 35: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/35.jpg)
Deep Learning Self Service (DLSS)C
od
ex A
I Su
ite
Bu
ll Ex
trem
e
Fcat
ory
![Page 36: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/36.jpg)
Summary
![Page 37: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/37.jpg)
Summary
2. The BullSequana XH2000:
3. Codex AI Suite:
4. BullExtreme Factory:
![Page 39: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/39.jpg)
End-to-end, fast development of complex enterprise use cases
Applications are infrastructure-agnostic
HPC business can deliver NG applications
Codex AI Suite differentiators
![Page 40: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/40.jpg)
Key scientific areas include:
•
•
•
•
Extreme Factory UK – working with STFC Hartree Centre
Atos Solution:
••
•
•
•
![Page 41: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics](https://reader036.vdocuments.site/reader036/viewer/2022071215/6046830ebca53877264ef02a/html5/thumbnails/41.jpg)
Key scientific areas include:
•
•
•
•
JADE – working with Oxford University and The Hartree Centre
Atos Solution:
•
•
•
•
•