exascale: head in the clouds or both feet...

24
EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET ON THE GROUND? Bartosz Dobrzelecki, Forkedbranch.eu KDM 2016, 27-28.06.2016, Poznań

Upload: others

Post on 03-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET ON THE GROUND?Bartosz Dobrzelecki, Forkedbranch.euKDM 2016, 27-28.06.2016, Poznań

Page 2: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

SCIENTIFIC VS ENGINEERING SIMULATION

Head in the clouds Both feet on the ground

Time variation of the absolute magnetic flux density in a synchornous motor (source: CST AG)

Dark matter layer of the EAGLE simulation (source: The Virgo Consortium)

Page 3: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

SCIENTIFIC VS ENGINEERING MINDSETBOUNDARY ELEMENT METHOD FOR ELECTRIC FIELD CALCULATIONS

Head in the clouds Both feet on the ground

▪ We developed new semi-empirical methods – look at our accuracy!

▪ But the accurracy is unparalleled!

▪ But we can’t leave it at ±3% when we can get below ±0.5%!

▪ Yes, nice, but we can’t wait 2 days for the result!

▪ OK, but we know so little about discharge physics that estimating a chance of inception with ±3% is fine for us...

Page 4: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

ENGINEERING MINDSET

Page 5: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

ENGINEERING MINDSET : ESTIMATION

“Yes, of course duct tape works in a near-vacuum. Duct tape works anywhere. Duct tape is magic and should be worshiped.”

― Andy Weir, The Martian

Watney in the Martian performs estimations in order to survive.

Scientific calculator can still be found on the desk of most simulation engineers.

Page 6: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

ENGINEERING SIMULATIONVIRTUAL PROTOTYPING

Page 7: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

TYPICAL SIMULATION INFRASTRUCTURE FOR VIRTUAL PROTOTYPING

Page 8: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

TYPICAL SIMULATION PROCEDURE

Page 9: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

HOW MUCH COMPUTATION?

Page 10: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

ENTRY LEVEL HPCBULLX BASED CLUSTERS

High quality package for entry level in-house HPC suitable for engineering companies.

Tested on the job.

bullx Rbullx B500

Air cooling or water-cooled door

High performance interconnect network

File systems and storage bays/solutions

HPC operating envoronment

GPU

Page 11: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

BULL SUPERCOMPUTER SUITE

Greatly simplifies deployment, configuration and operation.

Lowers entry barrier for sysadmins.

Page 12: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

BENEFITS OF HPC

Page 13: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

IS EXASCALE A PRAGMATIC GOAL?

Page 14: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

ENTRY LEVEL HPC IS ENOUGH FOR MOST PRODUCT DEVELOPMENT TASKS

CFD (Fluent) FEA (Abaqus)

• Computations on real geometries do not scale well.• Cost of parallel licenses is still prohibitive in many cases.• In-house solvers often need refurbishment to make use of

even the entry level HPC.

source: HPCWire source: ICHEC

Page 15: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

WILL ENGINEERING SIMULATION EVER ACHIEVE EXASCALE SCALABILITY?

Will we find out tomorrow?

Towards Exascale Fluid Dynamics Simulations for Industrial Applications

Niclas JanssonKTH Royal Institute of Technology, Sweden

Page 16: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

EXASCALE FOR HPC CLOUD

bursting

Many engineering companies will never invest in in-house HPC

Page 17: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

BULL EXTREME FACTORY

Page 18: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

EXASCALE DATACENTERINFRASTRUCTURE FOR HPC CLOUD

Page 19: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

SEQUANA: BUILDING BLOCK OF ANEXASCALE DATA CENTER

Open platform designed for the long-term Integrate current and future technologiesMultiple types of compute nodes (CPUs, GPUs, HPC accelerators)

Scales up to tens of thousands of nodesLarge building blocks to facilitate scaling Embedding the fastest interconnects

Ultra-energy efficientEnhanced DLC

Page 20: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

FLEXIBLE ARCHITECTURE SUPPORTING HETEGOGENEITY

KNL Blade

BDW Blade

SKL blade

GPU blade

ARM blade

Knights Landing Blade

Skylake Blade

Page 21: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

INDUSTRY 4.0

Massive amounts of data to be integrated and acted upon.

Page 22: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

THE EXTRA-LARGE MEMORY SUPER COMPUTER: BULLX S6000 SERIES

2 Haswell EX CPUs 4 Haswell EX CPUs 8 Haswell EX CPUs 16 Haswell EX CPUs

3U Form Factor 6U Form Factor 12U Form Factor 24U Form Factor

Up to 36 cores Up to 72 cores Up to 144 cores Up to 288 cores

Up to 3TB RAM Up to 6TB RAM Up to 12TB RAM Up to 24TB RAM

7 PCI-e Gen3 14 PCI-e Gen3 28 PCI-e Gen3 56 PCI-e Gen3

Active/Passive PS Active/Passive PS Active/Passive PS Active/Passive PS

N.A. HW Partitioning HW Partitioning HW Partitioning

Rear view

BCS2

BCS2

BCS2

BCS2

BCS2

BCS2

BCS2

BCS2

Supports large scale in-memory computations.

Well suited to enable the Industry 4.0 vision.

Page 23: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

EXASCALE AND VIRTUAL PROTOTYPING

Head in the clouds

▪ Most solvers used in virtual prototyping do not exascale.

▪ Exascale parallel licenses maycurrently cost exadollars.

▪ Simulation supports estimation in product engineering – there seem to be no grand challenges.

Both feet on the ground

▪ Engineering companies looking for increased compute power may move their simulations directly to the cloud.

▪ Exascale supercomputer may be at the heart of such data center.

▪ Merging BigData and HPC is the way forward in the race for exascale.

Page 24: EXASCALE: HEAD IN THE CLOUDS OR BOTH FEET …konferencjakdm.pcss.pl/2016/wp-content/uploads/2016/07/...Head in the clouds Both feet on the ground We developed new semi-empirical methods

Find out more about Atos exascale effort athttp://www.bull.com/extreme_computing

Find out more about streamlining your R&D workflows athttp://forkedbranch.eu