![Page 1: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/1.jpg)
S9719 – ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS
FOR AUTOMOTIVE AERODYNAMICS
Christoph Niedermeier – Development Manager GTC San Jose, March 20, 2019
![Page 2: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/2.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AUTOMOTIVE AERODYNAMICS
![Page 3: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/3.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
COMPUTATIONAL EFFORT PER SECOND
1E5Time steps
1E13Node updates
1E18FLOP
1E8Voxels
![Page 4: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/4.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AVAILABLE PERFORMANCE
2005 2010 2015
100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18Real-time
![Page 5: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/5.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AVAILABLE PERFORMANCE
2005 2010 2015
#1 TOP 500100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18Real-time
~10s per second
![Page 6: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/6.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AVAILABLE PERFORMANCE
2005 2010 2015
#1 TOP 500
#500 TOP 500
100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18Real-time
~10s per second
~1 hour per second
![Page 7: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/7.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AVAILABLE PERFORMANCE
2005 2010 2015
#1 TOP 500
#500 TOP 500
CPUs (Intel)
100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18Real-time
~1 week per second
~10s per second
~1 hour per second
![Page 8: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/8.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AVAILABLE PERFORMANCE
2005 2010 2015
#1 TOP 500
#500 TOP 500
CPUs (Intel)
100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18
Interactivity
Production-level usage
Real-time
~1 week per second
~10s per second
~1 hour per second
![Page 9: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/9.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
AVAILABLE PERFORMANCE
2005 2010 2015
#1 TOP 500
#500 TOP 500
CPUs (Intel)
GPUs (NVIDIA) ~1 day per second
100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18
Interactivity
Production-level usage
Real-time
~1 week per second
~10s per second
~1 hour per second
![Page 10: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/10.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
HIGH-FIDELITY CFD NEAR REAL-TIME
GOOD
CHEAP FAST
![Page 11: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/11.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
HIGH-FIDELITY CFD NEAR REAL-TIME
GOOD
CHEAP FAST
Accurate wall-modeled LES
Interactive simulations
near real-timeCosts of O(500) USD
per simulation
![Page 12: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/12.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
HIGH-FIDELITY CFD NEAR REAL-TIME
GOOD
CHEAP FASTInteractive simulations
near real-timeCosts of O(500) USD
per simulation
Accurate wall-modeled LES
![Page 13: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/13.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
METHODOLOGY
![Page 14: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/14.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
HOW TO USE AI SUPERCOMPUTERS FOR HIGH-FIDELITY CFD
![Page 15: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/15.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
A GLIMPSE OF LBM
• First comparable numerical approach for CFD: Lattice Gas Automata
• HPP model (1976), FHP model (1986)
• Bool variable: 0 or 1 particle per discrete direction
• Collision rules, propagation rules
![Page 16: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/16.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
A GLIMPSE OF LBM
• First comparable numerical approach for CFD: Lattice Gas Automata
• HPP model (1976), FHP model (1986)
• Bool variable: 0 or 1 particle per discrete direction
• Collision rules, propagation rules
https://keva92.github.io/lgca/
![Page 17: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/17.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
A GLIMPSE OF LBM
• Lattice Boltzmann Method (LBM)
• Essentially replaces the Boolean variable with a particle distribution function
• The algorithmic nature of the method remains unchanged
( , , )f t x
![Page 18: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/18.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
A GLIMPSE OF LBM
• Lattice Boltzmann Method (LBM)
• Essentially replaces the Boolean variable with a particle distribution function
• The algorithmic nature of the method remains unchanged
( , , )f t x
Collision Propagation
![Page 19: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/19.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
A GLIMPSE OF LBM
• Lattice Boltzmann Method (LBM)
• Essentially replaces the Boolean variable with a particle distribution function
• The algorithmic nature of the method remains unchanged
• Many very sophisticated LBM collision operators are available, e.g. Cumulant-based
operators with very low numerical diffusion, high stability and implicit subgrid-scale modeling
( , , )f t x
Collision Propagation
M. Geier, A. Pasquali, M. Schönherr, Journal of Computational Physics 348(1):862-888, 2017
M. Geier, A. Pasquali, M. Schönherr, Journal of Computational Physics 348(1):889-898, 2017
![Page 20: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/20.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
HOW TO USE AI SUPERCOMPUTERS FOR HIGH-FIDELITY CFD
• GPUs deliver tremendous speed for explicit, local algorithms – LBM is a perfect match
• High pace of GPU technology development leads to big performance advantage of GPU-
based LBM on recent hardware (~ 1 GPU-h vs. ~ 100 core-h of CPU-based LBM)
• Similar or even lower investment costs and a lower energy consumption compared to CPU-
clusters of same performance
NVIDIA
Tesla V100
15.7 TFLOPS (SP)
![Page 21: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/21.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
HIGHLY ACCURATE CFD ON MULTIPLE GRAPHICS PROCESSING UNITS
![Page 22: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/22.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
MULTI-GPU SIMULATIONS OF EXTERNAL AERODYNAMICS
GOOD
CHEAP FAST
Commercial
Altair ultraFluidXTM
![Page 23: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/23.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
ALTAIR ULTRAFLUIDXTM
• High-fidelity flow field computations based on the Lattice Boltzmann method
• Cumulant collision operator, Smagorinsky LES turbulence model, TBLE-based wall model
• Tailor-made for external aerodynamics
• Easy and robust handling of complex automotive geometries
• Extended automotive features, including belt systems, boundary layer suction, porous media support
• Rotating wheel modeling based on wall-velocity boundary conditions and MRF approaches
• Advanced post-processing capabilities (window averaging, spatial force contribution, probe outputs, …)
• Aiming at overnight simulations of external aerodynamics
• CUDA-aware MPI support for multi-GPU and multi-node usage
![Page 24: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/24.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
PREPROCESSING
• Automated volume mesh generation with local
grid refinement and support for baffle parts
• Octree-based grids with 43 lattice nodes per block
![Page 25: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/25.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
• Automated volume mesh generation with local
grid refinement and support for baffle parts
• Octree-based grids with 43 lattice nodes per block
• Kinks and thin parts are fully resolved in the
volumetric preprocessing
PREPROCESSING
![Page 26: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/26.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
PREPROCESSING
• Automated volume mesh generation with local
grid refinement and support for baffle parts
• Octree-based grids with 43 lattice nodes per block
• Kinks and thin parts are fully resolved in the
volumetric preprocessing
• Fast generation of production-level volume
meshes in < 1 hour (CPU-based, MPI-parallel)
• Domain decomposition with space-filling curves,
separately on each refinement level
![Page 27: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/27.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
• 40% scale DrivAer Notchback with engine bay flow (http://www.drivaer.com)
VALIDATION EXAMPLE
Ultra-fast, High-fidelity Computational Fluid Dynamics on GPUs for Automotive Aerodynamics
C.A. Niedermeier, C. Del Bene, C.F. Janßen, B. Schnepf, M. Ratzel, T. Indinger, WCCM 2018
Collin et al. (2017)
Tested for different radiator opening ratios
![Page 28: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/28.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
• 40% scale DrivAer Notchback with engine bay flow (http://www.drivaer.com)
VALIDATION EXAMPLE
156 M voxels
30 flow passes
(> 3 s full scale)
Ultra-fast, High-fidelity Computational Fluid Dynamics on GPUs for Automotive Aerodynamics
C.A. Niedermeier, C. Del Bene, C.F. Janßen, B. Schnepf, M. Ratzel, T. Indinger, WCCM 2018
![Page 29: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/29.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
• 40% scale DrivAer Notchback with engine bay flow (http://www.drivaer.com)
VALIDATION EXAMPLE
0.000
0.001
0.002
0.003
0.004
0.005
10 15 20 25 30
Exp
uFX
Ao/Ac %
Cd
Ultra-fast, High-fidelity Computational Fluid Dynamics on GPUs for Automotive Aerodynamics
C.A. Niedermeier, C. Del Bene, C.F. Janßen, B. Schnepf, M. Ratzel, T. Indinger, WCCM 2018
![Page 30: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/30.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
TOWARDS PRODUCTION-LEVEL USAGE
Can we reach the goal of overnight simulations without compromising on resolution?
2005 2010 2015
#1 TOP 500
#500 TOP 500
CPUs (Intel)
GPUs (NVIDIA) ~1 day per second
100PF
10PF
1PF
100TF
10TF
1TF
100GF
10GF
1EF
1E17
1E16
1E15
1E14
1E13
1E12
1E11
1E10
1E18
Interactivity
Production-level usage
Real-time
~1 week per second
~10s per second
~1 hour per second
![Page 31: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/31.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
TOWARDS PRODUCTION-LEVEL USAGE
Can we reach the goal of overnight simulations without compromising on resolution?
Single-node P100
Local machine with 10x P100 PCIe
(single root complex, 32 GB/s)
Multi-node P100
Up to four nodes of Tsubame 3.0 with
4x P100 SXM2 each, NVLink 1.0 and Omni-Path
(100 Gb/s)
Single-node V100
DGX-1 with 8x V100 SXM2 and
NVLink 2.0 (300 GB/s)
Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics
C. A. Niedermeier, C.F. Janßen and T. Indinger, ECFD 2018
![Page 32: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/32.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
ALTAIR ROADSTER CASE
• Altair roadster with grid refinement (6 refinement levels down to 2 mm and dt = 3.3E-6 s)
• Performance target for overnight simulations: 2000 MNUPS (corresponds to ~ 4 h/s)
Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics
C. A. Niedermeier, C.F. Janßen and T. Indinger, ECFD 2018
![Page 33: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/33.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
ALTAIR ROADSTER CASE
• Altair roadster with grid refinement (6 refinement levels down to 2 mm and dt = 3.3E-6 s)
• Performance target for overnight simulations: 2000 MNUPS (corresponds to ~ 4 h/s)
Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics
C. A. Niedermeier, C.F. Janßen and T. Indinger, ECFD 2018
![Page 34: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/34.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
ALTAIR ROADSTER CASE
• Altair roadster with grid refinement (6 refinement levels down to 2 mm and dt = 3.3E-6 s)
• Performance target for overnight simulations: 2000 MNUPS (corresponds to ~ 4 h/s)
Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics
C. A. Niedermeier, C.F. Janßen and T. Indinger, ECFD 2018
![Page 35: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/35.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
ALTAIR ROADSTER (STRONG SCALING)
~ 4 h per s
~ 2.5 h per s
Production-level
performance
![Page 36: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/36.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
ALTAIR ROADSTER (STRONG SCALING)
Parallel
efficiency for the
143M case and
4 vs. 8 GPUs is
between 82.4
and 87.0%
85.6%87.0%
82%
(4x 2 GPUs: 75.6%)
![Page 37: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/37.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
OUTLOOK
One DGX-1 already allows for the simulation of up to 1 s of physical time in 2.5 h – what‘s next?
GOOD
CHEAP FAST
![Page 38: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/38.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
THE MORE YOU USE, …
• Example use case: detailed analysis of 10 design
variations before taking decisions for next iteration
• Fully transient simulation:
3 s physical time, 230 M voxels
![Page 39: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/39.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
THE MORE YOU USE, …
• Example use case: detailed analysis of 10 design
variations before taking decisions for next iteration
• Fully transient simulation:
3 s physical time, 230 M voxels
• Solved on ten 8x V100 machines in the cloud
![Page 40: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/40.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
THE MORE YOU USE, …
• Example use case: detailed analysis of 10 design
variations before taking decisions for next iteration
• Fully transient simulation:
3 s physical time, 230 M voxels
• Solved on ten 8x V100 machines in the cloud
• 11 h wall clock time per individual run
• Overnight results; CPU-based CFD solution would
take ~ 4 days on 1,000 cores
![Page 41: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/41.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
DGX-2
CFD85.6%
4 vs. 12
GPUs
![Page 42: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/42.jpg)
March 20, 2019 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.©
CONCLUSIONS AND OUTLOOK
The DGX-1 delivers enough performance to simulate a production-level case overnight – a
game changer for simulation-based design.
The DGX-2 will further push the trend towards simulation-based design and at the same time
allow for adding additional physics (rotating wheels, water management, aeroacoustics, …).
High-fidelity simulations of external aerodynamics in real-time
would require access to exa-scale machines.
Multi-GPU architectures can deliver sufficiently enough
performance for overnight runs of an automotive production
case.
![Page 43: ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS FOR … · Massively-parallel Multi-GPU simulations for fast and accurate automotive aerodynamics C. A. Niedermeier, C.F. Janßen and T. Indinger,](https://reader030.vdocuments.site/reader030/viewer/2022041117/5f2d2f56cdaea9142c198ff1/html5/thumbnails/43.jpg)
S9719 – ULTRA-FAST HIGH-FIDELITY CFD SIMULATIONS
FOR AUTOMOTIVE AERODYNAMICS
Christoph Niedermeier – Development Manager GTC San Jose, March 20, 2019