a new computing era - nvidiaimages.nvidia.com/content/apac/events/ai-conference/resource/... · a...
TRANSCRIPT
![Page 1: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/1.jpg)
A NEW COMPUTING ERADAVID B. KIRK, FELLOW| NVIDIA AI Conference Singapore 2017
![Page 2: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/2.jpg)
TWO FORCES DRIVING THE FUTURE OF COMPUTING
1980 1990 2000 2010 2020
40 Years of CPU Trend Data
Original data up to the year 2010 collected and plotted by M. Horowitz, F. Labonte, O. Shacham, K. Olukotun, L. Hammond, and C. Batten New plot and data collected for 2010-2015 by K.
Rupp
Transistors
(thousands)
103
105
107
Single-threaded perf
1.5X per year
1.1X per year
The Big Bang of Deep Learning
![Page 3: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/3.jpg)
RISE OF NVIDIA GPU COMPUTING
1980 1990 2000 2010 2020
40 Years of CPU Trend Data
Original data up to the year 2010 collected and plotted by M. Horowitz, F. Labonte, O. Shacham, K. Olukotun, L. Hammond, and C. Batten New plot and data collected for 2010-2015 by K.
Rupp
103
105
107
Single-threaded perf
1.5X per year
1.1X per year
GPU-Computing perf
1.5X per year
NVIDIA Volta GPU | 21B xtors | 120 TFLOPS
![Page 4: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/4.jpg)
CUDA Downloads5X in 5 Years
RISE OF NVIDIA GPU COMPUTING
Global GTC Attendees10X in 5 Years
GPU Developers15X in 5 Years
20172012 2012
1.8M645,000
201720172012
22,000
![Page 5: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/5.jpg)
NVIDIA GPU-ACCELERATED APPLICATIONS
Computer Graphics Scientific Computing Data ScienceDeep Learning
K-Means Clustering Gradient Boosting
Support Vector MachineGeneralized Linear Model
NVIDIA CUDA
DATABASES
ANALYTICS
AMBERMolecularDynamics
COSMOClimateWeather
ChaNGaAstrophysics
GaussianQuantumChemistry
Schlumberger WGSeismic Processing
PowerGridMedical Imaging
ANSYS FluentComputational Fluid Dynamics
SIMULIA Abaqus Finite-ElementAnalysis
![Page 6: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/6.jpg)
NVIDIA GPU-ACCELERATED INDUSTRIES
HPC INTERNET SERVICES TRANSPORTATION MEDICAL IMAGING LOGISTICS
Ride Sharing
Self-Driving Cars
Design &Simulation
Radiology
VolumetricRendering
3D CT
AV Truck
RouteManagement
WarehouseAutomation
Photo Album
Recommendations
Social Media
Weather
Molecular Dynamics
MaterialsScience
![Page 7: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/7.jpg)
LIGODetection of Gravitational Waves
Detection of Gravitational WavesRainer Weiss, Barry Barish, Kip Thorne
Cryogenic Electron MicroscopyJacques Dubochet, Joachim Frank, Richard Henderson
Resolution
before 2013
Resolution
at present
NVIDIA GPU ACCELERATES 2017 NOBEL PRIZES IN CHEMISTRY AND PHYSICS
![Page 8: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/8.jpg)
ANNOUNCING NVIDIA HOLODECK THE DESIGN LAB OF THE FUTURE
Photorealistic Models
Physically Simulated Interaction
Virtual Team Collaboration
GPU-accelerated AI
Early Access NOW
nvidia.com/holodeck
![Page 9: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/9.jpg)
CATIA / Siemens NX Creo / Alias
Maya / 3dsMAX
CREATE AND COLLABORATE IN NVIDIA HOLODECK
![Page 10: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/10.jpg)
THE ERA OF AI
20172014
Deep Learning Papers Published 13X in 3 Years
3,000
20172012
AI Startup Funding12X in 5 Years
$6.6B
NIPS Registration
-50 -25 0 25
1500
3000
4500
60002017
2016
2002
![Page 11: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/11.jpg)
SOLVING THE UNSOLVABLE
NVIDIAInteractive Ray Tracing
NVIDIA / RemedyAudio-driven Facial Animation
WRNCHPose Estimation
University of EdinburghCharacter Animation
UC Berkeley / OpenAIOne-shot Imitation Learning
![Page 12: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/12.jpg)
THE WORLD’S AI PLATFORM
IT Services
Automotive
HealthcareSmart City
Manufacturing
Drones
Financial Services
Other
Every Framework NVIDIA Inception: 1,900 DL Startups Every Cloud and Data Center
NVIDIA AI PLATFORM
![Page 13: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/13.jpg)
AI INFERENCE IS THE NEXT GREAT CHALLENGE
DNN Model InferencingTraining
![Page 14: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/14.jpg)
EXPLOSION OF INTELLIGENT MACHINES
20M Inference Servers 100s of Millions of Autonomous Machines Trillions of IoT Devices
![Page 15: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/15.jpg)
EXPLOSION OF NETWORK DESIGN
Convolution Networks
ReLuPRelu
Recurrent Networks Reinforcement Learning
Dropout PoolingConcat
GRU HighwayLSTM
Embeddi
ng
BiDirectionalProjectio
n
BatchNorm
Generative Adversarial Networks
Rank GAN Conditional GAN
Coupled GAN Speech Enhancement
GAN
Latent space GAN A3C
Dueling DQNDQN3D-
GAN
![Page 16: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/16.jpg)
Speech Network ComplexityGOPS * Bandwidth
2014 2015 2016 2017 20182011 2013 2015 2017 2013 2014 2015 2016 2017 2018
EXPLOSION OF NETWORK COMPLEXITY
Image Network ComplexityGOPS * Bandwidth
Translation Network ComplexityGOPS * Bandwidth
DeepSpeech
DeepSpeech 2
DeepSpeech 3 MoE
OpenNMTResNet-50
Inception-v2
Inception-v4
AlexNet GoogLeNet
GNMT
350X30X 10X30X 10X
![Page 17: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/17.jpg)
NEWNVIDIA TENSORRT 3 PROGRAMMABLE INFERENCE ACCELERATOR
Compile and Optimize Neural Networks
Support for Every Framework
Optimize for Each Target Platform
DRIVE PX 2
JETSON TX2
NVIDIA DLA
TESLA P4
TensorRT
TESLA V100
![Page 18: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/18.jpg)
0
150
300
450
600
CPU +Torch
V100 +Torch
V100 +TensorRT
-
1,500
3,000
4,500
6,000
CPU + TensorFlow V100 + TensorFlow V100 + TensorRT
14ms
7ms
NEWNVIDIA TENSORRT 3 PROGRAMMABLE INFERENCE ACCELERATOR
7ms 153ms
117ms
0
Images/Sec (ResNet-50) Sentences/Sec (OpenNMT)
40x Speed-up on ResNet-50
140x Speed-up on OpenNMT
Half the Latency
280ms
![Page 19: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/19.jpg)
1 NVIDIA HGX with 8 Tesla V100 GPUs
45,000 images / second
3 KWatts
1/6 the Cost | 1/20 the Power | 4 Racks in a Box
NVIDIA TENSORRT10X BETTER DATA CENTER TCO
![Page 20: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/20.jpg)
THE AUTONOMOUS VEHICLE REVOLUTION
![Page 21: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/21.jpg)
NVIDIA DRIVEAV COMPUTING PLATFORM
Sensor Fusion: RADAR, LIDAR, Camera
Deep Learning, CV, Parallel Computing
Diversity of Algorithms
ASIL-D Functional Safety
Fully Integrated into NVIDIA BB8
DRIVE PX — AI CAR COMPUTER
DRIVEWORKS SDK
DRIVE AV
DRIVE OS
RADAR FusionLIDAR
Point-Cloud Processing
Camera Deep Learning
(Detection)
Camera Deep Learning
(Freespace)Camera Computer Vision
(SLAM)
HD Map
(Localizing to Map)Path Planning
![Page 22: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/22.jpg)
145 AV STARTUPS ON NVIDIA DRIVE
![Page 23: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/23.jpg)
THE ERA OF AUTONOMOUS MACHINES
![Page 24: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/24.jpg)
XAVIERWORLD’S FIRST AUTONOMOUS MACHINE PROCESSOR
Deep Learning, CV, Parallel Computing
Rich High-Speed Sensor IOs
Extreme Energy Efficiency
30 TOPS at 30W
![Page 25: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/25.jpg)
PROJECT ISAAC — AI ROBOT SIMULATOR
SIMULATION TRAINING AUTONOMOUS
Project Isaac
![Page 26: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/26.jpg)
NVIDIA INCEPTION PARTNERS IN SEA
RECENTLY GROWN AI STARTUPS
Automotive Drones / Robotics Financial Services Media / Entertainment IT Services Intelligent Video Analytics Medical Imaging / Life SciencesRetail / Etail
Leben-Vision
Hanalyticss u p e r c o m p u t e r s
![Page 27: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/27.jpg)
AI.PLATFORM@NSCCProvides Computational Services for AI and Deep Learning Applications
Provides AI and Deep Learning Trainings
Provides Technical Expertise to Support AI Projects
AI SINGAPORE, AND OUR STAKEHOLDERS, WILL BE
THE MAIN USERS OF THIS FACILITIES FOR THE START
In collaboration with
Supported by
![Page 28: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/28.jpg)
A NEW COMPUTING ERA
NVIDIA HolodeckDesign Lab of the Future
NVIDIAThe World’s AI Computing Platform
NVIDIA DRIVEOpen AV Platform for the Transportation Industry
NVIDIA DRIVE PXPegasus
Robotaxi AI Computer
Project IsaacAI Robot Simulator
![Page 29: A NEW COMPUTING ERA - Nvidiaimages.nvidia.com/content/APAC/events/ai-conference/resource/... · a new computing era david b. kirk, fellow| nvidia ai conference singapore 2017 . two](https://reader031.vdocuments.site/reader031/viewer/2022030903/5b4236277f8b9a2e058b724e/html5/thumbnails/29.jpg)