making xr a reality for everyone - qualcomm · making xr a reality for everyone hugo swart, senior...

29
Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management Qualcomm Technologies, Inc @qualcomm May 29, 2018 Augmented World Expo

Upload: others

Post on 07-Jun-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

Making XR a reality for everyoneHugo Swart, Senior Director, Head of XR Business ManagementHiren Bhinde, Director, XR Product Management

Qualcomm Technologies, Inc

@qualcommMay 29, 2018 Augmented World Expo

Page 2: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

2

Healthcare

Marketing &advertising

Retail

Engineering

Military

Education

Industrial &manufacturing

EntertainmentEmergency response

XR is thenext mobile computingplatform

Page 3: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

33

Professionals Working

Architects collaborating

on a shared design to

improve efficiency

Families Socializing

Families virtually brought

together with life-like

communication

Young Adults Exploring

A young man exploring

Rome and seeing the

Colosseum as originally built

XR will serve a broad spectrum of roles in daily life,reach critical mass and go mainstream

Children Learning

Children transported

into Amazon jungle for

virtual lesson

Page 4: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

44

Standalone devices are helping to make this happen

A new category of devices has arrived

Lenovo Mirage Solo w/Daydream

HTC VIVE Focus

Oculus Go

ODG R9

Shadow Creator

Page 5: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

5

Standalone AR + VRInstall Base by 2023

186 Million

Source: IDC, ABI Research, Qualcomm Technologies

Page 6: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

66

Consumers want convenience, comfort and affordability

Higher-resolution screensare most desired feature

Top reason for notbuying AR/VR device

45% 46%

Prefer astandalone device

Tooexpensive

Source: The reality of AR and VR survey: Technalysis Research

Page 7: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

77

Premium quality

The quality of XR experiences is key

Cheap VR goggles PC tethered

Low quality experiences that give XR a bad name

Quality standalone XR experiences

at an affordable price for mainstream users

For tech aficionados at high price

point and cumbersome setup

High quality

Page 8: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

88

For tech aficionados at high price

point and cumbersome setup

High quality Premium quality

High quality Premium quality

Low quality experiences that give XR a bad name

Standalone XR devices offer options for consumers

6DoF

Room scale trackingand positioning

Ultrasonic controllersand hand tracking

3DoF

Lean back and360 viewing

Simplecontrollers

Page 9: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

99

The first dedicated XR platform

Interactions

Audio

Visual Art

ific

ial I

nte

llig

en

ce

High quality XR experiences for mainstream audiences

Qualcomm Snapdragon is product of Qualcomm Technologies, Inc. and/or its subsidiaries.

#SnapdragonXR1

Page 10: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

1010

GPU

ISP

CPU

Security

Wi-Fi

DSP

Audio

System Memory

Location

Specially designed just for XR

Heterogenous Compute

#SnapdragonXR1

Page 11: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

11

WatchLean back and enjoy movies, videos and sports

11#SnapdragonXR1

Page 12: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

12

PlayInteract in game environments

12#SnapdragonXR1

Page 13: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

13

CaptureCapture moments worth saving

13#SnapdragonXR1

Page 14: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

14

ShareShare your experience asit’s happening

• “See what I see”

14#SnapdragonXR1

Page 15: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

1515

VisualIntuitiveinteractions

Sounds

An XR platform needs to address technology demandsto enable high quality XR experiences

IMMERSION

Dual DisplayMotion tracking

ApplicationInterfaces

Voice UI

3D Audio

Stereo Camera

Video &Graphics

Performance

Page 16: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

16c16

Immersion highlightsGet full immersion with low power andthermals that allow for sleek, lightweightand stylish headworn designs

Qualcomm aptX and Aqstic are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

UltraHD Premiumvideo playback

Adreno GPUFast graphics rendering

at low power

Kryo CPU

Qualcomm Aqstic and Qualcomm aptX audio

Qualcomm Aqstic voice UI

QHD+ (2K) display

6DoF headtracking

3DoF / 6DoFcontrollers

#SnapdragonXR1

Page 17: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

17

Visuals

Page 18: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

18c18

Pixels so realistic theyare indistinguishablefrom the real world

• Ultra HD premium video and display(up to 4K60 video w/ audio)

• Jitter reduction

• Fast graphics rendering at lower powerand reduced memory bandwidth

• OLED support for wide color gamut,and amazing contrast

#SnapdragonXR1

Page 19: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

19

AudioAudio input/voice input

Page 20: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

20c20

True-to-life soundis critical to immersiveexperiences

• Support Object and Scene based audioas well as Audiophile-grade DSD audio

• Improved quality high fidelity sound w/ Qualcomm Aqstic and pre-integratedaptX & aptX HD audio

• Low latency Immersive Audio supportedusing a 3D Audio SDK (Object-based audio,Ambisonics (HOA), HRTF and Reverb)

• Active noise cancellation

#SnapdragonXR1

The sounds and visuals mustmatch —depth, direction, andmagnitude of sound sources

Page 21: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

21c21

Voice is a natural way to interact with devices

• Voice activation

• Noise filtering, suppression, and cancellation

• Speech recognition

• Natural language processing

• Voice biometrics

• Deep learning

Qualcomm aptX and Aqstic are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

A hands-free interface is necessaryin certain situations

#SnapdragonXR1

“Show me diagram and

location to insert cord”

Page 22: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

22

Intuitive Interactions

Page 23: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

23c23#SnapdragonXR1

Natural userinterfaces withminimal latencyand precise headmotion tracking

• VIO Head Tracking

• Motion to Photon latencyless than 20ms

• DSP Sensor Fusion

• Support for 3DoF as wellas 6DoF controllers

Page 24: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

24

Artificial Intelligence

#SnapdragonXR1

Page 25: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

25

Hexagon

Vector Processor

Adreno

Ha

rdw

are

Tools• Snapdragon Neural Processing SDK

• Android NN

• Hexagon NN

Frameworks• Caffe/Caffe2

• TensorFlow/TensorFlow Lite

• ONNX

INT8 precision networks

FP32 and FP16 precision networks

FP32 and INT8 8bit precision networks

Kryo

Object classification

Pose prediction

Natural language understanding

Speaker recognition

On-device intelligence for XRXR1 heterogeneous computing key for on-device intelligence

#SnapdragonXR1

Page 26: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

26

Coming Soon

#SnapdragonXR1

Page 27: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

27#SnapdragonXR1

Page 28: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

282828

Qualcomm® Snapdragon™ XR1 platform

Making XR a reality for everyone

CaptureWatch Play Share

#SnapdragonXR1

Page 29: Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior Director, Head of XR Business Management Hiren Bhinde, Director, XR Product Management

Follow us on:

For more information, visit us at:

www.qualcomm.com & www.qualcomm.com/blog

Thank you!

Nothing in these materials is an offer to sell any of the

components or devices referenced herein.

©2018 Qualcomm Technologies, Inc. and/or its affiliated

companies. All Rights Reserved.

Qualcomm is a trademark of Qualcomm Incorporated,

registered in the United States and other countries. Other

products and brand names may be trademarks or registered

trademarks of their respective owners.

References in this presentation to “Qualcomm” may mean Qualcomm

Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries

or business units within the Qualcomm corporate structure, as

applicable. Qualcomm Incorporated includes Qualcomm’s licensing

business, QTL, and the vast majority of its patent portfolio. Qualcomm

Technologies, Inc., a wholly-owned subsidiary of Qualcomm

Incorporated, operates, along with its subsidiaries, substantially all of

Qualcomm’s engineering, research and development functions, and

substantially all of its product and services businesses, including its

semiconductor business, QCT.