the 5g era: consumer devices of the future...42 tracking/inputs encoded data on-device adjustment to...
TRANSCRIPT
![Page 1: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/1.jpg)
The 5G Era: Consumer Devices of the Future
Tuesday, 22 October 201913:00 – 15:00
![Page 2: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/2.jpg)
Director of Product ManagementQualcomm
Said Bakadir
![Page 3: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/3.jpg)
5G + AI + XR – Transforming the Mobile Industry for the Next Generation of Immersive ComputeSaid Bakadir
Director of XR Product ManagementQualcomm Technologies, Inc.
@qualcommOct 22, 2019
![Page 4: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/4.jpg)
31
XR is the next mobile computing platformEverything we’ve learned for smartphones will be used for XR
Laptop Smartphone XR glasses
![Page 5: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/5.jpg)
32
Connectingvirtually everything
Powering anXR world
Driving smarterexperiences
Healthcare
Transportation
Training
Construction
Utilities
Productivity
Emergency response
EntertainmentGaming
Education
Travel
Healthcare
Virtual world exploration
Retail
Social
Factory
The age of
5G, AI and XRConsumer Enterprise
![Page 6: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/6.jpg)
33
What does AI mean for XR?
AI improvesXR experienceson device
AI Agent
Virtual Assistant: Alexa-like avatar
Game agents
Contextual Awareness
Environment
Scene recognition
Always-on AI powered camera
When to show notifications
Object detection
Perception
AI based SLAM
Hand tracking
Body tracking
Eye tracking
Facial expression
Common Illumination
Multimedia
Illumination
Occlusion
Shader
Voice
Speech synthesis: text to speech or vice versa
Live translation
![Page 7: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/7.jpg)
34
AI Agent for guided XR instruction
Holographic AI Agent
Hand tracking
World trackingand registration foraugmented objects
Predictiveintelligence
Low latency motion tracking
Ultra reliable,low-latency wirelessconnection
![Page 8: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/8.jpg)
35
Transforming industries
Connecting virtually everythingat the wireless edge
Redefined computing
Desktop tosmartphones
Digitized mobile communications
Analogto digital
Evolution of mobile innovation…
Transforming how the world connects, computes and communicates
![Page 9: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/9.jpg)
3636Based on ITU vision for IMT-2020 compared to IMT-advanced; URLLC: Ultra Reliable Low Latency Communications; IAB: Integrated Access & Backhaul
Designing a unified, more capable 5G air interface
10xConnection density
3xSpectrumefficiency
10xDecrease inend-to-end latency
10xExperienced throughput
100xTrafficcapacity
100xNetwork efficiency
Enhanced mobilebroadband
Diversedeployments
Mid-bands1 GHz to 6 GHz
High-bandsAbove 24 GHz (mmWave)
Low-bandsBelow 1 GHz
Diversespectrum
Licensed/shared/unlicensed
![Page 10: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/10.jpg)
37
20+Operatorsannounced
20+OEMsannounced
5G rollout happening faster than 4G
4Operatorslaunched
3OEMslaunched
Source: IHS Report Jan ’19, Qualcomm Technologies data
Year 1 announcements underscore tremendous momentum with 5G
![Page 11: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/11.jpg)
38
1990sDigital voiceSMS
2000sMobile dataMMS and video calling
1980sAnalog voiceVoice call
2010sMobile broadbandEnhanced Video calling
2019+Enhanced Mobile BroadbandHolographic telepresence
Evolution of social communications buildingon decades of breakthrough technologies
![Page 12: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/12.jpg)
39
HolographicTelepresence
Real time social interaction
Spatialcomputing
39
![Page 13: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/13.jpg)
40
![Page 14: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/14.jpg)
41
Building the vision of converged XR
AR
VR
Existing Processing
Standalone Processing
Distributed Processing
(Wireless Proximity)
DistributedProcessing
(Mobile Edge Computing)Converged XR
(Mobile Edge Computing)
USB3-DP
Distributed Processing
(Cabled Proximity)
60 ghZ 5G 5G
![Page 15: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/15.jpg)
42
Tracking/Inputs
Encoded data On-device adjustment to latest pose1
XR headset
Deeperin network
On-premise, e.g. venue
with rendering
Cloud
Boundless XR over 5G – Distributed IntelligenceThe public or private 5G edge will augment on-device processing
1. Asynchronous time warp reduces Motion to Photon (MTP) latency by using on-device processing based on the latest available pose. MTP below 20 ms generally avoids discomfort — has to be processed on the device
Edge Cloud
Partial rendering offload possible with 5G’s low latency, capacity and quality of service
Power-efficient, latency sensitive on-device rendering and tracking
Today’s latency is unpredictable
Less latency sensitive content (e.g. recorded streaming video)
with on-device processing
![Page 16: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/16.jpg)
43
ODMs, OEMs
Platforms, Technology
Platform Content
Collaboration within the XR
ecosystem
OperatorsEnd
Users
consumer
enterprise
![Page 17: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/17.jpg)
44
The path to convergence
ComputeSystems:
Entertainment:
Telecomm:
Mainframecomputer
Workstation DesktopPC
Laptop Tablet Smartphone
Theater Movies Home Television
Home Phone Large CellularPublic Phone Feature Phone
Laptop Tablet Smartphone
Smartphone
![Page 18: The 5G Era: Consumer Devices of the Future...42 Tracking/Inputs Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue with rendering](https://reader030.vdocuments.site/reader030/viewer/2022040415/5e94c004c676426df915d30a/html5/thumbnails/18.jpg)
Nothing in these materials is an offer to sell any of the components or devices referenced herein.
©2018-2019 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved.
Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries. Other
products and brand names may be trademarks or registered trademarks of their respective owners.
References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm
Incorporated, operates, along with its subsidiaries, all of Qualcomm’s engineering, research and development functions, and all of its product and services businesses, including its semiconductor business, QCT.
Follow us on:
For more information, visit us at:
www.qualcomm.com & www.qualcomm.com/blog
Thank you
@BakadirS