multimedia evolution public for web approved · 2 the arm vision a world in which all electronic...
TRANSCRIPT
1
Multimedia Evolution
Ian Smythe
Director of Marketing
Media Processing Division
2
The ARM Vision
A world in which all electronicproducts and services are based onenergy-efficient technology fromARM®, making life better foreveryone
3
Consumer Entertainment Drivers
4
Revolution in Content Consumption
Growth in connecteddevices in the home
Major change in howcontent and servicesare consumed
Killer apps are socialnetworking and videosharing
Personalized contentdriving increasedneed fortransactional security
Petabytes per month
Sources: Cisco VNI Q4 2009: Futuresource Consulting
% of Homes withIP Enabled Devices
5
Enabling the Change
Infrastructure
Global adoption of 3G with2.8Bn subscribers and ~45%penetration by 2014
Evolution of mobile broadbandaccess from 2G to LTE+
Services moving to the cloud
Enabled by multi-serviceIP networks
OEM innovation driving widerange of products into themarket
6
The PCInternet
The MobileInternet
The Internetof Things
Minicomputer
Mainframe
7
Mobile is winning... It’s amazing tome that the smartest developers noware writing apps for mobile beforethey write for Windows or Apple Macdesktop operating systems.
Eric Schmidt – Google CEO, July 2010
8
Mobile Phone demands
Personalizedcompute platform
Advanced video, console qualitygaming
Navigation with augmented reality
Secure transactions
All-day battery life
On the Move – 2014 Mobile
Mobile Computing demands
Support for richinternet applications
Secure transactions
Continual innovationin UI and form factors
High speed wireless data access
All-day battery life
9
Mobile 1956: H Osborne of AT&T
10
1924: Google and 1935 Twitter
11
Social Media – changing the world
12
THE IMPACT OFIMMEDIATE ACCESS ONMULTIMEDIA EVOLUTION
13
GPUs Everywhere
Anything with a screen
Software is a necessity
Graphics acceleration is key
14
Graphics demands increasing
More complex effects require more processing...
Same number of output pixels, but more work done for each pixel
For example, a dual core ARM Mali™-400 MP can perform 20 shader operationsper cycle
...in addition to texture filtering, blending, anti-aliasing...
…realtime contrast, brightness and saturation adjustment with YUV texturing to275MPix/s
YUV texturing to ”pull”video into graphics
pipeline
...including realtimecontrast, brightness and
saturation adjustment
Per-pixel depth of fieldeffects
Per-pixel diffractioneffects
15
Insatiable Performance Requirement
WVGA WXGA 1080p
Screen resolution: 4.3x increase in number of pixels
>40x increase in graphics processing
Increasing content complexity: >10x increase in processing per pixel
OpenGL ES 1.1 Samurai OpenGL ES 2.0 Taiji Desktop(Complexity=1) (Complexity=5) (Complexity=10)
With power budget suitable for handheld.
16
The Gaming Experience
Complex content (geometry,texture data, etc…)
Smooth gameplay throughhigh framerates
Improved anti-aliasingtechniques
Realistic environments, waterreflections, shadows, bumpmapping, environmentmapping, etc...
17
The UI Experience
User interfaces exploit MaliGPU
Overlay and alpha blending
Complex Transitions
Animated icons
Applicable for phones, TVs,set top boxes, car dashboards - anything with ascreen
18
A World of Infinite Content
Internet everywhere
Broadcast, pay-per-view, pre-recorded, web content, usergenerated content, video conferencing…
Almost infinite array of content
How to personalize and simplify access?
How to draw consumers to directed advertising?
Good, intelligent user interface design
Critical for any screen-based solution
19
ARM Graphics Architecture
Design principles
Tile-based deferred rendering is the rightchoice for power-efficient design
Multicore delivers true performance scalability
Focus on compute performance for advanced content
Common ISA and software driver across a family of GPUs
Delivering industry leadership
Performance, memory bandwidth, area and power efficiency
Constant innovation
New GPU product on regular tick – 2x increase in performance / year
Common software driver to protect software investment
Improved performance per core in each generation
Increased architectural efficiency (performance/area and power)
20
1.0
1.5
2.0
2.5
3.0
3.5
4.0
1 2 3 4
Re
lati
veP
erf
orm
an
ce
Number of cores
Multicore performance at1080p
OpenGL ES 2.0 OpenGL ES 1.1
Mali-400 MP
World’s 1st embedded multicore GPU
Khronos OpenVG® 1.1, OpenGL® ES 2.0 support
Separate vertex (geometry) and fragment (pixel)processing for maximum parallel throughput
Industry-leading memory bandwidth efficiency
Level 2 cache reduces memory bandwidth andsystem-level power consumption
Multicore performance scalability
1 to 4 fragment processors
Near-linear performance scaling in real systems
Delivers in excess of 1G visible* pixels/s
Single, optimized software driver for allconfigurations
*No artificial overdraw assumptions
Multicore Performance Scalability
21
Mali & Stereoscopic 3D
ARM have already demonstrated Stereoscopic 3D on bothMali-200 and Mali-400 platforms at HD 720p
Demo details: Mali renders the entire world twice per frame at 30 frames per second
Mali-200 driving HD720p, 1280x720 horizontal split
Triangle count 16,000 (8,000 per eye) / frame
Average pixel shader complexity : 2-6 cycles per pixel draw,5% - 10% overdraw
No changes to Mali driver stackrequired to achieve stereo 3D
Essentially Stereoscopic 3Drepresents an increasedperformance load on the GPU asmore pixels need to be processed
22
Summary
Bewildering array of content available
Increasingly complex content and more and more interaction
Good UI design allows personalization and simplifies accessto content
GPU is a must-have for connected screens
Use of 3rd dimension & the “Apple effect” for UI
HD screens demand very high pixel throughput & bandwidth
ARM’s partners deploying GPUs today in wide range ofdevices
Bringing the multimedia evolution to you
23
See Mali demos from our partners
Amlogic: Android™ 2.2 Quake demo
STM: Sti7108 demo
Arphic: 3D font demo on SmartQ
Brogent: 3D UI on SmartQ
Digimax: Bare eye Stereoscopic 3D TV
Rightware: UI demo
TAT: UI demo
Come and see us:
Mali-400 tablet demo (TAT)
SmartQ raging thunder 2,
Stereoscopic game “BruteForce”
Want to know more?
24
...or go to Mali Developer Center
Full range of Mali developer resources
Tools, Development boards, Demos, Examples, Tutorials
www.malideveloper.com
25
QUESTIONS