technology status on visual feedback › public › uploads › ...emmanuel roncoroni graphics...

Strictly Private and Confidential

Emmanuel Roncoroni

Graphics Rendering Technology

September/October 2015

Technology Status on Visual Feedback

Visteon at a Glance

One of the world’s most recognized

automotive suppliers

Provides products to virtually every vehicle

manufacturer around the world

Product portfolio: electronics

Focused on, and well-positioned in, high-

growth cockpit electronics markets

Sales of $7.51 billion (2014)

12,000+ employees

50 facilities in 21 countries across the globe

Page 2

A Strong and Growing Customer Base

Our Brands :

Audio and Infotainment

Leading global audio technology – Solutions for all standards in silver box, HUs or

integrated

Infotainment to meet the needs of the future – Multi-OS; repartitioned, Cloud content and services;

domain architecture

Connectivity between smartphone and car – Bluetooth, Wireless Charging, Screen Replication,

WiFi

Global Telematics platforms to connect to

emerging services – TCU , eCall, GLONASS, 4G

Page 4

OpenAir® Premium Audio and Infotainment

BlueConnect™ Premium Connectivity

Information and Controls

#2 rank in global Instrument Cluster sales

– key partner to 7 of the world‘s top car makers

Solutions for all market segments

– from volume 2 wheeler to value segments

through to premium brands

World‘s largest secondary/center display provider

– Superior touch, graphics performance and vehicle

integration

Windscreen and Combiner options

– Leading optics and wide viewing angles to meet

emerging needs for AR

Page 5

LightScape™ Premium Instrumentation

Our Brands :

Graphics Rendering

Technology

The Graphics Rendering Eco-system

Hardware

Graphic Toolchain Graphic Driver

Proprietary

Art

istic C

reation

Ele

ctr

onic

Pro

ducts

• Visteon is a member of:

o GENIVI

o W3C

o Khronos group

• References and expertises in automotive graphics rendering:

Page 8

Visteon Graphics Rendering

Technology

Survey

Standards

Survey

Technology

Innovation

Technology

Assessement

Product

Development

Supplier

Management

Product

Deployment

Technical

Support

PI ELS

Do we need more pixels?

Car driver eyes can see between 115 to 300 ppi of their onboard devices

Static image Dynamic image

More pixels for a better quality and less driver distraction

The antialiasing

on stage

file:///C:/eroncoro/GfxRenderTech/5-Demos/mechanical_grab.mp4

Pixel rendering limitation

12.3 ’’ True color Display

• 1920x720 = 1,382,400 pixels 160 ppi

• 2880x1080 = 3,110,400 pixels 360 ppi

+225%

Memory Storage

• ¼ GB 1 GB

Memory Access

• CPU/GPU RAM/ROM bandwidth

Image Processing

• 2D Pixel engine capacity to process Mpix/sec

• 3D Fragment shaders to process Mpix/sec

More pixels has impact on the global electronic system architecture

The Technology Assistance

Realtime 3D vs pre-rendered images

• Reduce memory space and

bandwidth consumption

Higher memory bus throughput

• QSPI HyperBus …

• DDR2 DDR3 …

• Memory bus frequency increase

More rendering engines

• Mid-end platforms

o Sprite, Pixel, Drawing, Warping, … engines

• High-end platforms

o Multi-GPU cores

o More shader units / cores

Automotive graphics technology caught up CE market in few years

mechanical_grab.mp4

Some Technology Trends

More displays, pixels and real 3D effects Technologies

Consumer Electronic market status

Digital life drives the Visual FX to end-users

Tablet

Smartphone

Smart TV

Gaming

Movie

Do we need more Visual FX in cars?

Quality, Market differentiation, Driver attention

Realtime 2D Animations

• Color / Glow

• Blurring

• Scale Up

• Motion blurring

• …

Realtime 3D Animations

• Geometry & materials

• Camera

• Lighting

• Morphing

• Texture

• Level of details

• …

Realtime compositing

• Opacity

• Layer transformations

• …

And more to address:

• ADAS

• Autonomous driving

• Connectivity / IoT

• …

The Technology Status

Control technology solutions to avoid problems

Mid-end Platforms

High-end Platforms

OpenGLES 1.1 2.0 3.0 3.1 Vulkan

Multi GPU Cores

Multi Shaders / Cores

Multi shader types

Composition eco-system

Data integrity management

Proprietary APIs, OpenVG1.1, OpenGLES 1.1

Multi/dedicated Engines

Memory consumption optimization

Memory access optimization

Data integrity management


More visual effects for better emotion experiences

Geometry & Tesselation shading

Cloud based rendering Layer management

One of the In Vehicle Infotainment Technology is Web Based GUI

Do we need Web Graphics Technology

Web browsers are popular either in cars or at least in CE devices

Cars are more and more connected

Web application developer community is huge

Apps

• Native Apps for a given OS

• Nomad devices display replication

• Web Apps (eg HTML5)

Main GUI

• Native GUI

• Web GUI

Most of the common features are available, not all mature and efficient

« HTML5 » Technology status

+

• 2D w/ Animation

• 2.5D transformations

• Custom Vertex/Fragment shaders

• Realtime 3D rendering

• Layer Management

htmlApp/step3.bat

HTML5 Visteon market references


New Standard

HTML6 / CSS 4

or 5 / WebGL 2

New WebGL

Libraries

New Model

Cloud Based

Rendering

Hybridation

Native Rendering

Plugins

Today HTML5

CSS3

WebGL1.0

Web-based Graphics Technology grows up

Native UI

Perfomances optimization

Possible bottlenecks

• Memory - Access is overloaded

• GPU - Cannot process all the data at an acceptable rate

• CPU - Consumption is at the maximum

• Design – The design is not adapted to the electronic platform

Not smooth Animations on OpenGL platforms could lead to

• Jerky needle movements

• Skip speed digit scaling

• Steppy car & pod rotation

Some standard mistakes

Memory access is overloaded

• Data access is through only one hardware bus

• Data generally reused are not cached

• Data read in memory is not optimized generating lot of cache misses

• Frame buffer are copied multiple times

• Textures are not compressed

GPU - Cannot process all the data at an acceptable rate

• Shaders operations are not grouped leading to multiple shader switches

• Textures are not packed, leading to multiple texture switches

• Batches are not grouped leading to lot of batch counts to manage

• Shaders are too complex leading to long processing

Some standard mistakes cont’d

CPU - Consumption is at the maximum

• Do you measure it correctly? Peak vs Average?

• The graphic driver does not use all of the hardware acceleration

• The rendering engine is not designed for small CPU usage

Design – The design is not adapted to the electronic platform

• The geometry is not optimized

• The textures are not optimized

• The realtime lighting model is too complex

• Many invisible geometries are computed

Graphics rendering experts are needed to optimized the system

Practicle results

R_Workshop.exe

Conclusion

Key takeaways

More pixels, More displays, More animations, More visual exchanges

Displays and Graphics are brand differentiating factors for a car

Digital life has huge impact on the automotive visual trends

Visual FX can help reducing driver distraction

HTML5 is getting bigger in automotive, and performance improvements are going on

WebGL add 3D rendering to web applications

Recommendation

Adopt the right technology eco-system

o Use the GPU power for a good user experience at affordable cost

o Efficient graphics driver is an important piece in the chain

o Deployment of effective graphic tool chains helps easy creation and graphics

optimization

o Work with Graphics rendering experts

Ready for Future Graphics Rendering Technology Deployment with

mechanical_grab.mp4

www.visteon.com

technology status on visual feedback › public › uploads › ...emmanuel roncoroni graphics...

Documents