will robots drive our cars soon? · supercomputing systems ag phone +41 43 456 16 00 technopark 1...
TRANSCRIPT
![Page 1: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/1.jpg)
Supercomputing Systems AG Phone +41 43 456 16 00
Technopark 1 Fax +41 43 456 16 10
8005 Zürich www.scs.ch
Vision trifft Realität.
Will robots drive our
cars soon?
Driver assistant systems with FPGA und DSP
Felix Eberli, Department Head, SCS
![Page 2: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/2.jpg)
2 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Futuristic ideas already 1956
![Page 3: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/3.jpg)
3 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Driverless car in the 1980’s
![Page 4: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/4.jpg)
4 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
DARPA Challenge – 11.9km after start (5%)
![Page 5: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/5.jpg)
5 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
DARPA Urban Challenge 2007
![Page 6: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/6.jpg)
6 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Mercedes Benz Versuchsfahrzeug 2013
S-500 “Bertha”
![Page 7: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/7.jpg)
7 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Google car with laserscanner (2014)
![Page 8: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/8.jpg)
8 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Tesla Auto Pilot (2015)
https://www.teslamotors.com/de_CH/blog/your-autopilot-has-arrived
![Page 9: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/9.jpg)
9 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Will robots drive our cars soon?
![Page 10: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/10.jpg)
10 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
But already in series as many driver assistant systems
• ADC (Distronic)
• Blind spot detection
• Break assist
• Pedestrian detection
• Park pilot
• Stop & Go Pilot
• Highway Pilot
• ….
• Lets see
![Page 11: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/11.jpg)
13 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Sensor View – Radar and Stereo
![Page 12: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/12.jpg)
16 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS company profile
• Founded 1993 and privately owned by Prof. Dr. Anton Gunzinger
• 90+ employees:
Electrical engineers
Software engineers
Physicists
Mathematicians
• Company offices at Technopark Zurich, Switzerland
![Page 13: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/13.jpg)
17 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS Services
Departments
• Embedded & Automotive
• Life Science / Medical
• High Performance Safety
• Embedded
• High Performance Computing
• SW / Public Transport
• SW / Broadcast
• Measure & Decide
Embedded & Automotive
• Feasibility studies
• Hardware (Specification, Design, Schematics, Layout, Production)
• Firmware/IP (FPGA, DSP)
• Software (Drivers, Host SW – Windows/Linux)
• Optimizations (ARM, DSP, EVE, Neon)
![Page 14: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/14.jpg)
18 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS Embedded & Automotive Department
![Page 15: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/15.jpg)
19 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Why autonomous driving? - Traffic Must Become Safer
50% of all accidents with injured occur
in urban environments.
CH: 269 fatalities in 2014
0
5000
10000
15000
20000
0
100000
200000
300000
400000
500000
600000
1970 1980 1990 2000 2010
4002
391.000
Injured/ Year
Fatalities / Year
![Page 16: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/16.jpg)
31 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
The Principle of Stereo Vision
Left Image Right Image Disparity Image
Challenge: on-line calibration to guarantee
perfect results for the whole lifetime of the car.
Color encoded distance:
close ….. far
H.Hirschmüller: "Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual
Information", DAGM 2005, CVPR 2005
![Page 17: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/17.jpg)
32 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
The Principle of Stereo Vision
2008 world-wide first real-time
implementation of Semi-Global
Matching on an automotive compliant
FPGA
S.Gehrig, F.Eberli, T.Meyer, “A Real-time Low-Power Stereo Vision Engine Using Semi-Global
Matching”,
ICVS 2009 (Best Paper Award)
![Page 18: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/18.jpg)
33 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Local Stereo vs. Daimler Global Stereo
Advantages of Daimler-Stereo Semi-Global Matching (SGM)
Significantly more 3D measurents
Significantly fewer Measurement errors in low-contrast regions
robust against periodic structures
SGM Correlation
Color encoded distance:
close ….. far
![Page 19: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/19.jpg)
34 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Stereo Results in Real-Time
Baseline 25cm, 45° horizontal field of view
Color encoded distance:
close ….. far
![Page 20: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/20.jpg)
44 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Sensors in Modern Cars
![Page 21: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/21.jpg)
45 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Comparison Tesla – Daimler Sensors (2014)
![Page 22: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/22.jpg)
66 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Is Stereo-Based Driver Assistance a Solved Problem?
If we want Vision to become an all-day all-night sensor for safety
critical systems, we should be able to work under those adverse
conditions!
![Page 23: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/23.jpg)
90 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Current research focuses
on a deeper understanding of the scene
• https://www.cityscapes-dataset.com/examples/
![Page 24: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/24.jpg)
91 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Outlook Self Driving Cars – Additional Links
• BMW kündigt selbstlenkende Fahrzeuge für 2021 an http://www.zdnet.de/88269245/bmw-kuendigt-selbstlenkende-fahrzeuge-fuer-2021-an/
• Sieben Firmen testen zurzeit selbstlenkende Autos auf Kaliforniens Straßen
• Mercedes Future Truck 2025
• Chris Urmson – Google Director Self-Driving-Cars https://youtu.be/Uj-rK8V-rik
![Page 25: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/25.jpg)
92 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Baby you can drive my car…
Source: https://youtu.be/H0jJAPvN2uI?t=18
![Page 26: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/26.jpg)
95 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
SCS Stereo Vision Evaluation Plattform
![Page 27: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/27.jpg)
96 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Output of the SCS Stereo Vision Evaluation Plattform
More info: www.scs.ch/fpgabox
![Page 28: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/28.jpg)
97 Zürich 27.05.2016 © by Supercomputing Systems AG PUBLIC
Example measurement accuracy 3:
Distance measured = 10.549m +/- 0.022m (Baselength = 25cm)
![Page 29: Will robots drive our cars soon? · Supercomputing Systems AG Phone +41 43 456 16 00 Technopark 1 Fax +41 43 456 16 10 8005 Zürich Vision trifft Realität](https://reader033.vdocuments.site/reader033/viewer/2022060522/6051d7fa602e2c7cf21456e1/html5/thumbnails/29.jpg)
Supercomputing Systems AG Phone +41 43 456 16 00
Technopark 1 Fax +41 43 456 16 10
8005 Zürich www.scs.ch
Vision meets reality.
Supercomputing Systems AG
[email protected] +41 43 456 16 19