mathworks - simulationbased development of adas and … · • virtual sensors, e.g. for estimation...

23
A N D A T A A N D A T A Dr. Andreas Kuhn A N D A T A Simulationbased Development of ADAS and Automated Driving with the Help of Machine Learning München, 2017-06-27

Upload: others

Post on 31-Dec-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Dr. Andreas Kuhn

A N D A T A

Simulationbased Development of ADAS and

Automated Driving with the Help of Machine Learning

München, 2017-06-27

Page 2: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

© 2017, ANDATA

2

Fields of Competence

• Artificial Intelligence

• Data Mining

• Big Data Analytics

• Modeling and simulation

• Predictive Model based

Control

• Distributed Control

• Signal Classification

• Swarm Intelligence

• (Embedded) Software

• Decision Support Systems

• Robustness and Complexity

Management

Contact: A-5400 Hallein, Hallburgstraße 5, +43 6245 74063, [email protected], www.andata.at

Data driven

development

process

Automotive safety

(Mobile) Robotics Automated Guided

VehicleIndustry 4.0,

Digitalization

Failure prediction

Big Data Analytics &

AI & Simulation

Anomalies and

Incident Detection

Vehicle and traffic

automation

Page 3: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Advanced Driver Assistant Systems and Automated Driving

Which sensors are necessary for valid decisions in automated driving?

What sensefull functions can be carried out with a given set of sensors?

© 2017, ANDATA

3

Avoiding collisions by informing, warning,

braking, steering, automated manoeuvres

© A

udi A

G

Page 4: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Problem Statement

• Number, diversity and complexity of safety systems increases steadily

• Do we still underestimate the complexity of integral safety systems?

• What is the minimum/best set of test cases to sufficiently

describe/specify/evaluate the system behaviour?

• How can we be sure?

© 2017, ANDATA

4

Page 5: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Sources of Complexity• Human beings are part of the control loop now!

Systems have to anticipate the anticipation of other traffic participants

It’s about the difference between subjective and objective danger rather than about

objective danger only

© 2017, ANDATA

5

Page 6: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Sources of Complexity• The problem is of stochastic nature!

There are a lot of possibilities how a given situation can evolve

• Action/reaction of driver/pedestrian

• Scatter of environmental conditions

• Uncertain vehicle conditions

There is not one single certain

Time to Collision (TTC)

Time to Collision is a

stochastic random variable

Conditional probabilities: Bayes!

?p

TTCmost probable TTC

TTC

relative

frequency

© 2017, ANDATA

6

Page 7: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Sources of Complexity

• The problem is mathematically instable!

Even small changes in the initial/boundary conditions may lead to

completely different collision conditions

v1

v2

v1

v2+e

© 2017, ANDATA

7

Page 8: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Sources of Complexity

• Conflicting requirements

• Incomplete information

© 2017, ANDATA

8

© Audi AG

Page 9: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Consequences

• Taking a probabilistic/stochastic point of view

• Consequent Top-Down instead of Bottom-Up system development

• Analysis of field effectiveness instead of test effectiveness

• Increasing integration of simulation based development

(scenario based approach)

• Broad application of data driven approaches

(Big Data Analytics and Artificial Intelligence)

Combined into Integral Development Process

Almost completely carried out in MATLAB

© 2017, ANDATA

9

Page 10: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Field of Effect

The Core Principle for Algorithm Development

© 2017, ANDATA

10

• Example based represenation of functional requirements

Warning

t

Sensor signals

t

Desired action

Braking

t1

t1+dt

Algorithm

Time window

Restraint

Sensors

Algo

Action

Effect! > Visible to customer

Market driven > Requirements/Spec

Functional requirement for

algorithm:

• Which action to take

when

• in which situations

• based on which

sensors/information

Neural Networks,

Machine Learning

Page 11: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Example Based Representation of Functional Requirements

11

WarningBraking

WarningBraking

WarningBraking

Control Unit

Control

AlgorithmSensor signals Actorics

Situation1

Situation2

Situationn

.

.

.

© 2017, ANDATA

Page 12: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Data Acquisitions from Fleet Data

© 2017, ANDATA

12

Page 13: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Scenario-Management and Development/Approval of Actions

© 2017, ANDATA

13

Page 14: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Action Specification Based on „Decision Points“

with „Big Data Analytics“

© 2017, ANDATA

14

Page 15: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Folding Various Decision Variables (e.g. collision probabilities)

© 2017, ANDATA, several granted and pending patents

15

Page 16: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Effectiveness Rating von Different System Variants

© 2017, ANDATA

16

Page 17: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

What is a requirements conflict for a control algorithm?

In different situations, which induce the same sensor image, different actions are desired!

Numerical Conflict Analysis

17

Conflict Conflict

ConflictConflict

© 2017, ANDATA

LCNF,1

LCNF,2

LCNF,n

Cluster analysis

NoAct

MustAct

Page 18: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

ANDATA Solution Traffic Control

© 2017, ANDATA

18

Problem description• Model based predictive control of traffic flows

Solution approach• Scenario- & data based specification of function

• Functional algorithms with Artificial Intelligence

• Multi-level, stochastic simulation

• System-Engineering

• Pattern recognition

• Machine Learning

• Virtual sensors

• Effectivness rating

• …

Tools• MATLAB

• Neural Networks Toolbox

• Statistics and Machine Learning Toolbox

• Div. ANDATA Toolboxen für MATLAB

Page 19: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

ANDATA Solution Robotics, Production and Assembly

© 2017, ANDATA

19

Problem description• Development of control algorithms for

mobile robots in industrial environments

Solution approach• Scenario based approaches

• Sensor signal modeling

• Kinematic simulation

• „Intelligent“ algorithms for mapping,

localization, path planning

Tools• MATLAB, Simulink/Stateflow

• Neural Networks Toolbox

• Statistics and Machine Learning Toolbox

• MATLAB Compiler, MATLAB Coder

• var. ANDATA Toolboxes for MATLAB

Page 20: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

ANDATA Software and Tools

© 2017, ANDATA

20

• Data collection, preparation and

normalization

• Data cleaning

• Sensor models

• Signal preparation

• Requirements definition ("labelling", etc.)

• Data analysis

• Training, adaption and evaluation of

Machine Learning models

• Meta modelling, feature selection, etc.

• Scenario management

• Multilevel stochastic simulation

• Execution of distributed simulations

• Data plausibilization

• Anomalies and incident detection

Page 21: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Summary• Scenario Management

• Operational Requirements Management• Conflict analysis

• Proof of feasibility of the requirements

• Sensor concept evaluation and rating

• Effectiveness rating of system concept

• Design of experiments (What is the minimum test set to assure safe system functionality?)

• Virtual sensors, e.g. for estimation of collision probabilities

• Fast prototypical implementation

• Conform separation between specification and implementation

• Anomalies detection as quality assurance for simulation

• …

Extreme Development Procedures Extremely quick, efficient, effective

© 2017, ANDATA, several granted and pending patents

21

Uniform, integral product

development process for

traffic automation

Carried out completely

in MATLAB

Page 22: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

Conclusion

Just do it! Tools are available for decades now

MATLAB / Simulink / Neural Networks Toolbox© 2017, ANDATA, several granted and pending patents

22

Extreme product

development

procedures with

Big Data Analytics

and Artificial

Intelligence

are not research

anymore!

Page 23: MathWorks - Simulationbased Development of ADAS and … · • Virtual sensors, e.g. for estimation of collision probabilities • Fast prototypical implementation • Conform separation

A N D A T AA N D A T A

A N D A T A GmbHDr. Andreas Kuhn

Tel: +43 6245 74063

Email: [email protected]

Web: www.andata.at

23

Thanks, for listening!

The singularity is near, let‘s be prepared!

© 2017, ANDATA