open standards as a leverage for the development of ... · friction, roughness, … lane markings ,...

25
V1.0 | 2019-11-26 ASAM International Conference, December 11 th 2019 Open Standards as a Leverage for the Development of Automated Driving

Upload: others

Post on 29-Mar-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

V1.0 | 2019-11-26

ASAM International Conference, December 11th 2019

Open Standards as a Leverage for the Development of Automated Driving

Page 2: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Still valid, but: yesterday’s news:

Increased front-loading to avoid costly changes in late development phases

Deterministic controllability of vehicle and environment test conditions

Safe testing in critical driving maneuvers, including near crash situations or vulnerable road users

Simulation is an integral part of the development of automated driving:

New software development processes

Interdisciplinarity leads to diverse tooling and increased importance of standards

Increased quantity and quality of scenarios

Why do we need closed-loop simulation and (OpenX) standards?

Motivation

Single vehicle

Simple and short scenario

Interaction with environment only through road contact

Simple animation for verification purposes

Stand-alone usage on a desktop machine

2

Page 3: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Standards for Key Components of Virtual Test Driving

Standards for Virtual Test Driving

Dynamic Environment

vehicles, bicycles, pedestrians, animals

deterministic tasks orstochastic traffic

interaction with other roadusers and reaction on events

Sensor Models

camera, radar, lidar, ultrasonic

object lists, target lists orphysics-based sensor data

realistic sensormovements due to vehicledynamics

Vehicle Model

chassis, steering, tires, …

engine, electric motor, …

drivetrain components

electrical system, …

vehicle state sensors foryaw rate, acceleration, …

Static Environment

road profile, network

friction, roughness, …

lane markings, guard rails, traffic signs, signals, …

terrain, buildings, vegetation

lighting, fog, precipitation

Toolchain Integration

integration of systemunder test into vehiclemodel

integration of simulationapplication into variousexecution environmentsfrom MiL to HiL

test automation

reporting

management of resultdata and parameters

3

Page 4: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Standards for Key Components of Virtual Test Driving

Standards for Virtual Test Driving

Dynamic Environment

vehicles, bicycles, pedestrians, animals

deterministic tasks orstochastic traffic

interaction with other roadusers and reaction on events

Sensor Models

camera, radar, lidar, ultrasonic

object lists, target lists orphysics-based sensor data

realistic sensormovements due to vehicledynamics

Vehicle Model

chassis, steering, tires, …

engine, electric motor, …

drivetrain components

electrical system, …

vehicle state sensors foryaw rate, acceleration, …

Static Environment

road profile, network

friction, roughness, …

lane markings, guard rails, traffic signs, signals, …

terrain, buildings, vegetation

lighting, fog, precipitation

Toolchain Integration

integration of systemunder test into vehiclemodel

integration of simulationapplication into variousexecution environmentsfrom MiL to HiL

test automation

reporting

management of resultdata and parameters

OpenD

RIV

EO

penSCEN

ARIO

XiL

API

MDF

OSI

4

Page 5: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Standards for Key Components of Virtual Test Driving

Standards for Virtual Test Driving

Toolchain Integration

integration of systemunder test into vehiclemodel

integration of simulationapplication into variousexecution environmentsfrom MiL to HiL

test automation

reporting

management of resultdata and parameters

Dynamic Environment

vehicles, bicycles, pedestrians, animals

deterministic tasks orstochastic traffic

interaction with other roadusers and reaction on events

Sensor Models

camera, radar, lidar, ultrasonic

object lists, target lists orphysics-based sensor data

realistic sensormovements due to vehicledynamics

Vehicle Model

chassis, steering, tires, …

engine, electric motor, …

drivetrain components

electrical system, …

vehicle state sensors foryaw rate, acceleration, …

Static Environment

road profile, network

friction, roughness, …

lane markings, guard rails, traffic signs, signals, …

terrain, buildings, vegetation

lighting, fog, precipitation

DYNA4

5

Page 6: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Standards for Key Components of Virtual Test Driving

Standards for Virtual Test Driving

OpenDRIVE

OpenSCENARIO

OSI

MDF

XiL API

System under Test

0111000

1011010

0000100 C++

optional: custom sensor model

Input Simulation & Workflows Output

DYNA4

6

Page 7: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Test system performance of highway pilotfunction

uses vehicular environment perception sensors

enhanced with C2X functionality

Testing scenario with Vehicle under Test:

on a highway

approaching a traffic jam caused by a broken down vehicle

in varying surrounding traffic

Use-Case Description

Use-Case: Explorative Testing of a Highway Pilot

source: Daimler.com

7

Page 8: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

OpenDRIVE Road Model

Use-Case: Explorative Testing of a Highway Pilot

OpenDRIVE

DYNA4

8

Page 9: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

ASAM OpenDRIVE standard for parametrical

road model and static environment

Complex road networks with junctions,

crossfall, superelevation etc.

Road marks and barriers,

traffic signs and traffic lights, gantries, etc.

Integration of high resolution road surface

profiles in OpenCRG format

Direct support without conversion in DYNA4

Online generation of road and terrain

for simulation and 3D visualization

Simulink block for online access

to “ground-truth road data”

OpenDRIVE in DYNA4

Use-Case: Explorative Testing of a Highway Pilot

German highway A9 measured and exported to OpenDRIVE by

9

Page 10: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Enhancement of OpenDRIVE roads with custom-made environments

Use-Case: Explorative Testing of a Highway Pilot

Windridge City by

Wangen by

10

Page 11: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

What is SUMO?

Free and open traffic simulator

Part of Eclipse openMobility group

Simulation of Urban Mobility

Main contributor: German Aerospace Center

OpenDRIVE support in SUMO

Proprietary XML network format for SUMO

Conversion from OpenDRIVE via SUMO’s integrated

NETCONVERT tool

Reduction of manual effort through customizable

mapping of OpenDRIVE

OpenDRIVE in SUMO

Use-Case: Explorative Testing of a Highway Pilot

German highway A9 imported to SUMO displayed in NETEDIT

11

Page 12: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

OpenSCENARIO

Use-Case: Explorative Testing of a Highway Pilot

OpenSCENARIO

DYNA4

12

Page 13: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Current solution: proprietary scenario

description

Assign paths or routes to road users (vehicles,

cyclists, motorbikes, pedestrians, animals)

Trigger longitudinal or lateral driving tasks

such as lane changes for deterministic

behavior

Enhance deterministic traffic with stochastic

road users

Upcoming: OpenSCENARIO

Active contribution to OpenSCENARIO 2.0

Expectations / hopes:

> Standardized, yet extensible scenario description

language

> Unified mechanism for 0, 1 or n Vehicles under

Test + deterministic traffic + stochastic traffic

Traffic and Dynamic Environment

Use-Case: Explorative Testing of a Highway Pilot

13

Page 14: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Driving single VuT on highway in stochastic surrounding traffic

Use-Case: Explorative Testing of a Highway Pilot

Scene in traffic simulator SUMO Scene in visualization of DYNA4

Vehicle under Test

14

Page 15: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

OSI

Use-Case: Explorative Testing of a Highway Pilot

System under Test

0111000

1011010

0000100 C++

OSI

DYNA4

15

Page 16: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Simulated Sensor Data

Use-Case: Explorative Testing of a Highway Pilot

Sensors are crucial for environment perception of ADAS/AD algorithms

Simulator provides sensor data depending on boundaries of system under test:

(sensor-specific) object lists or

technology-specific raw data

Object lists are often sufficient for closed-loop simulation

But mapping them across tools is tedious!

Reference coordinate systems

Object types

Lidar point cloud simulated in DYNA4 (left), received and visualized in ROS Rviz (right)

Objects visualized in a Birds Eye View

69

16

Page 17: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Example: Testing the Sensor Fusion ECU (Hardware)

Use-Case: Explorative Testing of a Highway Pilot

FusedObject List

CANETH

DYNA4

OSI Protobuf

OSI ProtobufByte-Array

Protobuf-Deserializer

ETH

Object Lists:

Camera

Radar

C2X

Sensor FusionETH

Planned for 2020:

Sending object lists from DYNA4 as OSI Byte Array

Receiving OSI Byte Array in CANoe

OSI conform object list definition within CANoe

Object List Sensor

CANoe

17

Page 18: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Example: Testing the Sensor Fusion ECU (Software)

Use-Case: Explorative Testing of a Highway Pilot

DYNA4

OSI Protobuf

OSI ProtobufByte-Array

Protobuf-Deserializer

Object Lists:

Camera

Radar

C2X

Planned for 2020:

Sending object lists from DYNA4 as OSI Byte Array

Receiving OSI Byte Array in CANoe

OSI conform object list definition within CANoe

CANoe4SW

Object List Sensor

Visual Studio

Sensor Fusion

Function

18

Page 19: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Execution of DYNA4 Models in other Environment

Use-Case: Explorative Testing of a Highway Pilot

DYNA4 Studio

DYNA4 Run

export / compile

Authoring in DYNA4 StudioDYNA4 Run

Authoring of Models, Parameters and Scenarios with DYNA4 Studio

Headless Execution of DYNA4 Run in other environment: ADTF,

CANoe, ROS, Windows / Linux Executable, …

19

Page 20: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

C2X Simulation in CANoe executing a DYNA4 Model with SUMO

Use-Case: Explorative Testing of a Highway Pilot

Vehicle under Test

20

Page 21: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

MDF

Use-Case: Explorative Testing of a Highway Pilot

MDF

DYNA4

21

Page 22: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Standardized result data analysis with MDF

Use-Case: Explorative Testing of a Highway Pilot

Many scenarios and many virtually

driven kilometers generate a lot of

data

Generation of MDF files as result

data files for seamless result data

analysis without conversion

DYNA4 MDF support: Q2 2020

22

Page 23: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Open Standards for the Simulation of Automated Driving

Summary & Outlook

Single vehicle

Simple and short scenario

Interaction with environment only through road contact

Simple animation forverification purposes

Stand-alone usage on a desktop machine

Deterministic traffic, stochastic traffic and multiple vehicles under test.

Complex scenarios based on OpenDRIVE to reflect real-worlddriving. Soon: OpenSCENARIO.

Detailed environment simulation and sensor models on different levels. Soon: Support of Open Simulation Interface.

High-quality animation with sensorsimulation. Soon: Support of Open Simulation Interface.

Flexible integration in existingtoolchains through interfacesor headless model runtimes. Soon: Result analysis based on MDF.

Multiple Vehicles under Test in Platooning setup

Lidar point cloud displayed in ROS RViz

23

Page 24: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Any questions?

Thank you for your attention.

Summary & Outlook

24

Page 25: Open Standards as a Leverage for the Development of ... · friction, roughness, … lane markings , guard rails traffic signs, signals, … terrain, buildings, vegetation lighting,

© 2019. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.0 | 2019-11-26

Author:Dr. Jakob KathsVector Germany

For more information about Vectorand our products please visit

www.vector.com