canoe.diva: automated testing of diagnostic protocol ... · data driven diagnostic tests test...

32
V1.1 | 2015-01-16 Webinar 2018-04-19 CANoe.DiVa: Automated Testing of Diagnostic Protocol Implementation and Integration in ECUs / 6

Upload: others

Post on 27-Oct-2019

96 views

Category:

Documents


7 download

TRANSCRIPT

Page 1: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

V1.1 | 2015-01-16

Webinar 2018-04-19

CANoe.DiVa: Automated Testing of Diagnostic Protocol Implementation and Integration in ECUs

1 / 6

Page 2: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Presenter

Information

Customer contact concerning the Vector Diagnostic Solution and related tools:

CANdelaStudio / ODXStudio

CANoe.DiVa

Indigo

vFlash

2

Helmut Frank

Business Development ManagerDiagnostics

Email: [email protected]

2/32

Page 3: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Information

Overview

Features

CANoe.DiVa 10.0 News

Summary

More Information

Agenda

3/32

Page 4: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

The Mission

Overview

CANoe.DiVa

data driven diagnostic tests

test generation

reproducible

automated

broad and detailed

test run

documented

4/32

Page 5: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

The Tool

Overview

ECU Specification

ECUSystem under

Test

CDD

Test Module

CANoeXML/CAPL

CANoe.DiVaCANdelaStudio

DiagnosticAuthoring Tool

ODX

Configurator

Generator

RuntimeLibrary

ReportAnalyzer

Test Report

CANoeHTML/

XML

CANoeTest Feature Set

5/32

Page 6: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

The Objectives

Overview

Bus access:Communication

Transport protocol (CAN):ISO network layer, parameters, timings, Flow Controls,…

CANoe/CANalyzer

Diagnostic „communication“: Timings, message format, request/ response dependencies

CANoe.DiVa

Diagnostic „exchange“: Supported services and sub-functions, data content, state dependencies,...

CAN LIN FlexRay DoIP K-Line

6/32

Page 7: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Supported Protocols

Overview

ISO 14229 Unified Diagnostic Services (UDS): 2006/2013

ISO 15765 Diagnostics on CAN

ISO 14230 Keyword Protocol 2000 (KWP)

ISO 15031/J1979 On Board Diagnostics (OBD)

ISO 27145 World-wide harmonized OBD (WWH-OBD)

GMW3110 (including GM Node Verification Procedures)

Various manufacturer specific test extensions (e.g. for Daimler, GM, VW, FCA, …)

7/32

Page 8: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Automated Tests - Scalability of Automation

Overview

Diagnostic Console CAPL Browser vTESTStudio CANoe.DiVa

test creation

test execution

n/a editing CAPL tool supported generated

interactive automated automated automated

8/32

Page 9: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Information

Overview

Features

CANoe.DiVa 10.0 News

Summary

More Information

Agenda

9/32

Page 10: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Overview

Features

Automated generation of a CANoe test based on a diagnostic specification

User interface to configure tests

Generation of a test specification

Clear and detailed report of test results

Support of test report analysis

Requirement traceability

Extensible test functionality

10/32

Page 11: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Protocol Testing

Features

Diagnostic Message Flow

Physical, functional addressing and timing

Diagnostic Protocol Format

Valid, Combined and Invalid Requests

Response (single, none, multiple)

Data Type Checks

Check if the returned parameter value is within the specified (CDD/ODX)

data type boundaries

Sessions and Security Levels

Service execution in the different sessions and security levels

Session and security state transitions

DiVa ECU

11/32

Page 12: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Application Testing: Diagnostic Parameter

Features

Compare diagnostic parameters with CANoe system- or environment variables which may be connected/linked to ccp/xcp or a matlab model,…

Passive parameter validation against

Diagnostic values (e.g. read/write)

Configured data ranges

Expectation values

CCP/XCP values

CANoe System Variables

Active control of I/Os to validate diagnostic parameter content

CAN messages using CANoe rest bus simulation

HW I/Os via VT System channels

Any I/O using CANoe system variables

12/32

Page 13: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Application Testing: Fault Memory

Features

Provoke network signal failures

Communication timeouts

Data consistency failures

Provoke hardware failures using the VT System:

Short-circuits (Ground, UBatt, Pins)

I/O failures (interruption, resistance, voltage)

Individual error settings

Any other failures using user scripts

simul.node 2

realnode 1

simul.node 3

13/32

Page 14: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Application Testing

Features

CANoe ILECU

System under Test

txMsgTemp

Temp.Sensor

Read

(19,22)

IO

Control

(2F)

control

measure

control

check

CANoe.DiVa

VT System

14/32

Page 15: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

User Interface

Features

15/32

Page 16: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Test Reporting

Features

16/32

Page 17: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Test Result Analysis

Features

Compare test runs

Different Views on the test report

Result (Pass/Fail)

Service

ECU State

Issue Classification/Comment

Requirements

Identify error situations by combining Views

Comment and classify test results

Get one-page summary reports

Forward and archive a complete test report or an excerpt

17/32

Page 18: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

System Conditions

Features

Define non-diagnostic system states to enable diagnostic features

e.g. “3rd Gear Selected” or “Engine Running”

System Conditions can be assigned to DTCs or Services

Once assigned System Conditions are created automatically during test runtime

Define System Conditions by a sequence of the following actions

Setting of System Variable

Setting a Bus Message

Waiting Time

User Interaction

Clamp Control

VT System I/O Stimulation

CAPL Code call

18/32

Page 19: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Software Download Test

Features

Supported Download Tests*

Valid Flashing

Overvoltage and under voltage tests

Cancel data transfer (stop transmission or clamp reset)> Check that valid flashing is possible afterwards

Additional flash tests available for selected OEM extensions

* With Vector vFlash

19/32

Page 20: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Software Download Tests

CANoe.DiVa 10.0 News

Added in CANoe.DiVa 10.0

Erase Memory Errors

Clamp reset during EraseMemory

Cancel sequence after EraseMemory

Skip erase

Data Transfer

Transmit wrong CRC

Transmit wrong Signature

Skip writing Fingerprint

Already existing in CANoe.DiVa 4.0

Valid Flash execution

Valid Flash execution at min. and max. voltage

Errors during transfer data

Cancel by clamp reset

Cancel by stop transmission

20/32

Page 21: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Requirements & Traceability

CANoe.DiVa 10.0 News

Support of vTESTstudio requirement/trace item exchange format

TestReport

Link Requirement &TestCase

CANoe.DiVa

CANoeTest Run

Import

Testgenerate

Test results

Test cases

Requirement/ Test Data

Management System

Requirements

21/32

Page 22: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Requirements & Traceability

CANoe.DiVa 10.0 News

https://vector.com/vi_downloadcenter_en.html

22/32

Page 23: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Process related to IBM DOORS classic

CANoe.DiVa 10.0 News

IBM DOORS classic

CANoe.DiVa

DOORS objects (requirements or test specifications)

Object 1 pass

Object 2 pass

Object 3 fail

Object 4 pass

Trace Item Format

Generate executable test unit

CANoe.DiVa XML Report

Import test execution results

Track test coverage from system requirements to test reports

Traceability in CANoe.DiVa can be achieved by either linking requirements or test specifications from DOORS

Test execution results are imported back to DOORS corresponding objects

CANoe

Execute test unit in CANoe

CANoe.DiVaLink test cases to requirements

23/32

Page 24: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Step 1: Export Trace Items from DOORS

CANoe.DiVa 10.0 News

Export objects from a DOORS module by a plug-in into trace item exchange file

Objects can be system requirements or test specification

Trace items are structured in hierarchical folders based on hierarchy in DOORS module

IBM DOORS classic

Export trace items exchange file

24/32

Page 25: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Step 2: Import Trace Items into CANoe.DiVa Project

CANoe.DiVa 10.0 News

Import trace item exchange file

25/32

Page 26: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Step 3: Link Trace Items to Test Results

CANoe.DiVa 10.0 News

26/32

Page 27: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

IBM DOORS classic

Step 4: Import Test Report into DOORS

CANoe.DiVa 10.0 News

Import XML report with trace item links into DOORS

Test execution results are stored as attribute in DOORS objects (requirements or test specifications)

Mapping of test report information to DOORS attributes configurable

Import report file

27/32

Page 28: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Application Testing

CANoe.DiVa 10.0 News

Configure multiple DTC set criteria per DTC

Excel Import/Export of DTC and diagnostic parameter information

Edit DTC or diagnostic parameter attributes in Excel

Copy/Paste and import spec info from existing Excel tables

CANoeDiVa

.xlsx

CANoe.DiVastructure

.xlsx

OEM/Supplier structure

Export

Import

Edit

Copy

28/32

Page 29: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Information

Overview

Features

CANoe.DiVa 10.0 News

Summary

More Information

Agenda

29/32

Page 30: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Benefits

Summary

Significant savings of time and effort

Further quality improvement of the ECU Software

All development stages supported

Excellent test coverage

Efficient, generation-based approach

Automated tests without user interaction

User-defined tests allow tailoring

Widely used by OEMs and suppliers already with a proven record of success

Continuously enhanced features through implementation of customers’ requirements

30/32

Page 31: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

Vector YouTube Channel

More Information

Please find a set of engineering videos at the following link:

https://www.youtube.com/playlist?list=PLLKv-zcGiHJH3Oo6pqVbm36BR97YZH7vo

Currently 11 short videosexplaining individual use casesand related tool features.

31/32

Page 32: CANoe.DiVa: Automated Testing of Diagnostic Protocol ... · data driven diagnostic tests test generation reproducible automated broad and detailed test run documented 4/32. The Tool

© 2013. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.1 | 2015-01-16

Author:Simon Müller, Helmut FrankVector Informatik GmbH

For more information about Vectorand our products please visit

www.vector.com