implementation of open tc8 with canoe, vteststudio and vt … · 2019-05-13 · implementation of...

Implementation of OPEN TC8 with CANoe, vTESTstudio and VT System Version 1.0 2019-04-18 Application Note AN-IND-1-022

Author Vector Informatik GmbH Restrictions Public Document Abstract This document provides assistance in the practical implementation and application of

conformity testing of Automotive Ethernet ECUs as defined in the OPEN Alliance (One Pair Ethernet Alliance special interest group). The document shows how the tests can be set up with the help of CANoe .Ethernet, vTESTstudio and VT System and carried out largely automatically.

Table of Contents 1 Introduction ................................................................................................................................... 2

1.1 What Is Meant by the OPEN Alliance and the TC8 Test? ................................................... 2 1.1.1 Definition of the TC8 Test .................................................................................................... 2 1.1.2 Preparing the DUT ............................................................................................................... 2 1.2 Where to Get the Documents .............................................................................................. 2

2 Finding a Solution with Vector Tools .......................................................................................... 2 2.1 Overview .............................................................................................................................. 2 2.2 Tasks in vTESTstudio .......................................................................................................... 4 2.2.1 Definition of the Test Procedure .......................................................................................... 4 2.2.2 Test Configuration ................................................................................................................ 4 2.2.3 Stub Functions ..................................................................................................................... 5 2.3 Tasks in CANoe ................................................................................................................... 6 2.3.1 Runtime Environment .......................................................................................................... 6 2.3.2 Test Report .......................................................................................................................... 6 2.3.3 Simulated DUT As a Reference Implementation ................................................................. 7 2.4 Integrating the VT System ................................................................................................... 7

3 Practical Implementation Proposal with VN Ethernet Interface ............................................... 8 3.1 Overview .............................................................................................................................. 8 3.2 Restrictions/Notes ................................................................................................................ 9 3.3 Required Components ......................................................................................................... 9

4 Contacts ......................................................................................................................................... 9

Implementation of OPEN TC8 with CANoe, vTESTstudio and VT System

Copyright © 2019 - Vector Informatik GmbH 2 Contact information: www.vector.com or +49-711-80 670-0

1 Introduction

1.1 What Is Meant by the OPEN Alliance and the TC8 Test? The One Pair Ethernet Alliance special interest group (OPEN Alliance) plays an important role in the standardization of Automotive Ethernet. Many automotive OEMs, TIER1, and other suppliers and chip manufacturers are members of this group. Many technical committees of the OPEN Alliance prepare documents which should ensure the interoperability and compatibility of Automotive Ethernet. The technical committee 8 (TC8) "Automotive Ethernet ECU Test Specification" draw up documents which should ensure the interoperability and conformity with the existing ECU standards.

1.1.1 Definition of the TC8 Test The individual TC8 tests are based on the ISO/OSI layer model (Open Systems Interconnection Model) and can be assigned to individual layers. The tests include all layers from the layer 1 (bit transmission layer) to the layer 7 (application layer). A detailed list of all 850+ test cases and supported communication protocols can be found in [1].

1.1.2 Preparing the DUT To perform the TC8 tests, you must prepare the DUT (Device Under Test). This includes the ability to ensure a defined behavior of the DUT, depending on the test case. For example, it must be possible to delete the ARP tables to test the ARP protocol (Address Resolution Protocol) required for the IP communication. This functionality is usually not explicitly available on an ECU.

These settings can be made manually, for example via a debugger. In addition, the TC8 test specification refers to mechanisms, such as AUTOSAR testability protocol defined in [2]. These mechanisms can be used to make settings relevant for the TC8 test via an Ethernet communication. CANoe supports both options during test execution.

1.2 Where to Get the Documents You can freely download the OPEN Alliance documents from the homepage (www.OPENSIG.org) or via the members portal (https://members.opensig.org). The AUTOSAR documents are also freely available at (https://www.autosar.org). You cannot obtain them via Vector. To successfully implement and perform the TC8 tests, you must understand the contents of the following documents:

> [1] OPEN Alliance Automotive Ethernet ECU Test Specification TC8 ECU Test, version 2.0 > [2] Testability protocol and service primitives, version 1.2.0

2 Finding a Solution with Vector Tools

2.1 Overview With the CANoe .Ethernet option from version 12.0, Vector provides the TC8 ECU tests as a sample configuration. Figure 1 shows the interaction of the tools using a Vector standard Ethernet interface.

http://www.opensig.org/

https://members.opensig.org/

https://www.autosar.org/



Figure 1 - Tool chain to perform the TC8 tests on the basis of vTESTstudio and CANoe

Figure 2 shows an example of how the use of the VT System can increase the automation degree of the test execution. In addition, the use of the VT System allows you to extend the test coverage to the physical layer.

Figure 2 - Tool chain to automatically perform the TC8 tests on the basis of vTESTstudio, CANoe and VT System.



2.2 Tasks in vTESTstudio

2.2.1 Definition of the Test Procedure In vTESTstudio, all implemented TC8 tests and the test procedure are clearly represented (see Figure 3). If required, you can modify the TC8 tests and the procedure here. However, this is generally not necessary. The vTESTstudio is used to generate test units which are later executed in CANoe.

Figure 3 - Test procedure definition in vTESTstudio using the ARP tests as an example

2.2.2 Test Configuration To successfully perform the TC8 tests, certain settings must be made. Incorrect configuration of settings may falsify the test results or make a successful execution of the TC8 tests impossible.

The TC8 tests in the vTESTstudio are designed such that they must be configured only at a few defined points. For this, two parameter files are located in each test group (e.g. ARP, ICMP, IPv4, …):

> the global parameter file "GeneralTestParameters.vparam" and a > parameter file with specific settings for the test group to be executed.

The global parameter file contains general settings for the DUT, such as its IP address or MAC address (see Figure 4). The file exists once and is referenced in all test cases. The specific parameter file contains settings for the selected test group. For example, all parameters of the ARP tests (Address Resolution Protocol) are described in the "ArpParameters.vparam" file (see Figure 5).

Figure 4 - vTESTstudio parameter file "GeneralTestParameter.vparam" to configure general settings of the DUT



Figure 5 - Example of a vTESTstudio parameter file "ArpParameters.vparam" to configure specific ARP test parameters

2.2.3 Stub Functions In addition to the configuration by means of parameters, as described in chapter 2.2.2, other options for adjusting the TC8 tests are also available. These are the stub functions. The stub functions are typically a CAPL code block which is executed in CANoe during the TC8 test and which usually has an equivalent on the DUT in the form of a special test code. The stub function serves to prepare the DUT to the upcoming test. Figure 6 shows an example using the Address Resolution Protocol test (ARP) where the stub function for deleting the MAC address table must be called before executing the test in CANoe. The stub function must ensure that after calling in CANoe, the table with the MAC addresses on the DUT is completely deleted.

The implementation of the TC8 tests in vTESTstudio defines a separate stub function for all required test steps. It must be generally adjusted to the corresponding DUT before test execution.

Figure 6 - Example of a stub function for deleting the ARP table on the DUT

The implementation of the stub functions is partially based on the use of the AUTOSAR testability protocol – a communication protocol specified by AUTOSAR. This communication protocol is already



supported by the Vector TC8 test implementation. In this case, only individual parameters need to be modified when adjusting the stub functions.

2.3 Tasks in CANoe

2.3.1 Runtime Environment CANoe provides the runtime environment for the TC8 tests created with vTESTstudio. In CANoe, you can select the tests to be executed and start the test procedure. The vTESTstudio is not required if you only want to run the tests.

2.3.1.1 Which CANoe Is Required?

To execute the TC8 test, any CANoe .Ethernet (pro, pex, fun and run) from version 12.0 can be used.

2.3.1.2 Which Ethernet Interface Can Be Used?

Basically, any Vector Ethernet interface which supports IEEE 100BASE-T1 can be used. CANoe has no special requirements. The functional range of the Ethernet interfaces varies; this may affect the tests to be executed. The VT6306, for example allows you to execute some test for the physical layer. Most TC8 tests can be executed with one or two Ethernet channels. Some tests, for example the switch tests require three channels.

2.3.1.3 Which Configuration Is Provided by Vector?

All TC8 test configurations provided within the scope of CANoe are implementation proposals and serve to demonstrate the functionality. Moreover, further configurations can be downloaded via the Vector Knowledge Base. Note that the number and scope of the configurations may change over time and that the demonstration and sample programs show only certain aspects of the software. Since these programs are only intended for demonstration purposes, the warranty/liability of Vector Informatik GmbH for slight negligence is excluded unless liability is expressly stipulated by law.

2.3.2 Test Report

2.3.2.4 Creation and Representation

CANoe automatically creates an extensive HTML test report which records the contents of the performed tests and the results (see Figure 7).

Figure 7 - Summary of the results

For each test step, the report also contains a detailed summary of the procedure and contents (see Figure 8). This information allows you to identify problems with test execution or test configuration very quickly. In particular, the specified time stamps can be used to jump directly into the Trace Window to analyze the communication.



Figure 8 - Test report extract from CANoe with time stamp

2.3.3 Simulated DUT As a Reference Implementation

2.3.3.5 Goal of the Reference Implementation

The configuration of the TC8 test cases and the assessment of the found problems are complex processes and requires some practice. To support the users, Vector provides the "Golden device" as a reference implementation of the DUT within a CANoe simulation. It is used to enable you to perform error-free TC8 tests on the simulated Golden device and create a positive test result, logging files, etc. The result based on the Golden device can be used as a reference for the assessment of the result on the basis of the DUT. In case of an error, a direct comparison helps you decide whether the configuration of the TC8 test or the DUT causes the error.

2.4 Integrating the VT System The VT System can basically be used to execute tests analogously to a PC with CANoe. The VT System offers a wide range of options for automatic test execution. As shown in Figure 2, various plug-in cards allow you to influence the physical ports of the DUT. The control of the supply voltage can be used to implement, for example the reset of the DUT. The Ethernet interface card VT6306 allows you to influence the physical transmission channel. This allows you to implement test cases for the physical layer very easily, for example to determine the time of the link building after a start of a control unit.



Figure 9 - Options for influencing the physical transmission channel of the VT6306 Ethernet interface

3 Practical Implementation Proposal with VN Ethernet Interface

3.1 Overview To perform the OPEN TC8 test of the ISO/OSI layers from two to seven, one (1) sample configuration is available in the CANoe .Ethernet. It is located under

> File – Sample Configurations – Ethernet - Testing – TC8Test (Ethernet).

Once the test units have been adjusted to your DUT (see 2.2.2 and 2.2.3), the tests can be performed. The test setup is identical to the setup shown in Figure 1.



3.2 Restrictions/Notes Table 1 contains a list of the TC8 test groups included in the configuration.

ISO/OS Layer TC8 Test Group State CANoe .Ethernet Version 12.0 2 TC8 Switch Tests available for evaluation 2 ARP available 3 ICMPv4 available 3 IPv4 available 3 Dynamic IPv4 Link Local Address available for evaluation 4 UDP available 4 TCP available 7 DHCPv4 available 7 SOME/IP Server available 7 SOME/IP ETS not implemented

Table 1 – TC8 tests available in the CANoe .Ethernet VN sample configuration

The number of available Ethernet channels can restrict the execution of the switch tests. The capacity limit of the test system can also be reached when performing full-load tests.

3.3 Required Components > 1 x CANoe .Ethernet from version 12.0

If only TC8 tests are to be executed, a RUN or PEX variant can be used. > 1 x vTESTstudio from version 3.0 SP3

Independently of the number of test stations, only one (1) vTESTstudio is required for configuration.

> 1 x Ethernet interface: VN5610, VN5610A or VN5640

4 Contacts For a full list with all Vector locations and addresses worldwide, please visit http://vector.com/contact/.

http://vector.com/contact/