automotive avb conformance test suite pack...remote server configuration step 1 . ttworkbench...

12
Automotive AVB Conformance Test Suite Pack First Steps User’s Guide General Information This user’s guide helps you to download and install TTworkbench and leads you through configuring and running test cases of the Automotive AVB Conformance Test Suite Pack, hereafter named AVB Test Suites. For a successful proceeding please follow the instructions step by step! If you need assistance, please contact Spirent’s customer care department: Mr. Dirk Borowski Manager Support Services Phone: +49 30 726 19 19 0 Email: [email protected]

Upload: others

Post on 20-Aug-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

General Information

This user’s guide helps you to download and install TTworkbench and leads you through configuring and running test cases of the Automotive AVB Conformance Test Suite Pack, hereafter named AVB Test Suites.

For a successful proceeding please follow the instructions step by step!

If you need assistance, please contact Spirent’s customer care department:

Mr. Dirk Borowski Manager Support Services

Phone: +49 30 726 19 19 0 Email: [email protected]

Page 2: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

2/12

www.spirent.com

Table of Contents

1. Requirements .......................................................................................................................................... 3 1.1. Test Environment and Test Suites .................................................................................................................... 3 1.2. Hardware and Software Requirements ............................................................................................................. 3

2. Get TTworkbench and AVB Test Suites .................................................................................................. 3 3. Installation ............................................................................................................................................... 4

3.1. TTworkbench ..................................................................................................................................................... 4 3.2. AVB Test Suites ................................................................................................................................................ 4 3.3. Import AVB Test Suites ..................................................................................................................................... 5

4. Remote Server Configuration .................................................................................................................. 6 5. Load Test Campaign and Configuration .................................................................................................. 7

5.1 Parameter View ................................................................................................................................................. 7

6. Running Test Cases ................................................................................................................................ 9 6.1. Analysis ............................................................................................................................................................. 9 6.2. Saving Configurations and Test Results ......................................................................................................... 10

7. Details (for Development) ...................................................................................................................... 10 7.1. Core Language Editor (CL Editor) ................................................................................................................... 10 7.2. TTthree (TTCN-3 Compiler) ............................................................................................................................ 11

8. Related Documentation ......................................................................................................................... 12 9. Appendix ............................................................................................................................................... 12

Page 3: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

3/12

www.spirent.com

1. Requirements

1.1. Test Environment and Test Suites

TTworkbench is the TTCN-3 execution platform needed to run the AVB Test Suites.

System Requirements

Operating Systems: Microsoft Windows 7/8/10

Linux (GTK2, x86-32, x86-64)

Java 2 Platform: 64bit version. Please refer to the following Spirent Knowledge Base article FAQ17885.

Memory: 2 GB (8 GB recommended)

1.2. Hardware and Software Requirements

• Spirent C50 including Spirent TestCenter 64 bit: Refer to the Spirent TestCenter documentation.

• TTworkbench Test Package: Refer to the TTworkbench on C1/C50 First Steps User's Guide.

• Wireshark 64bit version should be downloaded (www.wireshark.org) and installed on your computer. Please install Npcap in WinPcap API-compatible mode (refer to the following article FAQ18909). In addition, a special pcap DLL is required for TSN conformance testing (refer to FAQ18875 / Log-in required).

2. Get TTworkbench and AVB Test Suites Please use Spirent’s Customer Service Center at https://support.spirent.com.

Step 1 In case you are not registered yet, go to https://support.spirent.com/CSC/register and fill in the registration form. The support team will check your data and notify you about your approval.

Step 2 Login at Spirent’s CSC and click on the download app tab on the left side.

Step 3 Select the product line TTworkbench and filter for categories and operating system. Download the purchased TTworkbench version.

Step 4 Select the release type Controlled Release, the Product Line TTworkbench and the Category TTsuite for TTworkbench. Download the AVB Test Suites installer.

Page 4: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

4/12

www.spirent.com

3. Installation

3.1. TTworkbench

Step 1 Windows Platform:

Double click on TTworkbench-xxx-installer.exe (to be found on desktop or selected directory).

Linux Platform:

Use command line java -jar TTworkbench-xxx-installer.jar.

Step 2 Follow the pop up installation wizard…

Manually choose license server (Manual configuration), input the Spirent C50 IP address in the License server name or IP address field and choose License server on C1/C50 Port configuration.

In case of using a Spirent C1 device, input the license server name or IP address and choose the Automatic Port configuration as the license server should be running on a local machine (not on the C1 device).

(AVB Test Suites and TTworkbench require a valid license file for execution.)

Step 3 Follow the pop up installation wizard and finish the installation.

3.2. AVB Test Suites

Step 4 Start the AVB Test Suites installer.

Windows Platform:

Double click on

AVB Test Suites-ReleaseBundle_xxx-installer.exe

(to be found on desktop or selected directory).

Linux Platform:

Use command line

java -jar AVB Test Suites-ReleaseBundle_xxx-installer.jar

Page 5: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

5/12

www.spirent.com

Step 5 Accept the terms of license agreements, click Next.

Step 6 Select the TTworkbench installation folder, click Next and finish the installation.

3.3. Import AVB Test Suites

Step 7 Start TTworkbench from created desktop icon or menu entry.

Select or create a new workspace.

Step 8 Close the TTworkbench welcome tab.

In the project view, click on the right mouse button, go to menu File → Import → TTCN-3 → TTCN-3 Test Solution Projects → Next.

Step 9 Select the installed test suite projects and click on Finish.

Further details about installation you can find in the integrated User’s Guide.

Click on Help → Help Contents → Spirent TTworkbench User's Guide.

Page 6: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

6/12

www.spirent.com

4. Remote Server Configuration

Step 1 TTworkbench enables the use of remote execution of the test suite on device connected to the same network of the Spirent C50.

In order to run the test suite remotely, the remote server has to be configured.

In the TTworkbench main menu bar, click on Window → Preferences.

Step 2

Navigate to TTCN-3 → Execution - TTman → Engine.

On the Engine tab click on Add Server, enter the IP address of the device (C50) in the Server Address field and select Use C1/C50 ports.

Step 3 Select the configured TTman Server from the Server list. The Web Admin port enables you to access the server from a web interface for additional settings.

After having set the parameters click on Check to see if the connection was established.

The question mark should turn into a green check sign with a “successful” message.

More information can be found in the TTworkbench on C1/C50 First Steps User's Guide.

Page 7: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

7/12

www.spirent.com

5. Load Test Campaign and Configuration Please configure your AVB Test Suites according to your local settings. You can use our MBS (Message Building System) to ease it up.

For further details about Test Suite Parameters, please refer to the integrated user’s guides. Click on Help → Help Contents → Using Automotive AVB Test Solutions.

5.1 Parameter View

In the Parameter View of the Execution Management you find different parameters to change the settings for your individual test configuration.

Step 1 Open the TTsuite-AVB-xxx folder in the Package Explorer (TTCN-3 Development Perspective).

Step 2 In the clf folder, double click on the test campaign loader file xxx.clf (with the icon ).

The perspective will automatically switch into the TTCN-3 Execution Management.

Here is an example test case Avb_Automotive_802_1AS_Testcases.clf:

The Parameters window enables you to configure the parameters specific to Device Under Test (DUT) as well as the Test System (TS). The module parameters allow a quick repetition of test cases with different values. All the parameters have a short description that explains their function.

The configuration parameters in the DUT Parameters contain the hardware address and communication ports of the DUT and have to be retrieved from it. The characteristic parameters are specific to some features that the DUT may or may not have, which will enable or disable some related test cases. Make sure to check the availability of these features on your device and set these parameters accordingly before you launch the test campaign.

Page 8: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

8/12

www.spirent.com

The TS parameters require only the names of the interfaces that are used for the testing and their corresponding ports. The timers can also be customized to suit the user’s needs.

You can click on the right button over the parameters view to use the Message Building System dialog.

You can access the single parameter and the attributes of single fields in the dialog.

When finished, just click on OK to save the change. The changed parameters are called by the test system during runtime. You can run your test campaign with the new configuration at once without recompilation of your test cases.

Page 9: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

9/12

www.spirent.com

6. Running Test Cases For test execution, double click on one test case or select one test case by single click and press the Execute tests button ( ).

For more configuration details, please refer to the Automotive AVB Test Suites integrated user’s guides. Click on Help → Help Contents → Using Automotive AVB Test Solutions.

6.1. Analysis

After execution, click on the TTCN-3 Graphical Logging tab. It shows the results of the execution as a graphical output.

A single click on a send or receive message arrow provides further details of the TTCN-3 template representation in the Test Data View, which you see the received message compared to the expected TTCN-3 template.

Mismatched values are marked red.

Double click on send or receive arrows for the raw messages in the Dump View.

Result Analyzer

Graphical Online Logging

Management View

Test Parametrization

Page 10: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

10/12

www.spirent.com

6.2. Saving Configurations and Test Results

The current executed run of test cases can be saved in a *.tlz file by pressing the export button and selecting Export Log in the Management View.

The generated *.tlz file (with the icon ) contains the current configuration (CLF) and the executed log traces.

For reviewing, this file can be imported by pressing the import button and selecting Import Log.

In order to generate a test report, use this button.

Further details about execution and savings you can find in the integrated Users Guide, Chapter Using TTworkbench TTman. Click on Help → Help Contents → Spirent TTworkbench User's Guide.

7. Details (for Development)

7.1. Core Language Editor (CL Editor)

Each TTCN-3 file is view- and editable by double clicking in the CL Editor. As shown in Step 1 of 4. Running My First Test Case you find the TTCN-3 source code (*.ttcn3) in folder ttcn3.

After opening the files, the source code will be syntactically checked and highlighted. In addition, an outline will be generated automatically and the go-to-declaration feature will be enabled.

TTCN-3 Compiler/ Validate Buttons

Project View TTCN-3 Core

Language Editor

Outline

Page 11: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

11/12

www.spirent.com

7.2. TTthree (TTCN-3 Compiler)

For recompiling all TTCN-3 files, please open the main module (with the icon ) in the CL Editor by double click. Press the Rebuild button .

Please note! Compilation is only necessary if some test cases are changed or some new one is created. Otherwise, the generated *.jar files from TTCN-3 source are already available for execution.

Page 12: Automotive AVB Conformance Test Suite Pack...Remote Server Configuration Step 1 . TTworkbench enables the use of remote execution of the test suite on device connected to the same

Spirent Automotive AVB Conformance Test Suite Pack First Steps User’s Guide

About Spirent Communications

Spirent Communications (LSE: SPT) is a global leader with deep expertise and decades of experience in testing, assurance, analytics and security, serving developers, service providers, and enterprise networks.

We help bring clarity to increasingly complex technological and business challenges.

Spirent’s customers have made a promise to their customers to deliver superior performance. Spirent assures that those promises are fulfilled.

For more information, visit: www.spirent.com

Contact Us For more information, call your Spirent sales representative or visit us on the web at www.spirent.com/ContactSpirent. www.spirent.com © 2019 Spirent Communications, Inc. All of the company names and/or brand names and/or product names and/or logos referred to in this document, in particular the name “Spirent” and its logo device, are either registered trademarks or trademarks pending registration in accordance with relevant national laws. All rights reserved. Specifications subject to change without notice.

Americas 1-800-SPIRENT +1-800-774-7368 | [email protected]

US Government & Defense [email protected] | spirentfederal.com

Europe and the Middle East +44 (0) 1293 767979 | [email protected]

Asia and the Pacific +86-10-8518-2539 | [email protected]

Rev 20191022 | 12/12

8. Related Documentation In order to use the Automotive AVB Test Suites efficiently, you should be familiar with Avnu Alliance Automotive AVB Test Specifications, TTCN-3 and Spirent C50.

For additional resources refer to the following documentation:

• TTworkbench on C1/C50, First Steps User's Guide

• AVB Test Suites integrated User’s Guides Help → Help Contents → Using Automotive AVB Test Solutions

• TTworkbench integrated User’s Guide Help → Help Contents → Spirent TTworkbench User's Guide

• T3Doc of Automotive AVB Test Suites Help → Help Contents → Using Automotive AVB Test Solutions → Chapter 8. T3Doc of Automotive AVB Test Solution

• Spirent TestCenter documentation

9. Appendix

Acronyms

CL Editor Core Language Editor

CLF Campaign Loader File

MBS Message Building System

OS Operating System

TLZ Test Logging Zip File

Notes This document is subject to change without notice.

Spirent Communications, Michaelkirchstraße 17/18, 10179 Berlin, Germany

Phone +49 30 726 19 19 0 Fax: +49 30 726 19 19 20

Email: [email protected] Internet: www.spirent.com/ttworkbench