fleet logging solutions · 2019-07-26 · fleet logging solutions. 2 ... data management: >...

71
V0.1 | 2019-07-17 Mohamad Sah Fleet Logging Solutions

Upload: others

Post on 22-Jun-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

V0.1 | 2019-07-17

Mohamad Sah

Fleet Logging Solutions

Page 2: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

2

Introduction

Different Data Sources

> Environment Data : Physical values from sensors like temperature, voltage etc.

> Vehicle CAN (Multiple CAN bus)

> ECU Internal Signals (CCP/XCP)

> GPS

> CAMERA

Distributed Fleet

Challenges

Page 3: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

3

Introduction

Solution Approach

CAN

CAN

XCPonEthernet

vSignalyzer/CANape

for Analysis

vLogger Cloud

ML Server

vMDM Cloud

vMDM Enterprise

Page 4: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

4

Introduction

Components

CSM Modules CAN- and EtherCAT®-based measurement modules

Measurement of:

> Temperature (thermo-elements, RTD*)

> Voltage (pressure, acceleration etc.)

> Mechanical strain

> Speed (RPM, PWM, event counting etc.)

Loggers Compact Fleet of GL Logger Family

Handy fleet logger for 2/4/8 CAN Channels

Wireless data exchange via 3G/UMTS

High storage capacities on CF card

Possibility to connect SSD or external USB hard disk

All loggers also have IP65 waterproof variant

Page 5: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

5

vMDM

Data management:> Centralized, secured storage of large amounts of files

> Organization of stored data into data catalogues, so called collections

> Management of access rights for users and groups

> Searching and filtering of files, based on flexible, user defined criteria

> Download of files for use in desktop tools

Data analysis:> User defined pre-processing of uploaded data

> Automated analysis of signal- and meta data

> Creation of meaningful reports

Components

Introduction

Page 6: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

V3.6.1 | 2019-02-20

Highlights of GL1000, GL2000, GL3000, GL4000 and GL5000

GL Logger Family – The Professional Data Loggers

Page 7: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

7

Introduction

Versatility

Tool Chain

Data Analysis

Additional Data Sources

Remote Access

Other Use Cases

vMDM Solution Overview

vMDM in the Vector Cloud

vMDM in the Data Center

Use Cases

vMDM Concepts

vSignalyzer

vSignalyzer Introduction

Agenda

Page 8: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

8

GL Family Approach

Versatility

GL1000 Family

2 CAN, 2 LIN and I/Os

GL1010 as waterproof IP65 variant

Very compact housing

GL2000 Family

NEW: GL2400 with 4 CAN FD

4 CAN, 2 LIN and I/Os

Wireless data transfer via 4G

GL2010 as waterproof IP65 variant

GL3000/GL4000 Family

9 CAN, 2 LIN, 2 FlexRay, 1 MOST150 and I/Os

2 independent logging memories for separate configuration

High storage capacities on CF card, SSD

Wireless data transfer via Wi-Fi, 4G

GL5000 Family !! NEW !!

Up to 24 CAN, thereof up to 12 CAN FD, 6 LIN, 2 FlexRay, 1 MOST150 and I/Os

2 independent logging memories for separate configuration

High storage capacities on SSD

Wireless data transfer via Wi-Fi, 4G

Page 9: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

9

Various Data Sources: Vehicle Networks & ECU Access

Versatility

Vehicle Diagnostics:

Access to series ECUs

ECU identification data, measurement values & fault memory (DTCs)

UDS, KWP2000, OBD II

KWP2000UDS

ODXPDX

Diag Req

Diag Resp

Vehicle Networks:

Access to ECU communication

Messages & signals in vehicle

CAN (FD), LIN, FlexRay, MOST

FlexRay

LIN DBCLDF

FIBEX

CAN (FD)

CCP/XCP:

Development access to ECU

Firmware variables

Measured signals

On CAN, FlexRay, Ethernet

VX module & POD

DAQ or polling mode

Seed & Key

DAQ

Polling

A2L

PODVX

Various ECU Ports:

Proprietary debug ports of ECUs

RS232

Ethernet

Page 10: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

10

Various Data Sources: Vehicle Environment & Operator Input

Versatility

Camera:

Capture environment visually

Actions of driver or instruments, outside environment

Configurable resolution, compressed images, …

Physical Measurement:

Access to ECU environment

Analog measurements

Temperatures, pressure, voltage, …

CSM Measurement modules over CAN or Ethernet

GPS:

Register vehicle location synchronously to measurement

Various Accessories:

Easy operation by test drivers

Remote control, display

Voice recording

Web-Display

Page 11: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

11

Introduction

Versatility

Tool Chain

Data Analysis

Additional Data Sources

Remote Access

Other Use Cases

vMDM Solution Overview

vMDM in the Vector Cloud

vMDM in the Data Center

Use Cases

vMDM Concepts

vSignalyzer

vSignalyzer Introduction

Agenda

Page 12: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

12

Vector Logger Configurator

Tool Chain

Easy-to-use graphical configuration program

CAN/CAN FD, LIN, FlexRay, MOST150

Import databases

DBC

LDF

XML

CDD

MDX

ODX

Download configuration COD

Upload logged files

Export logged data

A2L

BLF

ASC

MDF

TXT

MAT

HDF

ADTF

Page 13: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

13

Logging Modes

Tool Chain

Configure the logger with the suitable mode for your logging use case:

1. Permanent long-term logging: Record all data directly after start of the test drive until the end

Test drive

SleepWake-up

time

Marker M1 M1M2 M2M3 M2

Test drive

Start Start StartStop StopStop

time

2. Conditioned long-term logging: Record data between Start and Stop conditions

Test drive

Trigger A Trigger B Trigger A Trigger C

time post-trigger timepre-trigger time

3. Triggered logging: Record data of a trigger event with pre- and post-trigger time

… and use filters for further data reduction → optimal for long-term logging

Marker M1 M2 M3 M2M3 M1

Page 14: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

14

Automatic wake on bus activity or ignition

From sleep: Wake-up time 20-200 ms

From standby: No message lost

Permanent supply of logger from vehicle battery

Bus idle

Enter sleep mode → <1 mA

Enter standby mode → >1 mA but << normal operation

Configure Power Management: Sleep vs. Standby

Tool Chain

VehicleBattery

Ignition

optional

time

Logger On Sleep Logger On

Current

1 mA

last message on bus

timeout to sleep wake-up

wake

CAN

Logger On Standby wake Logger On

Page 15: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

15

Offline Data Analysis

Data Analysis

Logging formats

BLF

ASC

CSV

MDF

IMG

TXT

raw

CANoe, CANalyzer

Comfortable analysis with the Vector tools CANoe/CANalyzer and CANape/vSignalyzer or 3rd party tools

CANape, vSignalyzer

3rd party tools

HDF5

MAT

Raw format

CAN data

GPS position

Camera images

Trigger events

Voice notes

Data Mining

Offline Classifications

ADTF

Page 16: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

16

Introduction

Versatility

Tool Chain

Data Analysis

Additional Data Sources

Remote Access

Other Use Cases

vMDM Solution Overview

vMDM in the Vector Cloud

vMDM in the Data Center

Use Cases

vMDM Concepts

vSignalyzer

vSignalyzer Introduction

Agenda

Page 17: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

17

Diagnostics, OBD II, Trigger on DTC

Additional Data Sources

Gather additional information via diagnostic ECU access

Either with diagnostic description or via OBD II

Trigger on DTC: React to selected error conditions

Download config

Upload log data

CANape, vSignalyzer

CANoe, CANalyzerVector Logger Configurator

Exportformat

CDD

ODXPDX

MDX

UDS KWP2000OBD II

Diag RQ

Diag RS

CAN

Integrated OBD II

Standard

OBD

Page 18: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

18

Vehicle bus: CAN, FlexRay or Ethernet

ECU Measurement via CCP/XCP, optionally with VX Modules and POD

Additional Data Sources

Recording additional internal ECU measurement data via CCP/XCP

XCP on Ethernet allows for a much higher data rate than XCP on CAN buses

VX module and POD: allow to record internal ECU data without load on vehicle buses

Download config COD

Upload log data

SKB

CANape, vSignalyzer

CANoe, CANalyzer

A2L

Vector Logger Configurator

Exportformat

POD

Ethernet

Page 19: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

19

Measurement Technology: Physical Measurement

Additional Data Sources

CSM is Vector’s partner for measurement equipment

CAN or Ethernet based measurement modules for a variety of physical values

Temperature, pressure, strain, voltage, …

Logger can record output of modules

Export values as signals e.g. to MDF

Trigger on analog signal values (limitations may apply)

Logger configures measurement modules remotely

Page 20: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

20

Logger Accessories

Additional Data Sources

Accessories Short description GL1000 GL2000 GL3000 GL4000 GL5000

LINprobeAdditional LIN

channels✓ ✓ ✓ ✓ ✓

CANgpsRecord GPS information

✓ ✓ ✓ ✓ ✓

VoCAN Voice recording and

voice output- ✓ ✓ ✓ ✓

CASM2T3L Voice recording - ✓ ✓ ✓ ✓

HostCAM Record color images - - ✓ ✓ ✓

VX modulesRecord internal

ECU signals- - ✓ ✓ ✓

CSM modules Record sensor data - - ✓ ✓ ✓

Page 21: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

21

Introduction

Versatility

Tool Chain

Data Analysis

Additional Data Sources

Remote Access

Other Use Cases

vMDM Solution Overview

vMDM in the Vector Cloud

vMDM in the Data Center

Use Cases

vMDM Concepts

vSignalyzer

vSignalyzer Introduction

Agenda

Page 22: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

22

Wireless Data Exchange

Remote Access

Upload logging data with automatic conversion to desired format and automatic update of a new configuration

One common solution for Wireless LAN and 4G/LTE with GL3000/GL4000/GL5000

Solution for 4G/LTE also available with GL2000

PC/data server

MLserver

Software

Logdata

Wireless LAN

Download config COD

COD

Logdata

Upload log data

Access Point

4G / LTE

Download config COD

Upload log data

4G Internet

)))(((

)))(((

((( )))

Page 23: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

23

Vector Logger Cloud

Remote Access

Vector Logger Cloud

Data center locations in the following regions:

USA (Buffalo), Germany (Frankfurt), Japan (Tokyo)

Customer-specific data location policy

e.g. Europe only

Operated by certified partners

Page 24: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

24

Information Displays (Web-Display)

Data management and vMDM

And many more …

Action> Transmit messages on events

> Set digital outputs

> LEDs, display and sound on events

Freely programmable via LTL> Complex filter and trigger conditions

> Drive recorder for selected signal information

> Timer and timeouts

> …

Context cameras

J1939

Record debug information (e.g. RS232, Ethernet, …)

Signal oriented recording (LTLgen)> Signals are sampled

> Timeout and value range is monitored

Gateway functionality between CAN buses

More Features at a Glance

Other Use Cases

Page 25: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

25

vMDM is Vector’s solution for the management and analysis of measurement data

Data management:

Centralized, secured storage of large amounts of files

Organization of stored data into data catalogues, so called collections

Management of access rights for users and groups

Searching and filtering of files, based on flexible, user defined criteria

Download of files for use in desktop tools

Data analysis:

User defined pre-processing of uploaded data

Automated analysis of signal- and meta data

Creation of meaningful reports

vMDM in a nutshell

vMDM Solution Overview

Page 26: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

26

vMDM Advantages

vMDM Solution Overview

vMDM is made for automotive engineers

vMDM leverages the power of existing Vector tools like CANape and vSignalyzer

Access data directly in the tools, no need to learn new concepts or GUIs

vMDM takes care of your data

Your data is secured and protected against data loss and unauthorized access

vMDM gives you insight into your data

With powerful search and filters your data is never lost in a huge data lake

Analyze large amounts of data on the server

Visualize and document analysis results with meaningful graphs and diagrams

vMDM empowers teams

vMDM is a multi-user system, deployed either in a private cloud or in the Vector Cloud

Measured data can be made accessible to all project members

Team members can share queries, analysis algorithms and reports

0 1 0 0 1 1 0 0 1 0 0 0 1

1 1 1 0 0 1 1 0 1 1 1 0 1

0 0 0 1 0 1 1 1 0 1 0 1 1

1 0 1 1 0 0 1 1 0 1 1 1 0

1 1 0 0 1 1 0 1 0 0 0 1 1

0 1 0 1 1 0 1 0 1 0 0 0 1

1 1 0 0 1 1 0 1 1 1 0 0 1

Page 27: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

27

Server-based measurement data management and analysis

Multi-user

Vector tools as frontend

Dedicated admin tool

The Vector Measurement Toolchain

vMDM Solution Overview

MDM Use Case CANape vSignalyzer vMeasure vMDM Admin Tool

Other Vector Tools

Measurement data acquisition ⚫ ⚫ ⚫

Interactive analysis ⚫ ⚫

Automated analysis and reports ⚫ ⚫

Administration ⚫

vMDM

Page 28: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

28

Vector Cloud

Operated by certified partners

Worldwide data center locations

Buffalo, Frankfurt, Tokyo

Customer-specific data location policy

e.g. Europe only

Software-as-a-Service

vMDM in the Vector Cloud

Software-as-a-Service

Usage-based business model

Service includes

Installation

Operation and maintenance

End user support

Page 29: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

29

Vector benchmark

“The security of data in the Vector Cloud is equal or higher as in an on-premise deployment.”

Cloud-specific risks are addressed in the Vector Cloud

Access via internet✓ Authentication at the Vector Service Gate

✓ Access only via secure HTTPS

Multiple customers using the same cloud infrastructure✓ Strict separation via Tenant Concept

Hosting and operation by 3rd party✓ Vector only works with certified partners (ISO 27001)

Information Security

vMDM in the Vector Cloud

Page 30: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

30

IT Environment:

VM(s) or physical server with Windows Server 2012R2

Microsoft IIS

High available, redundant (network-) file system for storage of mass data> Alternative: OpenStack Object Store

Access to Active Directory Controller for user authentication

Scalability:

vMDM 1.0: functional distribution to (up to) 3 servers: business logic, MySQL database and index> MySQL and Elastic Search may be deployed on Linux or Windows VM/server

Future:> load distribution of individual functional blocks to support high throughput applications

> Support of Big Data storage systems such as Hadoop HDFS

IT Environment and Scalability

vMDM in the Data Center

Page 31: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

31

vMDM 3-Tier Architecture

vMDM in the Data Center

Business Logic

Microsoft IIS

Relational DB

(MySQL)

Search Engine

(Elastic Search)Meta Data

IndexDB

Measurement Files

Windows Server 2012R2

Windows / Linux Windows / Linux

HTTP(S)

File systemFile system

File system or

OpenStack Object Store

vSignalyzer / CANape

AD ControllerUser Authentication

Page 32: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

32

Use Case – Pattern Detection & Search

Use Cases

Detect patterns in measurement data:

Store detected hits in index:

Search data based on events:

> A gear shift, a kick-down or a detection of a specific object type by an vehicle subsystem

> Detected using CANape data mining analysis methods (CASL, ML/SL models or C-DLL)

> Each detected event results in a Data Mining 'hit'

> Engineers can search for measurements based on indexed event data

“Give me all detected emergency break situations at speed 40 … 45 km/h”

> The hits allow an analysis of the affected vehicle types or the specific driving situation leading to the hit

> Run pattern detection on each incoming file in pre-processing

> Detected patterns are added as events to vMDM index, e.g.

> Event type (“Emergency break situation”),

> Timestamp (“02:32:21.3s”)

> Any additional data (“speed = 43 km/h, GPS position = …”)

Page 33: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

33

Data Management:

Data Quality Assurance:

Data Enhancement:

Automated Analysis:

Reporting:

Use Case – Endurance Testing

Use Cases

> Manage continuous streams of incoming data from a logger fleet

> Collect meta data from customer's fleet management database

> Combine multiple measurement files to single measurement

> Various reports to assess long and short term behavior of individual test vehicles, a selected subset or even the complete test fleet

> Manual analysis of individual driving situations (e.g. low quality gear shift events)

> Detect and count gear shift events, calculate drivability ratings

> Find anomalies in historical data

> Add meta data from diagnostic log files

> Extract metrics to compute KPIs for the test campaign

> Detect corrupt / incomplete data

Page 34: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

34

Data Management:

Data Enhancement:

Automated Analysis:

Reporting:

Use Case – Component Testing

Use Cases

> Store measurement files generated at one or several test stands

> Combine several measurements from the same unit under test into a single report

> Document production quality by comparing measurements from different component samples

> Document material fatigue characteristics by analyzing long term measurements

> Calculate FFT and add to measurement file

> Calculate temperature classification and add to meta data

> Identify inconsistent measurement data

> Add meta data describing test configuration from test management system

> Extract measurement equipment serial number information from measured CAN signal

Page 35: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

35

vMDM Functional Architecture

vMDM Concepts

Reporting

User Mgmt.

Index

Measurement Data

Pre-Processing

?

Data Mining

MDF

Page 36: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

36

Measurement files are organized in so called collections:

Users may have read and/or write access to one or more collections

Collection access is managed by the collection admin

Collections

vMDM Concepts

Manage collection permissions in the vMDM Admin ToolMeasurement data is organized in collections

MDF

MDF

MDF

Page 37: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

37

System Administrator

The system admin manages system wide vMDM aspects such as administration role assignment or recovery of deleted files and collections

Collection Administrator

A user who manages a collection

Administration Roles

vMDM Concepts

vMDM UsersMeasurement

Data

Collection Admin

SystemAdmin

Collection Admin

Page 38: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

38

vMDM indexes your measurement data based on a collection-specific indexing scheme > The collection admin can define the indexing scheme using an easy to use tool with graphical user interface

> No adaptation of the software or the layout of an SQL database scheme required like for other tools

The result is a set of meta data properties which describe each measurement file, for example:

> Measurement start time

> Comment

> File name

> Measurement module serial number

> ECU SW & data revision

> Vehicle identification number

> Component variant codes

> ...

Properties are used to search and filter measurement files in vMDM> Measurements are solely organized in terms of collections and properties

> This allows to create flexible data views, not limited by a static directory hierarchy

Data Indexing

vMDM Concepts

Define a collection’s indexing scheme

Page 39: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

39

Queries> Although working with filters is easy in vMDM, you want to avoid to do repetitive work

> Therefore vMDM allows to store search & filter conditions for later re-use as so called queries

> Queries can be private, shared with the project team or even global for all vMDM users

Full text search> Explore measurement data in the most

intuitive way using full text search

Property-based filters> If you need more control over your search

vMDM allows to filter search result based on property values:

“all files from last 24 hours where max. oil pressure was > 3.4 bar2

> An easy to use graphical user interface helps to create powerful filters with few mouse clicks

Data Searching and Filtering

vMDM Concepts

vMDM property filters in vSignalyzer

Page 40: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

40

vMDM offers several ways to initiate an upload of one or several measurement files> Once an upload is initiated vMDM will manage the upload task in the background

> If an upload is interrupted due to network disconnection or restart of the computer it will be resumed automatically when vMDM is online again

> Ongoing and completed uploads can be viewed from the vMDM icon in the Windows taskbar

From the Windows File Explorer> Right click on some MDF files and select a target collection from the vMDM submenu

From CANape / vMeasure> Simply configure the recorder(s) of your measurement configuration to upload to a vMDM collection

Using the vMDM command line tool> Upload files from batch scripts

> For integration of tools which do not yet support direct connection with vMDM

Upload Data to vMDM

vMDM Concepts

Page 41: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

41

vMDM Pre- and Post-Processing

vMDM Concepts

Pre-Processing Data Storage Post-Processing

Reports

Data Mining

Index

Measurement Data

MDF

MDF

Offline Measurement

sig = f(a,b)

Metrics Calculation

Tmax = 98°

Meta Data Generation

VIN : a30z

Detect Signal Patterns

max(y) > 8

Pre-processing: executed once for every file

Post-processing: executed for each analysis, results are stored in vMDM

Page 42: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

42

Each file which is uploaded to vMDM runs through a so called pre-processing on the vMDM server

During pre-processing a number of tasks are executed:

Custom pre-processing> Defined per collection by the collection admin

> Processes the signal and meta data of original measurement file

> Updates the original file with processing results (signal and/or meta data)

> See also next slide

Standard pre-processing> Optimizes the MDF file for faster analysis*

> Extracts the MDF meta data properties from the file and adds them to the collection’s index

Data calculated during pre-processing can be used to perform fast data analysis on a variable, large set of files

* MDF sorting and creation of sample reduction data as defined by the ASAM standard

Data Pre-Processing

vMDM Concepts

Page 43: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

43

Extract information about the measurement or its environment from the data and store it as new meta data property

> Distance of a test drive, e.g. from an odometer signal

> Vehicle Identification Number, e.g. from a diagnostic signal

Add information from external systems like a test management database> ID of the test track where the measurement has been taken

> Fault memory data from an associated diagnostic log

Calculate key metric figures from the recorded data and store them as new meta data properties> Min/max/avg signal values, classifications

Detect user defined signal patterns and store them as events with time stamp> voltage drop below threshold of an inverter outlet

Perform offline measurement on the recorded data and store the results as new signals> Based on standard function library or user defined functions

> MATLAB/Simulink models

> Own C-DLLs

Custom Pre-Processing

vMDM Concepts

Page 44: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

44

Analyze signal and meta data of a large set of files> Selection of files is based on a vMDM search query

> Query can yield a different set of files for each Data Mining execution

Data Mining execution> Based on schedule (e.g. every day at 02:00)

> On demand

Same set of analysis features as in pre-processing> Standard function library or user defined functions

> MATLAB/Simulink models

> Own C-DLLs

Individual analysis results for each measurement file are aggregated into a report> Classifications, min/max/avg values

> Individual signal diagrams

> List of detected signal patterns / events

Data Mining

vMDM Concepts

Page 45: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

45

Data Analysis - Pre-Processing vs. Post-Processing

vMDM Concepts

Using Pre-Processing Using Post-Processing

Use case

Workflow

Pros

Cons

Standard data analysis algorithms On demand data analysis algorithms

Expensive signal analysis performed once

Good resource usage due to streaming mode

Reports available in few seconds

Dynamic adaptation of analysis algorithms

f(x)

Data Analysis & Aggregation

Increased index size

Only for algorithms with low change frequency

High & bursty processing demand

Long report generation time

Index

Step 1:

File-based data analysis

f(x)

Step 2:

Aggregation

intermediate results

Page 46: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

46

Example – Drivability Report

vMDM Concepts

…ECU SW

Rev.Distance

[km]#of gear

shifts drivability …

2.3.51 145 17 1

2.3.51 201 21 1

2.3.51 79 43 2

2.3.51 32 39 1

2.3.51 167 24 3

2.3.51 145 24 1

2.3.51 201 43 1

… … … …

2.3.53 79 40 3

2.3.53 153 22 2

2.3.53 101 17 1

2.3.53 32 21 2

2.3.53 205 21 1

2.3.53 71 43 2

2.3.53 41 32 1

2.3.53 210 21 2

2.3.53 170 27 2

2.3.53 142 17 1

2.3.53 73 43 3

2.3.53 30 32 1

… … … …

Intermediate analysis results from pre-processing

Query: “ECU SW Rev. = 2.3.51”

Query: “ECU SW Rev. = 2.3.53”

Report generation in post-processing

Page 47: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

47

What is vSignalyzer?

vSignalyzer

vSignalyzer is a professional tool for displaying, evaluating, and documenting measurement data

Recorded signals and bus traces can be visualized

Fast processing and handling of very large measurement files

Pre-defined or user-defined functions can be applied in both manual and automated analysis of one or many measurement files

Powerful tools for printing and reporting are integrated

Page 48: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

48

What is vSignalyzer?

vSignalyzer Introduction

vSignalyzer is a subset of CANape

Page 49: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

49

Use Cases

vSignalyzer

Analyzing measurement files from loggers, test benches, simulations and experimental systems

Searching for specific conditions in bus logging or measurement files

Reducing measurement files to the data the user is focusing on

Complete automated analysis of measurement files including documentation generation

Handling of very large measurement files

Same handling and speed independent of file size (220 kB or 50 GB)

Working and setup of Projects without hourglass interruptions

Converting measurement files to different file formats

Validation of ADAS sensor and camera data

Page 50: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

50

Handling of Large Measurement Files and Virtual File Channels

vSignalyzer is optimized to work with big measurement files

More than 200,000 possible signals, 4 Giga Samples / signal

Fast loading of big files

Calculation of envelope curves in background without waiting times> During calculation it is possible to show signal in graphic window and zoom/out

Direct access to all signals to start windows configuration

Functions for analysis are calculated in the background

Fast redraw of virtual file channels in graphical windows

Benefit

Working with vSignalyzer without waiting times for calculation

vSignalyzer

Page 51: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

51

Setting the Output MDF Format for Imported Measurement Files

vSignalyzer

Import of measurement files using the Vector Import Converter

Selection of MDF version for output including MDF v4.1

vSignalyzer is optimized to work with large measurement files> With MDF version 4.x no maximum file sizes exist anymore

> Handling import of large measurement files without restrictions

Storing of imported files in the preferred MDF version

Benefit

No file size limitations

Conversion in different MDF formats

Page 52: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

52

Export of Measurement Signal Data

vSignalyzer

New conversion functionality for measurement files

Direct access to export of measurement files in context menu of symbol explorer

The “save signals” functionality for all signals in measurement file supports additional file formats

Possible exports format are:> ASCII (*.txt), MATLAB (*.mat)

and Excel (*.XLS)

Benefit

Sharing measurement files in different file formats

Page 53: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

53

Import Converter for Different GPS Logging Formats

vSignalyzer

New converter for importing different GPS formats:

Importing and viewing of GPS data

Conversion in MDF format (up to MDF 4.1)

Support of Vector logging format and NMEA 0183 standard

Benefit

Additional GPS data can be added synchronous to measurement data

Page 54: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

54

Local Color Functions in Graphic Windows

vSignalyzer

To display in graphic windows the z-axis color functions are used

Global color functions to set the same setting in all used windows

Local color functions sets the color only to the selected window> Different use cases in different windows can be shown

Benefit

Better analysis and comparison of signals in different use cases

RPM over Throttle RPM over Speed

Page 55: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

55

Overview

vSignalyzer

vSignalyzer offers a wide range of functions stored in the internal library to analyze measurement data automatically

Users can add functions to the library, written in C or generated with Simulink Coder out of Simulink models for the data mining algorithms

vSignalyzer analyzes many different measurement formats

*CANape / CANgraph

MDF, DAT, BLF,

ASC, CLF, CSV,

ATF, XLG, …

DLLs

Measurementdata Function Library

C-Functions andSimulink-models

vSignalyzer

Page 56: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

56

Analyzing and Reporting

vSignalyzer

vSignalyzer offers the use of a wide range of measurement files:

Simple visualization up to complete automated analyzing and reporting

Creating fast algebraic expressions or use the internal function library

Write your own functions or integrate C Code or Simulink model DLLs

Individual reports created directly in vSignalyzer

Possibility to run complete automated analysis by using scripts

Integrated Data Mining to extend the analysis from single measurement files to many complete automated

Logging formats

BLF

ASC

MDF

IMG

TXT

CLF

Page 57: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

57

Different Ways of Analyzing

vSignalyzer

Automated analysis

Math-Functions

Visualization, Manual Analysis

Create Analysis Use Analysis

No programming

Know How necessary

No programming

Know How necessary

ProgrammingKnow How necessary

CASL*, C-Code, Simulink model

Data Mining

* CASL: Calculation and Scripting Language in CANape, vSignalyzer

Page 58: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

58

Data Mining Workflow

vSignalyzer

Analyze one measurement file in a Graphic Window

Open one measurement file in a Graphic Window

Select the appropriate functions and define the hit

condition

Select amount of measurement files

Start Data Mining

Control hit list report

Analysis completed?

Run the analysis steps over all measurement files

Hit list report allows the convenient manual analysis of the affected files

Page 59: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

59

New Data Mining Scripting Functions

vSignalyzer

Script functions help to get information out of “Data Mining Result files”

Get Number of hits of analysis

Hit properties like HitName, time, FileName, Method, Signals …

Loading of associated measurement file and set global measurement cursor on the time of the hit

Benefit

Create report out of Data Mining result file

Page 60: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

60

Add Same Page Twice with Different Cursor Position in PDF

vSignalyzer

Advanced PDF creation - Add same page twice with different cursor position

One PDF report with different Data Mining hits

Set cursor/difference cursor on important points for report

Benefit

One Data Mining Report for different hits and result files

Data Mining Hit 1 Data Mining Hit 2

Page 61: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

61

Iterative Access to Measurement File Signals

vSignalyzer

Local variable referencing another variable

Assign of signal name by script

Script based search for variable names in measurement file

New datatype “varref”> Additional functions to get signal count and name out of MDF

> Modifiers to detect scalar, array or string

Benefit

Writing scripts without knowing the exact name of signals

Page 62: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

62

Virtual Signals as Placeholder for Not Existing Input Signals

vSignalyzer

Not existing input signals could be replaced by virtual signals

Data Mining did not stop if input signal is missing (lost variables)

Virtual function base class parameter to allow optional arguments

For input signals of functions, Simulink DLLs or algebraic expressions

Lost variables returns zero

Benefit

Calculation even if not all input signals are valid

Page 63: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

63

Source Signals of Data Mining Hits in Symbol Explorer

vSignalyzer

Clicking on a hit in the symbol explorer activates the vertical lines

Activate the visualization of all data mining hits in Graphic Window

Page 64: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

64

Source Signals of Data Mining Hits in Symbol Explorer

vSignalyzer

Data Mining hits and results are shown in Symbol Explorer

Input signals which lead to a hit are shown

Function used for created hit is shown (virtual signals)> Code and conditions when hit was created

> Independent if the same function name uses different code

> Not available for MATLAB/Simulink model DLLs

Drag & drop of the signals in analyzing windows

Loading/replacement of the measurement file automated

Today the function checks

BrakePedal > 42

The hit was created

BrakePedal > 40

Cursor marks position of Hit1

42

40

Page 65: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

65

Adding Video Files as Input for Virtual Measurement Channels

vSignalyzer

Video files as input for virtual measurement channels

Integration of MATLAB/Simulink DLLs with video input

Datamining and automated analyzing of video files

Verification of DLL by replay always the same video file

Benefit

Automated analyzing of videos

Verification of image processing

Page 66: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

66

Signals and Bus Messages in Trace Window

vSignalyzer

vSignalyzer can load offline data traces of bus systems in the Trace Window including the bus description files:

CAN, CAN FD, LIN, FlexRay and Ethernet

The loaded trace is synchronized with all other windows

vSignalyzer can visualize signals and bus messages

Additional tools are part of vSignalyzer to edit/visualize the data description files:

DBC++ Editor for CAN and CAN FD DBC files

LDF Explorer Editor for LIN LDF files

FIBEX Explorer Editor for FIBEX files

AUTOSAR Explorer Editor for FlexRay, CAN und Ethernet ARXML files

Page 67: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

67

CANalyzer/CANoe like Trace Window

vSignalyzer

Improvements to vSignalyzer Trace Window:

Trace Window shows same messages in the same line

Filter mechanism

CANalyzer/CANoe look & feel, optimized for measurement data analysis

Benefit

Big improvement in analyzing bus messages

Page 68: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

68

Loading Offline Traces

vSignalyzer

Bus traces in different file formats can be integrated easily

Load a trace direct in Trace Window

Drag & drop a trace from file explorer into Trace Window

Page 69: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

69

Data Handling

vSignalyzer

All advantages of the Trace Window are available

If a database is loaded the messages are decoded down to the signals

Filters can be set (stop and pass filters by drag & drop)

The global measurement cursor is available and shows directly the message for a specific signal

Page 70: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

70

Data Handling

vSignalyzer

Full support of drag & drop

Drag signals in trace and drop it in measurement windows

Use the print and reporting function to copy actual screen to different documents

Signals and messages can be inserted in different windows directly from symbol explorer

Page 71: Fleet Logging Solutions · 2019-07-26 · Fleet Logging Solutions. 2 ... Data management: > Centralized, secured storage of large amounts of files > Organization of stored data into

71 © 2018. Vector Informatik India Private Limited. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V0.1 | 2019-07-17

Author:Sah, MohamadVector India

For more information about Vectorand our products please visit

www.vector.com