systematic testing of charging communication · 2018-10-13 · check of tcs with negative tcs 10....

17
SYSTEMATIC TESTING OF CHARGING COMMUNICATION 2018 [P3] Systematic Testing of Charging Communication Vector Testing Symposium Stuttgart

Upload: others

Post on 14-Mar-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

SYSTEMATIC TESTING OF CHARGING COMMUNICATION

2018 [P3] Systematic Testing of Charging Communication

Vector Testing Symposium Stuttgart

Page 2: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

1

2

BRIEF INTRODUCTION TO P3

CHALLENGES INTEROPERABILITY AND TESTING

DEVELOPMENT OF CONFORMANCE TESTS4

2

CONTENT

3

Page 3: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication 3

P3 is a global network of innovative and creative experts, serving customers in five industries

ABOUT US

TELECOMMUNICATIONSConsulting, engineering and testing services for the whole telecommunications industry

AUTOMOTIVEConsulting, management support and testing services for the automotive industry

ENERGYInnovative solutions based on a scientific background for energy transition

PUBLIC SECTORA combination of wide range technical know-how and long term management experience

AEROSPACEConsulting, application and implementation services for all major OEMs and their tier 1 suppliers

Page 4: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

42018

Neutrality, innovation and passion define P3 as the standout player.

Our expertise

WHAT WE DO

P3 IS AN INTERNATIONAL CONSULTING COMPANY AND PROVIDES INNOVATIVE ENGINEERING SERVICES

+ Conception and enhancement of technology strategy and new revenue streams

+ Assessment, development and implementation of cutting-edge technology

+ Efficiency programs, quality systems and new business

+ Design and improvement of internal processes

+ Management of company risks andopportunities

+ Structure of business divisions and company reorganization

+ Successful launch management of complex projects

+ Design, conception, modeling, construction, certification

+ Simulation, measurement, testing, performance, documentation

+ Quality and risk management+ Outsourcing and offshoring+ Cybersecurity assessment,

benchmarking and design

CONSULTINGSERVICES

ENGINEERINGSOLUTIONS

MANAGEMENTSUPPORT

[P3] Systematic Testing of Charging Communication

Page 5: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

1

2

BRIEF INTRODUCTION TO P3

CHALLENGES INTEROPERABILITY AND TESTING

DEVELOPMENT OF CONFORMANCE TESTS4

5

CONTENT

3

Page 6: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

Worldwide charging test drives show that about 20 % of all charging attempts failed. Most issues where introduced by infrastructure.

Abnormalities/Violation of the standard but charging possible

Car

Grid

Charger

10%

70%

20%

▪ CP-signal voltage to high▪ PWM-frequency not within standard req.▪ Charging station stops at random point

▪ Information to the customer not correct

▪ Voltage out of bound (+/- 10%)▪ Harmonics larger than allowed in the

standard

Charge Cancel/Charging not possible

Charger

Grid

Car

3%

90%

7%

▪ Defect on charger ▪ No CP signal from charging station▪ Authentication not possible (backend not connect)▪ Wrong parameters in messages▪ Voltage out of bound

▪ Invalid / wrong processing of optional parameters

▪ Voltage drop under load (up to 30 V)

Cause Percentage Example

Cause Percentage Example

Result charging tests

„One in five charging attemped had issues“

Chargingok

60 %

20 %

20 %

>1.8

00

ch

argi

ng

test

s

Charging possible / violations of the standard

Charging not possible

Quelle: P3

[P3] Systematic Testing of Charging Communication

CHALLENGES INTEROPERABILITY AND TESTING

2018 6

Page 7: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication 7

Challenges

CHARGING CONFORMANCE TESTING FOR ELECTRIC VEHICLES

Goal

Approach

▪ Development of test cases for easy integration in development process of the electric vehicle

▪ Test cases need to be easily adaptable

▪ Test cases need to work on all levels in the V-model

▪ High quality of tests for easy use by non-experts

scalability of testing in the field

▪ Agile Development of automated test cases with biweekly sprints

▪ Modular architecture of test case design

▪ Different callbacks for easy manipulation of test cases

Limited test capacity

• Test stand

• Qualified manpower

Test depth

• High test depth required to achieve interoperability

New technology

• Fast updates required due to changes in market

• Standard still subject to change

Page 8: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

1

2

BRIEF INTRODUCTION TO P3

CHALLENGES INTEROPERABILITY AND TESTING

DEVELOPMENT OF CONFORMANCE TESTS4

8

CONTENT

3

Page 9: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 9

P3 APPROACH: TEST ASSESSMENT

The P3 test chain: Overview of the methodical approach

The test experts of P3 analyze the quality of testing based on the seven elements of the P3 test chain:

Ex. Test equipment: If the tools are set, how are we testing in this specific test environment?

Ex. Reporting: What KPIs are urgently required? How can I streamline the process due to those KPIs?

The key success factor is the management: this makes the tests scalable, with a relatively constant management effort

THE TEST CHAIN IS ONLY AS STRONG AS ITS WEAKEST CHAIN LINK.There are interactions between the individual chain links.

[P3] Systematic Testing of Charging Communication

Page 10: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

Project steps and implementation steps

CHARGING COMMUNICATION TESTING FOR EV AND EVSE

Requirements Definition of TCs Implementation ofTCs

Validation

Check TCs againstsimulation

Implementation ofnegative TCs

Check of TCs withnegative TCs

10

Page 11: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

Agile software development with Scrum

How we use the scrum process

PLANNING

▪ Developers are located in two different sites

All communication via skype

OneNote as knowledge base

▪ Sprint 2 weeks long

▪ Sprint planning last Tuesday before the new Sprint starts

▪ Every Thursday scheduled communication about current technical topics

▪ Daily stand up via skype

▪ Retrospective every other Friday for review of processes

MunichStuttgart

Product and sprint backlog is saved in a TFS (Team foundation server)

11

Page 12: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

Test case implementation

Finding similarities in test specification helps to improve quality with lower effort

TEST CASES

▪ Every TC is implemented according to the dual control principle:

▪ One test engineer implements the TC

▪ Another test engineer validates the TC

▪ Most DIN V2G-TCs can be categorized into 8 groups

Templates

DIN V2G-categories:

1. Good case

2. Expired time

3. Response code

4. Out of sequence

5. Set CP state E/F

6. Non-critical shutdown

7. CP state E/F and datalink connection

8. Invalid duty cycle

12

Page 13: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

Testing of charging communication between EV and EVSE

Electric vehicle (EV), electric vehicle supply equipment (EVSE)

TEST EQUIPMENT

▪ EV or EVSE communication controller is simulated by hardware module and SCC software package

▪ Relays are switched during testing, like in

real equipment

▪ No counter part is needed

▪ Test cases are easily implemented due to

built-in functions of the SCC package

▪ CharIN interface for interoperability with different hardware

▪ Test cases and equipment can be used for HiLtests as well as tests of the complete system

Example test setup

13

Page 14: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication 14

Implementation in vTESTstudio, modular built, easy to understand

TEST IMPLEMENTATION

Implementation

▪ Implementation is done in modular functions

▪ There is a caption for each test step

▪ Restbus simulation can be easily integrated in the preparation

▪ All functionalities provided by CANoe can be accessed

Page 15: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018

CANoe provides all traces from the test and generates a full test report

Simulation and test of CAN field busses

TEST DOKUMENTATION

[P3] Systematic Testing of Charging Communication

▪ Execution of test cases with well-known CANoe

▪ Automation of test execution and test report generation possible

15

Page 16: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

2018 [P3] Systematic Testing of Charging Communication

Testing and validation of test cases

For quality assurance during and after development

QUALITY ASSURANCE

▪ Check if test cases detect errors / malfunctions of SUT

▪ Two CANoe test units:

1. Runs normal test cases

2. Simulates a malfunction in SUT

16

Page 17: SYSTEMATIC TESTING OF CHARGING COMMUNICATION · 2018-10-13 · Check of TCs with negative TCs 10. 2018 [P3] Systematic Testing of Charging Communication Agile software development

QUESTIONS?

This document contains P3 Systems GmbH proprietary information and shall at all times remain the property of P3 Systems GmbH. It shall be distributed and used only by the recipients registered on the distribution list of this document. The recipients are not allowed to copy this document without P3 Systems GmbH prior written consent. It shall not be used, distributed or copied by any other third part without P3 Systems GmbH prior written consent.

2018 [P3] Systematic Testing of Charging Communication 17

AEROSPACETELECOMMUNICATIONS ENERGYAUTOMOTIVE Public