reactive test of embedded systems using models · 2017-10-16 · evaluation across various tools...

19
REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS Presented by Sadegh Sadeghipour & Hans-Werner Wiesbrock Partly funded by the German Ministry of Economic Affairs and Energy (BMWi) © All rights reserved

Upload: others

Post on 03-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELSPresented by Sadegh Sadeghipour & Hans-Werner WiesbrockPartly funded by the German Ministry of Economic Affairs and Energy (BMWi)

© All rights reserved

Page 2: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

CONTENT• Introduction

• Test environment architecture

• Industrial case study

• Conclusion

© All rights reserved

Page 3: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Closed-loop vs. open-loop tests

3

• Open-loop: no reaction to test object‘s behaviour during the test run

© All rights reserved

testinput

testoutput

testobject

• Closed-loop: reactive testing

testinput

testoutput

testobject

environmentmodel

• Closed-loop model-based testing

testmodel

testoutput

testobject

Page 4: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Two kinds of test specification in MBT

4 © All rights reserved

• Open-loop test: specifying a test model, generating test cases (test sequences) from it and executing them

• Closed-loop test: specifying a test model and running it parallel to the test object (co-simulation)

testmodel

testoutput

testobject

testinput

testoutput

testobject

Page 5: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

• Introduction

• Test environment architecture

• Industrial case study

• Conclusion

© All rights reserved

Page 6: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Using a framework for automating test execution

6 © All rights reserved

• ContinoProva: Automated test execution and evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, …

• Defining interfaces for coupling new tools; integrating different kinds of test specification

Client

Server 1

Tool 1.1

Tool 1.2

Test specificationServer 2

Tool 2.1

Tool 2.2

Page 7: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Automation procedure

7 © All rights reserved

• Test model specified in Enterprise Architect

• Generating executable code from the test model and integrating it into ContinoProva

• UML Testing Profile used as architecture guidance

Page 8: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Test environment architecture – ContinoProva

8 © All rights reserved

test server

test client

test control

test report

test evaluation

Page 9: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Test environment architecture – external tools

© All rights reserved

external tools

test object

abstraction layer

communicating with

exetrnal tools

9

Page 10: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Test environment architecture – MBT integration

10 © All rights reserved

test model

abstraction layer for

different modeling tools

Page 11: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Test environment architecture

11 © All rights reserved

test model

abstraction layer communicating

with exetrnal tools

external tools

test object

test server

test client

test control

abstraction layer for

different modeling tools

UTP TestCase

test report UTP TestLog

UTP SUT

test evaluation UTP Arbiter

Page 12: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

• Introduction

• Test environment architecture

• Industrial case study

• Conclusion

© All rights reserved

Page 13: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Test object and test objective

13 © All rights reserved

• Test object:

• A ventricular assist device (VAD) pumping blood from the heart to the aorta, connected to a control unit and battery

• Test objective:

• Does the software of the control unit detect a kink or a leak in the hose connecting the pump and the pneumatic drive (by sounding an alarm)?

• Kink and leak diagnosis: Unusual low resp. high friction within the system

Page 14: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Characterization curves of friction and its hysteresis

© All rights reserved

alarm

fmin fmax

friction

ON

OFF

friction‘s hysteresis

diagram

14

friction

fmin

pressure

fmax

p1 pn

frictions‘s characterization

curves depending on the

pressure

leak

kink

Page 15: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

The test model (UTP TestCase)

© All rights reserved15

• Characterization curves have to be individually explored for each pump, cannula and patient during testing

• Sampling the characterization curve step by step (by increasing the pressure)

• For each pressure value simulating a kink/leak by increasing/decreasing the friction and running the system into alarm states

• Decreasing/increasing the friction and checking whether the alarm is stopped according to the hysteresis diagram

Page 16: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

The State Machine

© All rights reserved16

Page 17: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

• Introduction

• Test environment architecture

• Industrial case study

• Conclusion

© All rights reserved

Page 18: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

Results

© All rights reserved18

• The presented test environment architecture and the MBT approach fit well into the use case:

• closed-loop test

• high variability of interaction with the environment

• Heterogeneous tool environment

• The architecture cannot be used in the cases, where the test environment has to fulfill hard real-time requirements, e.g. when testing car engine ECUs

Page 19: REACTIVE TEST OF EMBEDDED SYSTEMS USING MODELS · 2017-10-16 · evaluation across various tools deployed in the test environment, e.g. debugger, relay box, CAN tool, … •Defining

© All rights reserved

THANKS FOR YOUR ATTENTION!

ANY QUESTION?