institute for telematics university of lübeck, germany m. ebner, m. schmitt, j. grabowski test...

15
Institute for Telematics University of Lübeck, Germany M. Ebner , M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

Upload: emery-doyle

Post on 16-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

M. Ebner, M. Schmitt, J. Grabowski

Test Generation

with

Autolink and TestComposer

Page 2: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

2 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Motivation

• Systematic testing of complex systems

• Test specification and description

• Formal Specification of the System under Test (SUT)

• Automatic test generation

Autolink and TestComposer

Page 3: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

3 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Page 4: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

4 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Page 5: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

5 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Distributed Test Architecture

Page 6: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

6 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test Purpose Computation

• Coverage– large structural coverage– coverage unit and observation step

• Search strategy– breadth first– depth first, iterative depth first– repetitive local exploration

• Automatic computation of postambles

Page 7: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

7 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Page 8: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

8 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test Purpose Specification

• Manual specification– Interactive Simulation– Observer Processes

• Abstract test purposes

• MSC test purpose structuring– Preamble, Test body, Postamble– HMSC and MSC expressions

Page 9: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

9 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Page 10: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

10 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test Case Generation

• State Space Exploration– find paths corresponding to test purpose

– postamble computation for alternative paths

– “On the fly” generation

• Direct translation of MSCs to TTCN– Problem: SDL model may be incomplete

– consistency checks with regard to interface

Page 11: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

11 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Page 12: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

12 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test suite production

• Generate TTCN test suite parts

• Provide suite customisation

• Enhance readability • Reduce manual

post-processing

• Test grouping• Test step format• Test purpose

comments• SDL signal mapping

on ASPs or PDUs• Timer

Page 13: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

13 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Page 14: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

14 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Summary I

• TestComposer– Flexible in test purpose description – Postamble computation– Support of timers– API for test suite access

• Autolink– Supports MSC’96– Direct translation from MSC to TTCN– Test suites for distributed test architectures

Page 15: Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test Generation with Autolink and TestComposer

15 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Summary II

• Same principles but different kinds of test generation solutions

Tools complement each other combination of the best features would

enhance practical usability