overview - ttcn-3 1...rnc nodeb rnc 4 © nokia siemens networks vikas pratap singh / ttcn-3 user...

8
1 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Using a TTCN-3 middleware in TTCN-3 based testing Vikas Pratap Singh - TTCN-3 User Conference Asia 2007 - 2 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Overview Introduction Test Process A TTCN-3 Middleware TcSkeletonV3 Results Things to remember

Upload: ngokhanh

Post on 14-Mar-2018

235 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

1 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Using a TTCN-3 middleware in TTCN-3 based testing

Vikas Pratap Singh- TTCN-3 User Conference Asia 2007 -

2 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Overview

IntroductionTest ProcessA TTCN-3 MiddlewareTcSkeletonV3ResultsThings to remember

Page 2: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

3 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Introduction

UMTS– Standards body : 3GPP– Broadband mobile access

for voice (TDM) and data (statistical multiplexing)

– Guaranteed QoS, can use IP for signaling

RNC: Radio Network Controller

– Owns and controls the radio resources (NodeB)

– Uses specialized procedures (e.g. handover control, admission control, power control…)

Core networkCore network

Mobile(UE)

NodeBRNC

NodeB

RNC

4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Test Process definitionFrom SoW until TTCN-3 TC execution

TC categ 1TC categ 2

TC categ n

TTCN-3 TestCase ScriptsTTCN-3 Protocol proceduresTTCN-3 templates

SowAuthoring

T-SpecAuthoring

TTCN-3 TC Scripting

TTCN-3 TCModule Testing

Test Case APSCO

Test Execution

MSCs andFunctional Specifications

Sow(excel)

T-spec(word)

SCOPE OF WORKTESTCASE SPECIFICATION

TESTCASE IMPLEMENTATION

TESTCASE EXECUTION• TC specification as per Feature requirements.• Population of TTCN-3 templates • TTCN-3 Scripting of TC

as per TestSpecindications.

• MT of TTCN-3 TCs before delivery for execution.

•MSC is the most imp. part

Page 3: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

5 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Scripting Demands

Script the data types.Script the templates.Design the data structure that might be needed by all the PTC’s(e.g: ports and

components etc)Create all the PTC’sConnect them to the MTC and any other component as required.At the end of the testcase, tear down all the connections.Script different send and receive statements.Design an algorithm to assure that the exact sequence of the testcase is followed.Take care of the verdict handlingScript the functions required to encode/decode incoming and outgoing data.Formulate the algorithm to handle various possible scenarios as, coregion, parallel

behavior, alternative behavior etc.EtcEtcEtc……..

6 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Page 4: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

7 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Remedy– A TTCN-3 middleware

This middleware will be a library of functions written in TTCN-3 that would implement algorithms to handle the common behavior of the test system. The middleware simplifies the task of the scripter massively in converting a test MSC into executable TTCN-3 scripts and helps him focusing on the correct translation of the test specification instead of spending time on implementing the test execution logic.

8 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Remedy– A TTCN-3 middleware........TcSkeletonV3

This middleware was a developed by a team with the following members:

– Andy Rauland (Ulm)– Andreas Ulrich (Munich)– Zhang Chao (Beijing)– Vikas Pratap Singh (Bangalore)

SUT

TRI TCI

TcSkeletonV3 as test APITTCN-3

FrameworkJava / C++

TTCN-3 test casesTTCN-3

Page 5: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

9 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Aim of TcSkeletonV3

To make a middleware fully compliant with TTCN-3 standard.

To provide simple scripting interface to users.To provide easy mapping of test cases written in high-level

MSC’s to TcSkeletonV3 user functions.Make it efficient in terms of compilation time.Provide the support for alternatives, parallel behavior, etc

by means of simple API.

10 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

TcSkeletonV3-The Concept (Sequential behavior)

MTCMTCMTC

UPSAP #1UPSAP #1UPSAP #1alivealivealive UPSAP #2UPSAP #2UPSAP #2

alivealivealive TUSAPTUSAPTUSAPalivealivealive

Syst

emPc

o

Syst

emPc

o

Syst

emPc

o

MtcCp MtcCp MtcCp

SystemComponentSystemComponentSystemComponent

PreTcUPSAP

PreTcTUSAP

MainTest CaseFunction

TUSAP_Port[]UPSAP_Port[]

NPSAP_Port[]

NBAP_Port[]

UPSAP_In_Func

UPSAP_Out_Func

<ProtocolProcedure>

UPSAP_In_Prot_Func

UPSAP_Out_Prot_Func

PostTc

Page 6: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

11 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Some API’s in detail

PreTc<INTERFACE> (e.g: PreTcUPSAP )- Creates the PTC and connects it to the MTC.

<INTERFACE>_In_Func(e.g:UPSAP_In_Func)- This function starts another function which receives, decodes and matches the incoming template .

<ProtocolProcedure>: Here some intermediate functionality can be performed, like copying information from incoming message to outgoing template.

<INTERFACE>_Out_Func(e.g:UPSAP_Out_Func)- This function starts another function which encodes the template and sends it out.

PostTc: This function shall tear down all PTCs and check the queue towards SUT if empty

12 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Features supported

Case tool for test case editing

TTCN - 3

Page 7: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

13 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

NBAP_Port[]

NBAP_Port[]

MTCMTCMTC

TcSkeletonV3-The Concept (Parallel behavior)

PreTcUPSAP

MainTest CaseFunction

UPSAP #1UPSAP #1UPSAP #1alivealivealiveCtrlPtcCtrlPtcCtrlPtc

alivealivealive

TUSAP_Port[]UPSAP_Port[]

NPSAP_Port[]

TUSAP #1TUSAP #1TUSAP #1alivealivealive

Syst

emPc

o

MtcCp

SystemComponentSystemComponentSystemComponent

TUSAP_Port[]UPSAP_Port[]

NPSAP_Port[]

NBAP_Port[]

TUSAP_In_Func

TUSAP_Out_Func

<ProtocolProcedure>

TUSAP_In_Prot_Func

TUSAP_Out_Prot_Func

Syst

emPc

o

MtcCp

CtrlPtcCtrlPtcCtrlPtcalivealivealive

TUSAP_Port[]UPSAP_Port[]

NPSAP_Port[]

UPSAP_In_Func

UPSAP_Out_Func

<ProtocolProcedure>

UPSAP_In_Prot_Func

UPSAP_Out_Prot_Func

PreTcTUSAP

PostTc

14 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Results

TcSkeletonV3 was used in our project by ~100 testers across 5 different sites and 3 different countries.

This middleware reduced the complexity of scripting massively resulting in happy testers.

Reusability: a high degree of reusability was achieved as the middleware itself is fully reusable.

Another feature of TcSkeleton, called ANTI-TcSKELETONallowed the scripters to module test there testcases, thus reducing the scripting mistakes by about 95%.

Currently this middleware is being used in LTE project.

Page 8: Overview - TTCN-3 1...RNC NodeB RNC 4 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China Test Process …

15 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Things to remember

Make sure that the scripting interface is simple, thus providingeasy mapping of system requirements modeled in MSCs to middleware functions.

Make sure that you stick to the latest edition TTCN-3 standards.

Make sure that your middleware is as independent of any tooling as possible.

Always keep automation in mind.Make sure that your middleware is optimized for compilation time.The middleware should be well documented.

• A user’s manual is always a good idea

16 © Nokia Siemens Networks Vikas Pratap Singh / TTCN-3 User conference Asia 2007 / Beijing,China

Thank you for your attention