![Page 1: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/1.jpg)
New TTCNNew TTCNNew TTCNNew TTCN----3 Test Adapter Framework 3 Test Adapter Framework 3 Test Adapter Framework 3 Test Adapter Framework with Capability Descriptionwith Capability Descriptionwith Capability Descriptionwith Capability Description
Yang LIUBei Hang University
![Page 2: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/2.jpg)
Outline
• Introduction• The Problem• The solution• The solution• Test Adapter Framework• Evaluation• Conclusions
![Page 3: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/3.jpg)
The separation of test specification with test adapter
TM: Management
Test System User
TCI
Introduction
System Under Test (SUT)
SA (System Adapter) PA (Platform Adapter)
CH:
Component
Handling
CD: CodecTE
TCI
TRI
![Page 4: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/4.jpg)
Outline
• Introduction• The Problem• The solution• The solution• Test Adapter Framework• Evaluation• Conclusions
![Page 5: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/5.jpg)
The Problem
• The dependencies among the abstract test
case, CD and adapters (SA and PA) are
obvious.
• There is no explicit semantic definition of the • There is no explicit semantic definition of the
dependencies in TTCN-3 standard so far.
![Page 6: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/6.jpg)
Outline
• Introduction• The Problem• The solution• The solution• Test Adapter Framework• Evaluation• Conclusions
![Page 7: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/7.jpg)
The solution
• Capability description language for specifying
the dependencies among the abstract test
case, CD, SA and PA
• A Test Adapter Framework• A Test Adapter Framework
– Automatic load the Adapter which comply with
the requirements of test cases
– Based on the description language
– Transparent to the test system
![Page 8: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/8.jpg)
Outline
• Introduction• The Problem• The solution• The solution• Test Adapter Framework• Evaluation• Conclusions
![Page 9: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/9.jpg)
Mapping between the Adapter and
TestCase
• Adapter Capacity
– SA: Communication Adapter
– PA: External method Adapter
– CD(ECD): Data Adapter
AdapterAdapter Capacity
– CD(ECD): Data Adapter
• Test System Interface(TSI)’s demand
– Demand for communications capacity
– Demand for External method
– Input and output data types SUTTSI’s
demand
![Page 10: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/10.jpg)
Adapter Framework – Overall
Architecture
Function Layer
Adapter
1
Adapter
2……
Adapter
N
Test Adapter Framework
TE
SUT
Execute Engine
Configuration Layer
Configuration
ManagementSwitcher
Interactive Layer
SA PA CD
![Page 11: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/11.jpg)
Adapter Framework – Switcher
SAs PAs CDs
Test Adapter Switcher
Loader Mapper Selector
![Page 12: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/12.jpg)
Adapter Framework - Loader
• Environment Description– OS
– Environment VarsTest
Adapter (jar)
Loader Adapter
Objects
• Test Adapter Description – SA
– PA
– CD
Test Adapter 1
Attributes
Test Adapter 2
Attributes
Test Adapter n
Attributes
Environment
Abilities
…
![Page 13: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/13.jpg)
Adapter Framework - Mapper
TSI SA
port name
type
name
port-type
SA
(jar)
PA
CD
type
module
Encode
Rules
module
name
rule
name
PA
(jar)
CD
(jar)
![Page 14: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/14.jpg)
example of capability matching
capability requirement description of the test case:
capability provision description of the CD & SA :
![Page 15: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/15.jpg)
Adapter Framework – Selector
![Page 16: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/16.jpg)
Dynamic switcher
• Prerequisite :– TTCN-3 test script
– SA , PA & CD
– Test adapter & TSI ‘s Description File
descAdapter load mapping relationship
jardesc
Test adaptor Description File
Adapter load
Loader
mapping relationship
MapperMapping object
Select Adapter
TE Selector
Specificadapterobject
Adapter Object
![Page 17: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/17.jpg)
Outline
• Introduction• The Problem• The solution• The solution• Test Adapter Framework• Evaluation• Conclusions
![Page 18: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/18.jpg)
Evaluation
• Experiment:
• SUT
–Simulated heterogeneous distributed
systems
HTTP
• Test system
–SA and CD of Three test subsystems
–test script
• Support Tools
–Compiler (TTthree)
–Execution Engine (TTman)
SUT
TCP
UDP
![Page 19: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/19.jpg)
Experiment with TAF
SUT TCP UDP HTTP
module TCPTest UDPTest HTTPTest
TSIPortName tcpSystemPort udpSystemPort httpPortArray
type TCP UDP HTTP
encodeRules TCPCodec UDPCodec HTTPCodec
SATCP_TA.jar
/TCPTestAdapterUDP_TA.jar
/UDPTestAdapterHTTP_TA.jar
/HTTPTestAdapter
CDTCP_Codec.jar
/TCPCodecUDP_Codec.jar
/UDPCodecHTTP_Codec.jar
/HTTPCodec
![Page 20: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/20.jpg)
TAF –Test Result
![Page 21: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/21.jpg)
Performance comparison
![Page 22: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/22.jpg)
Outline
• Introduction• The Problem• The solution• The solution• Test Adapter Framework• Evaluation• Conclusions
![Page 23: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/23.jpg)
Conclusions
• Why we design the test adapter framework
• Existing problems
– Test Adapter Framework configuration is complex
– The efficiency of loading the modules which will – The efficiency of loading the modules which will
be dynamic switching is low
![Page 24: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/24.jpg)
Conclusions
• Future work
– Raise the ability to match to the semantic level
– Use a general language of Capability Description
– Set the general test adapter Standard – Set the general test adapter Standard
![Page 25: WU New TTCN-3 Test Adapter Framework with Capability ... 1/session 2/WU...New TTCNNew TTCN- ---3 Test Adapter Framework 3 Test Adapter Framework with Capability Description Yang LIU](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7cf76072b06041f7f4d4b/html5/thumbnails/25.jpg)
THANK YOU