making heterogeneous elements interoperate · interconnected by different types of local and wide...

MAKING HETEROGENEOUS ELEMENTS

INTEROPERATE

ANTHONY WILES

ETSI CENTRE FOR TESTING AND INTEROPERABILITY (CTI)ETSI CLOUD WORKSHOP 28 - 29 SEPT 2011

My starting point is

• In a global market interoperability is essential

• Standardisation enables interoperability

About This Presentation

The ETSI approach to achieving interoperability:

• Standards validation and testing

About Interoperability Events

A few words on conformance and interoperability

Conclusions

2 Standards in the Cloud: a transatlantic mindshare

Definition of Interoperability

No single definition of Interoperability, two examples

1) The ability of two or more systems or components to exchange and use information

2) Interoperability is a property of a product or system, whose interfaces are completely understood, to work with other products or systems, are completely understood, to work with other products or systems, present or future, without any restricted access or implementation [Wiki]


ICT Technologies are Built on Multiple

Standards

ITU

ETSI

IEEE

IETF

Fora

ICT technologies are often specified by ‘islands of standards’

• From (many) different standardisation bodies or organisations

• Different approaches in terms of specification

Converged into a single product (Smartphone)

Interconnection of many hetererogenous components (LBS, IMS, Cloud)

• Maybe using standards beyond their original purpose or where end-to-end interoperability

may never been considered

Results in potentially non-interoperable standards and/or products


ETSI Approach –

Validation and Testing

Products mature from prototypes to commercial products

Time

Certification

(not done by ETSI)

Development of Base Standards

Validation through Interoperability Events


Products mature from prototypes to commercial products

Conformance Testing

Development of Test Specs (Conformance & Interop)

Validation Through Interoperability

Events

Single physical location or several interconnected locations during a fixed

period (e.g., 5 days)

• At ETSI, test lab, hotel etc.

• Test infrastructure is put into place just for each event

• Events can be (fully) remote but still fixed duration

Dedicated location

• Permanent (or semi-permanent) testbed

• Can be fixed duration events

• Can be long-term activity

In both cases ETSI Plugtests offer full organisational and technical support

Standards in the Cloud: a transatlantic mindshare6

Typical Plugtests Events

IMS

Bluetooth

IPv6

B2B (Business-to-Business)

SIPiT

J2ME – Mobile Apps

In operation since 1999

Over 160 events so far

For many diverse technologies

IPv6

Triple Play over xDSL

SIM/Handset

WLAN IRAP

RFID

STQ (Speech Quality)

WiMAX

SIGTRAN

Femtocell

OSA/ParlayX

SMS / MMS


J2ME – Mobile Apps

HDMI

VoIP for Air Traffic Management (3 EUROCAE events)

Electronic Signature (XadES, CadES)

Lawful Interception

Optical Fibre (GPON)

Power Line (PLT)

Intelligent Transport Systems (ITS – C2C)

Fixed Mobile Convergence (FMCA)

GRID (Cloud)

ENUM

Plugtests™ can look like this…


… or this (Car2Car Interop)


Enabling Remote Events - Hub for

Interoperability and Validation at ETSI


Validation of Standards by

Interoperability Events

Community

ProductsStandards


ProductsStandards

Identified

IOP Issues

Tests

Interop Event

Evaluation of Standards Solutions by

Interoperability Events

Community

StandardsTrial

Alternative


Interop Events,

StandardsTrial

Solutions

Alternative

Standards

Solutions

Evaluated

Solutions

Scenarios

Resolution of Specific IOP Problems

by Interoperability Events

Community

Standards

Community

Identifies

IOP Issues


Trial

Solutions

IOP Issues

Evaluated

SolutionsInterop Events,

Scenarios

Evaluation of Co-existence Issues

Community

1 2

1 2

1 2


ProductsStandards

Identified

coexistence

Issues

Tests

1 2 1 2

Interop Event

ETSI Test Specifications for

Conformance

ETSI Develops conformance test specifications for

many of its mainstream standards

For use by members in their proprietary development

processes

Certification schemes, for example• Developing standardised conformance test specifications for GSM and 3G

(UMTS/LTE) for over 15 years

• Follow strict methodology (based on TTCN-3)

• Average budget 1M€ per year

• 3GPP RAN#5 delivers these tests to GCF (Global Certification Forum)

• All tests validated (executed) on up to 5 platforms against real equipment before

approval and publication


Conformance Testing and IOP Testing are

Complementary

As you move up a system stack the emphasis should change

from conformance to interoperability testing

Lower layer protocols

• Emphasis on conformance testing

Middleware, enablers, infrastructure

16

Middleware, enablers, infrastructure

• Combination of conformance and

interoperability testing

Services, applications

• Emphasis on interoperability testing

Conformance testing should be a pre-requisite to

interoperability testing

Standards in the Cloud: a transatlantic mindshare

Interop and the Cloud

Another definition of interoperability:

- Being able to accomplish end-user applications using different types of

computer systems, operating systems, and application software,

interconnected by different types of local and wide area networks (James A.

O'Brien and George M. Marakas)


Combining IOT with Conformance

Checking


Conclusions

Interoperability is a major factor in driving ICT

standardisation

Validated standards(Plugtests) help ensure

interoperable standardsinteroperable standards

Testing helps ensure interoperable products

Standardised test specs and interoperability events

should be an integral part of standards development

• Requires planning and support

Works for Cloud too!


Contacts

Email: [email protected]

Web: www.etsi.org/plugtests


THANK YOU!

Anthony Wiles

Director

Centre for Testing and Interoperability (CTI)

[email protected]

ETSI Approach – Three Best Practices

Technical Bodies

3GPP

AERO

ATTM

BRAN

CLOUD

DECT

eHEALTH

SPECIFICATION

Validation of standards as an active

Application of best practice

specification methods, techniques

and tools.(Subject of another presentation!)

eHEALTH

ERM

ESI

HF

INT

ITS

LI

MTS

PLT

SCP

STQ

TETRA

TISPAN …


VALIDATION

TESTING

Validation of standards as an active

part of the development process.

Mainly through interoperability

events.

Development of standardised test

specifications for key technologies.

Series of IOP Events

Maturity of the Standard

Stable and interoperable

Number of Events

Event 1 Event 2 Event nn...........


Early draft

Scope of Interoperability Testing

Interoperability

Scope of

Interoperability

Testing


Interoperable

products may still

not conform!

Performance addressed

to some degree –

depends on the

complexity of the test

scenarios

Cannot explicitly cause

error conditions so

robustness addressed to

a limited degree and in a

less controlled manner

Scope of Conformance Testing

Conformance

to

Requirements

Scope of

Conformance

Testing


Requirements

Conformant

products may still

not interoperate!

Performance not usually

addressed – requirements

not standardised and

testing is done under

ideal conditions

Can simulate error

conditions – but only

standardised robustness

requirements addressed

making heterogeneous elements interoperate · interconnected by different types of local and wide...

Documents