Presented by: For:

© ETSI 2019

21-22.11.2019

How to Make Better StandardsAchieving Interoperable Standards

Ultan Mulligan ETSI Seminar

© ETSI 2019 2

IOP and Complex Standards

Complex ICT standards are increasingly specified by ‘islands of standards’

From different standardisation bodies

Or developed for a different (original) use

Complete system not specified in detail

Results in potentially non-interoperable standards and/or products

© ETSI 2019 3

Poor Interoperability Can be Expensive

Bad publicity

For the technology

For the manufacturer

Annoyance to the end customer

Damage to brand name

Loss of customer base

Allegiances change rapidly

May affect uptake of new technology

Loss of investor confidence

We can no longer afford to get it wrong!

© ETSI 2019 4

ETSI and Interoperability

Standardisation enables interoperability

Enabling interoperability in a multi-vendor, multi-network, multi-service environment

Interoperability is the red thread running through the entire ETSI standardization process

Interoperability is addressed from the beginning

Not something ‘bolted on’ at the end, it must be built-in

© ETSI 2019 5

How to develop interoperable and robust standards

There is no Silver Bullet, but …

ETSI takes a pragmatic approach

Write high-quality standards

Ensure that the standards specify the right thing

Ensure products implement standards correctly

© ETSI 2019 6

Typical Causes of Non-interoperable Standards

Requirements not well identified or missing

Ambiguous requirements

Varying technical quality and use of language

Inadequate handling of options

Lack of clear system overview

Loose definition of interfaces (reference points)

Poor maintenance

Using standards beyond their original purpose

...

© ETSI 2019 7

Improving deliverable quality

• An Introduction to Achieving Technical Excellence

• Guide to Writing World Class Standards

• Easy reading for internal use as well as wider distribution (even beyond ETSI)

• Introductory flavour but with ‘hooks’ for subsequent detailed developmentBrochures

• Principles and examples of Writing World Class Standards

• Organized on demand for TBs/ISGs

• Focused on Standard Drafting Skills

• To obtain general standards writing expertise

Workshops

7

© ETSI 2019 8

Standards Development - Three Best Practices

SPECIFICATION

VALIDATION

TESTING

Application of good standards engineering principles, guidelines and techniques

Validation of standards as an active part of the development process.

Mainly through peer review and interoperability events

Development of standardised test specifications for key technologies

© ETSI 2019 9

ETSI Support for Interoperability

Technical Committee Methods for Testing and Specification (MTS)

Standardised frameworks, methodologies, languages

For protocol specification

For testing

Centre for Testing and Interoperability (CTI)

Direct support to ETSI Technical Bodies

CTI experts can be attached to a standardization group and provide hands-on assistance

© ETSI 2019 10

CTI

CTI Support to TBs for the Development of Interoperable Standards

SPECIFICATION

VALIDATION

TESTING

Support ETSI Technical Committees on the application of best practice protocol

specification methods, techniques and tools.e.g., ASN.1, UML, MBT (Model Based Testing)

Support ETSI Technical Committees on the validation of standards.

Mainly Plugtests events (organisation and provision of testing expertise)

Support ETSI Technical Committees on ALL testing aspects including the development of

test frameworks, methodologies, test specifications. Mostly through

participation/leadership of STFse.g., STF 160, ITS, TTCN-3

© ETSI 2019 11

CTI expertise

CTI

Standards Engineering based on methodology and best working practicesTraining

Validation Activities Interoperability Events

Test Specifications

Protocol Design

© ETSI 2019 12

CTI activities

CTI

Standards Engineering based on methodology and best working practicesTraining

Validation Activities Interoperability Events

Training

• Best Practices

• Methodology

• Languages

• Implementation issues

Validation Activities

• Validation of Standards

•Peer-review

• Simulation by modelling

• Interoperability events

• Proofs of Concept

• Open Source development

Test Specifications

Test Specification

• Test Planning & Frameworks

• Extraction of Requirements

• Test Purposes

• Test Descriptions

• TTCN-3 code

• Tool support

Protocol Design

Protocol Design and Specification

• Application of best practices

• 3-Stage approach

• Techniques such as:

UML, MSC, SDL, ASN.1, XML, JSON etc.

Interoperability Events

• Organizational &Technical

• Logistics, website, press

• Registration, NDA, promo

• Test platform and IT

• Monitoring, test results

• Feedback to TC

© ETSI 2019 13

Bridging the Gap between products and standards!

Implementations mature from prototypes to INTEROPERABLE commercial products

Market Awareness and

Pre-Standardization:

Proofs of Concepts

Testing and Validation

Methodology frameworks,

documentation, planning and tools

INTEROPERABLE standards evolve in parallel with product development

Standardized Test SpecificationsConformance, Interoperability etc.

PLUGTESTS EventsInteroperability, pre-conformance, coexistence etc.

Product Testing (not ETSI) Ce

rtification

© ETSI 2019 14

Useful Links

ETSI Approach to Interoperability and Testing

An Introduction to Achieving Technical Excellence

Guide to Writing World Class Standards

Interoperability Best Practices

CTI: www.etsi.org/about/how-we-work/testing-and-interoperability

Plugtests: www.etsi.org/about/what-we-do/plugtests

TTCN-3: www.ttcn-3.org

STF: portal.etsi.org/STF/STFs/Summary.aspx

Mail contact: CTI_support@etsi.org