etsi nfv plugtest overview

NFV PLUGTESTS

Silvia Almagia

ETSI CTI

© ETSI 2015. All rights reserved

OSM-MR#1, Madrid

June 2016

ETSI Plugtests


Plugtests are interoperability testing events organised and run by ETSI to support its Technical Bodies• Run in parallel with specification work

• Most often part of a series

Main focus on validating the interoperability among different implementations over standardized reference points

Run consistent testing across different combinations of implementations

Compile statistic results and provide consistent feedback to the TB

Participation is free and open to any organisation providing a Function Under Test (FUT)

7

NFV Plugtest

ETSI is organising a first NFV Plugtest• Hosted by 5Tonic in Madrid, Spain

• 23 January – 3 February 2017

• Preceded by a remote integration phase

Goal: Validate ETSI NFV Release 2 capabilities and Information Model in a number of NFV end to end configurations with components from different providers.

NFV capabilities in scope include: • VNF Package, SW Image and NSD Management,

• VNF & NS Life Cycle Management,

• VNF & NS Fault & Performance Management.


Functions Under Test


NFV components (FUTs) in scope include:

• VNFs

• MANO (VNFM & NFVO)

• NFVi & VIM

VNFs

MANO

NFVI & VIM

* Note: FUTs can be provided by a group of companies / partners (i.e. comp1, comp2 and comp3 team up and bring a pre-integrated NFVi & VIM)

Supporting Open Source Projects

Open Source Projects supporting the NFV Plugtest:• Review and provide feedback to the Test Plan

• Provide and support (at least) one FUT


Test Plan

Test Plan development lead by ETSI

Based on ETSI NFV Rel’2 Capabilities

Following NFV IOP Methodology (TST002)

With input from

• ETSI NFV (TST)

• Plugtest participants,

• supporting Open Source projects

Applicable to any implementation in scope

• So vendors and Open Source projects can derive their own detailed test plan (map configuration / stimulus / check steps to their implementation specifics)

Will be run and validated during Plugtest

• Over a number of combinations of implementations

And submitted to ETSI NFV as possible input for NFV IOP Test Specification


Test Plan Reference documents

Information Model

IFA015 - NFV Information Model Report (**)

• NFV Information Model overview

IFA014 – Network Service Templates Specification (**)

• NSD Templates

IFA011 – Network Service Templates Specification (**)

• VNF Packaging

Capabilities

IFA010 – MANO Functional requirements specification (*)

• MANO Requirements overview

IFA012/IFA013 – Os-Ma-Nfvo ref point Spec - svc mgmt & info model (**)

• MANO NBI

IFA008 – Ve-Vnfm ref point Spec (**)

• Interface to VNF/EM

IFA005/006 – Or-Vi/Vi-Vnfm reference points Spec (*)

• VIM NBI

Test Methodology

TST002 – NFV IOP Methodology (**)

• IOP Test Framework and summary of capabilities

TST007 – VNFM/VIM IOP Guidelines (TBC)

• Very early stage, change of scope under discussion


(*) Published http://www.etsi.org/deliver/etsi_gs/NFV-IFA/001_099/

(**) Latest draft in https://docbox.etsi.org/ISG/NFV/Open/Drafts/

http://www.etsi.org/deliver/etsi_gs/NFV-IFA/001_099/

https://docbox.etsi.org/ISG/NFV/Open/Drafts/

PlugtestIntegration

Timeline

Registration (July to September)• Co-participants

• FUT

• NDA (test results)

Preparation: (Sept-Oct)• Test Plan development & practical arrangements – lead by ETSI

• Regular conf-calls, details captured in Plugtest WIKI

Remote integration & pre-testing (Nov-Dec)• Through HIVE

• Regular conf-calls, IRC sessions, …

F2f Plugtest• 1st Week (23-27 Jan) – Local Infrastructure Deployment

• 2nd Week (30 Jan – 3 Feb) – Test Sessions


PreparationRegistration

23 Jan – 3 Feb 2017

Sept Oct Nov Dec Jan Feb

Xmas

Remote Integration


Remote Integration Sessions


MANO to VIM VNF to MANO

Plugtest Setup


During Plugtest

Week 1 – Local infrastructure deployment in host’s lab

• Finalise / re-run pre-testing among local and remote implementations

Week 2 – Interoperability Test Sessions

• Min 1 engineer on-site per FUT (even if FUT remote)

• Test Session Schedule generated automatically (fair and balanced)

• TRT allows to record test results and provide a real-time statistical view

• Per test case, test group, configuration, …

• Detailed results remain private to individual participating organisations

• Daily wrap up meetings :

• To discuss issues, workarounds, feedback, .. on specs and test plan

• Any outstanding topic is documented in the Plugtest Report


What it looks like


Test Session Scheduler


Test Sessions IRC channels


Test Reporting Tool


After Plugtest

Final Plugtest Test Plan submitted to ISG NFV (TST)

• As potential input to NFV Interoperability Test Specification

Plugtest Report is finalised, agreed with participants and submitted to ISG NFV:

• List of participants and implementations (FUTs)

• Test Infrastructure

• Integration and pre-testing

• Test Results (aggregated data)

• Per SUT config

• Per Test group

• Per Test case

• Feedback

• On NFV specifications (IFA, TST, …)

• On general IOP issues

• Conclusions and Recommendations


Backup Slides

First NFV Plugtest

Functions Under Test (FUT)


Functions Under Test – VNF

Exposing VNF (& NS) Descriptors • And associated requirements: resources, VNFC interconnection,

configuration methods, …

Supporting integration w/ MANO


Functions Under Test – MANO

Pre-integrated VNFM & NFVO

Exposing data model (templates) to support the test plan (in line w/ NFV IM)

Supporting integration w/ VIM NBIs & VNFs


Functions Under Test – NFVi&VIM

Pre-integrated VIM & NFVI

If to be deployed locally, Max: 1 rack

Minimum of 3 NFV nodes:

• Pre-configured computing nodes (to be used with the pre-integrated VIM)

• Data plane switches

VIM running in a VM or small sever

• Exposing required NBIs to support the test plan

• Supporting integration w/ MANO


etsi nfv plugtest overview

Documents