federating experimental platforms as a playground for the future internet

Federating experimental platforms as a playground for the future

internet

Serge Fdidahttp://www-rp.lip6.fr/~sf/

UPMC – Sorbonne UniversitésLaboratoire LIP6 – CNRS

France

FIBRE Workshop- Salvador - Nov 27 2012 1

Past and current testbeds success

FIBRE Workshop- Salvador - Nov 27 2012 2

● Do you/we TRUST the results that you/we produce?

● Can you REPRODUCE the conditions for which you obtained these results, or reproduce the results? Or check the robustness of your assumptions?

● Which Solution(s)?

Simulation, Emulation, Testbeds

● A testbed for what type of problem?

One or multiple testbeds?

● What about the environment?

Monitoring, Control and Experimental plane

Why?

FIBRE Workshop- Salvador - Nov 27 2012 3

What is our target?Can we achieve this?

FIBRE Workshop- Salvador - Nov 27 2012 4

Or this, eg FEDERATION

Overlays

Services

Optical

Sensors

Multi-Hopradio

FIBRE Workshop- Salvador - Nov 27 2012 5

Some possible scenario ….

FIBRE Workshop- Salvador - Nov 27 2012 6

The Polymorphic Internet : Some Internet Future(s)

• The Network is a Database (“CCN”)

• The (Access) Network is The (Access) Network is WirelessWireless

• The Network is the People

• The Network is a global Virtualized resource

• And many others … The Social Computer …

• They’re all Federated (Inter-domain)

FIBRE Workshop- Salvador - Nov 27 2012 7

Enabling continuous deployment of New architectures

Virtualized substrate

IP world

Policies

Monitoring

Security/Trust

Federation

FIBRE Workshop- Salvador - Nov 27 2012 8

The Federation Concept!

FIBRE Workshop- Salvador - Nov 27 2012 9

Federation (dictionary definition!)

A federation is a union comprising a number of partially self-governing regions united by a central ("federal") government under a common set of objectives.

FIBRE Workshop- Salvador - Nov 27 2012 10

Why to federate?

● Many benefits …. For users, testbed providers, …

● But also challenges Complexity, Legal and trust issues Policies

● How? Trust testbed owners Describe, control and manage distributed testbeds

resources

● Challenges Modelling and description of the resources Policies, Monitoring, Scheduling, “Scale”, Diversity, …

FIBRE Workshop- Salvador - Nov 27 2012 11

Federation Architecture

● Who is concerned?

● Management Authority

Own the resources

Legal entity

● Operation Engineers

Operate the testbeds and their associated resources

● Experimenters

Motivated by the launch of an experiment across the resources

FIBRE Workshop- Salvador - Nov 27 2012 12

Architecture: Definition (from GENI)

● An aggregate represents a resource or set of resources that can be offered for inclusion in some customer specified topology. These typically fall into the broad categories of Computation, Communication and Storage resources.

● A sliver is a (real or virtual) resource group provided by the aggregate via the “Aggregate Manager” (AM) API.

● A slice is a collection of slivers gathered for a common purpose that are configured into a topology on which to deploy experiments or applications in some degree of isolation from other slices.

FIBRE Workshop- Salvador - Nov 27 2012 13

Federation: main entities

Researchers

Resources

Facility A

Slice Management

Administrative borderAuthority A Authority B

Slice Management

Facility B

FIBRE Workshop- Salvador - Nov 27 2012 14

Federation (1)

Facility A

Slice Management Slice Management

Facility B1. Share user credentials

FIBRE Workshop- Salvador - Nov 27 2012 15

Federation (2,3)

Facility A

Slice Management Slice Management

Facility B1. Share user credentials

2. Share resource descriptions

3. Allow experiments to run across facilities

FIBRE Workshop- Salvador - Nov 27 2012 16

Federation: more than resource integration

Facility A

Slice Management Slice Management

Facility B

Policies

Monitoring

Security

FIBRE Workshop- Salvador - Nov 27 2012 17

PlanetLab nodes worldwide and (insert) PlanetLab nodes located within Europe

PlanetLab Europe testbed

FIBRE Workshop- Salvador - Nov 27 2012 18

PlanetLab Terminology

● Site A site is a physical location where PlanetLab nodes are located (e.g. Fraunhofer Institute or UCL).

● Node A node is a dedicated server that runs components of PlanetLab services.

● Slice A slice is a set of allocated resources distributed across PlanetLab. Slices are assigned to some number of PlanetLab nodes. Slices have a finite lifetime and must be periodically renewed to remain valid.

● Sliver A sliver is a slice running on a specific node. You can use ssh to login to a sliver on a specific node.

● MyPLC: PL control framework

19FIBRE Workshop- Salvador - Nov 27 2012 19

Distributed Virtualization

● As a user you want to isolated from other activities on those nodes on which you run. The PL provides a level of isolation which gives you your own file system, and process control.

● You share CPU cycles and network bandwidth with other active slivers on each node.

● The concept of slice aggregates the presence of your slivers within the system

20FIBRE Workshop- Salvador - Nov 27 2012 20

Nodes

21FIBRE Workshop- Salvador - Nov 27 2012 21

Slices – hujiple_isis

22FIBRE Workshop- Salvador - Nov 27 2012 22

Slices – upmcple_paristr

23FIBRE Workshop- Salvador - Nov 27 2012 23

Slices

24FIBRE Workshop- Salvador - Nov 27 2012 24

Federation (& Legal aspects)

● Local consortium agreement defines responsibilities and liabilities of each partner

● Federation integrates the consortiums into a seamless global authority

● Formal Trust Relationships are the basis for this integration

25FIBRE Workshop- Salvador - Nov 27 2012 25

Global Federation

26

UPMC

EuropePLC

USAPLC

JapanPLC

Princeton

Kyoto

FIBRE Workshop- Salvador - Nov 27 2012 26

In Practice …

What is SFA, OMF, MySlice, …

FIBRE Workshop- Salvador - Nov 27 2012 27

Researchers

Testbeds

What researchers want

Researchers

Testbeds

What researchers want

To have access to a testbed

Researchers

Testbeds

What researchers want

To access many instances of thesame type of testbed / resource

Researchers

Testbeds

What researchers want

To access many instances of thesame type of testbed / resource

• For geographic diversity• For reproducing experiments

Researchers

Testbeds

What researchers want

To access different types oftestbeds and resources

Researchers

Testbeds

What researchers want

To access different types oftestbeds and resources

• For combined experiments• For moving between simulation,

emulation, and the real-world

Researchers

Testbeds

What researchers want

Authority

Researchers

Testbeds

What researchers want

Administrative simplicity:A single place to sign upin order to use all the testbeds

Authority

Researchers

Testbeds

What researchers want

Experimentcontrol tool

Researchers

Testbeds

What researchers want

Ease of access:The ability to use a smallnumber of familiar tools toaccess and control the testbeds

Experimentcontrol tool

Researchers

Testbeds

Where we were recently

Authorities

Tools

Researchers

Testbeds

Where we were recently

Authorities

Tools

✗

Researchers

Testbeds

Where we were recently

Authorities

Tools

✗ ✗ ✗

Researchers

Testbeds

Where we were recently

Authorities

Tools

✗ ✗✗

Researchers

Testbeds

Impossible to agree on whowill be the single trustedauthority at a global scale

Problems to be solved

Researchers

Testbeds

Impractical to scale asingle database to globalscale

Problems to be solved

Researchers

Testbeds

A secure and distributedthin waist

Common API

Researchers

Testbeds

SFA aims to provide a secure common API with the minimum possible fonctionality to enable a global testbed federation

SFA: Slice Facility Architecture

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Authenticate

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Resource discovery

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Resource reservation

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Configure resources

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Run experiment

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Repatriate results

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Release resources

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Authenticate Yes*

*This is at the heart of SFA

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Resource discoveryYes*

*Without going into all details

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Resource reservationYes

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Configure resourcesNo*

*Use the tool of your choice

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Run experimentNo*

*Use the tool of your choice

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Repatriate resultsNo*

*Use the tool of your choice

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Release resourcesYes

Naming (slices, users, resources, authorities)

Hierarchical naming space

Authentication and authorization

X.509 certificates and signed credentials

Federation links through the exchange of certificates

Resource descriptions (RSpecs)

Only the language (XML) not the semantics

Standard API (XMLRPC)

To manage objects (users, resources, slices, authorities)

To manage resources (browse, acquire, manifest)

To manage slices (create, delete, start, stop)

60 SFA

FIBRE Workshop- Salvador - Nov 27 2012 60

OMF supports users over the full cycle of their experiments, from description to instrumentation, to

execution and measurement collection and visualization.

OMF/OML software

FIBRE Workshop- Salvador - Nov 27 2012 61

● A common abstraction to help the user browse through and interact with a large amount of data and sources

● Grounded on related work on data integration and large dataset navigation.

● Formulate semantic queries, requesting ltering and annotations

● Propose enhanced visualizations on received results

● Allow to balance homogeneity and heterogeneity in the GUI

MySlice

FIBRE Workshop- Salvador - Nov 27 2012 62

MySlice

FIBRE Workshop- Salvador - Nov 27 2012 63

FIBRE Workshop- Salvador - Nov 27 2012 64

FIBRE Workshop- Salvador - Nov 27 2012 65