federica federated e-infrastructure supporting research experiments on new internet architectures...

27
WWW.FP7-FEDERICA.EU FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next steps Mauro Campanella - GARR mauro.campanella@garr.it APAN 29th - Sydney 10th February 2010

Upload: jared-thompson

Post on 25-Dec-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

WWW.FP7-FEDERICA.EU

FEDERICAFederated e-Infrastructure supporting research experiments on new

Internet architectures and protocols

Experience and next steps

Mauro Campanella - GARR

[email protected]

APAN 29th - Sydney 10th February 2010

Page 2: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

2FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUAgenda

– FEDERICA– introduction and user requirements– Framework, architecture– Infrastructure status– Service model, how to access– challenges

– Federating FEDERICA

– Evolution and Conclusions

Page 3: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

3FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFEDERICA at a glance

What: European Community co-funded project in its 7th Framework Program in the area “Capacities - Research Infrastructures”, 3.7 MEuro EC contribution, 461 Person Months

When: 1st January 2008 - 30 June 2010 (30 months)

Who: 20 partners, based on stakeholders on network research and management: 11 National Research and Education Networks, DANTE (GÉANT), TERENA, 4 Universities, Juniper Networks, 1 small enterprise (MARTEL), 1 research centre (i2CAT) - Coordinator: GARR (Italian NREN)

Where: Europe-wide e-Infrastructure, open to external connections

Page 4: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

4FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFEDERICA

Deploy and manage an e-Infrastructure (FEDERICA) based on virtualization in both computers and network elements as a fundamental tool/playground for researchers on current and Future Internet, its uses and technologies.It allows researchers a complete control of their set of resources (a “slice”), poses a minimum number of constraints and enables disruptive experiments at all communication layers over a realistic substrate.

Router/Switch

Host for Virtual nodes

Ethernet 1 Gbps

Particular care is placed in reproducibility of the experiments and in the avoidance of complexity.

Page 5: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

5FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFEDERICA Framework

The infrastructure requirements brought to 2 key framework choices for the infrastructure, at the core of design:

1. The simultaneous presence of computing and network physical resources. These resources form the substrate of the infrastructure.

2. The use of virtualization technologies applied both to computing and network resources. Virtualization will allow creating virtual, un-configured resources.

Framework is compatible with the Infrastructure as a Service (IaaS) paradigm of “clouds”, including the network layers and it may offer also other services (e.g. PaaS and AaaS).

Page 6: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

6FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFEDERICA - Current Architecture

Two levels:

1. The virtualization substrate. The physical infrastructure which contains all the hardware and software capable to create the virtual resources.

2. The level containing all virtual infrastructures (slices). Each slice contains a set of virtual resources and their network topology.

Two elementary resource entities:

1. Connectivity. In form of a bit pipe (point to point circuit) with or without capacity guarantees and with or without a data link protocol.

2. A computing element and its attributes, offering the equivalent of a computer hardware containing at least RAM, CPU and one network interface, mass storage is optional. The computing element is capable of hosting various operating systems and perform also functionalities (e.g. routing). This is different from “Clouds” where storage is considered an independent entity.

Page 7: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

7FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EU

Infrastructure Status is up and running

All links are 1 Gbps Ethernet

GARRIT

DFNDE

CESNETCZ

SWITCHCH

Red.esES GRNET

ICCS GR

HungarnetHU

PSNCPL

HEAnetIE

i2CATES

KTHSE

NORDUNET

SUNET

FCCNPT

Each PoP hosts one or more large PC and a network switch/router

Page 8: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

8FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUThe Core Substrate - HW

Router / Switch: Juniper MX480, Dual CPU, 1 line card with 32 ports at 1Gb Ethernet. Virtual and logical routing, MPLS, VLANs, IPv4, IPv6, 2 of the 4 line cards have hardware QoS packet-based capabilities

V-Nodes:each is a 2 x Quad core AMD @ 2GHz, 32GB RAM, 7+1 network interfaces, 2x500GB disks, VMware ESXi 3.5

FEDERICA substrate

Page 9: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

9FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUThe Core Substrate - IP

Management plane is a single IP Autonomous System:

AS 47630 : (public, no transit, all 4 core nodes peer with local NRENs which announce the AS to GN2 and

Global Internet) active

IP v4 : 194.132.52.0/23 (public addresses) active

IP v6 : (ready - under tests)

FEDERICA substrate

NRENs andGlobal Internet

Page 10: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

10FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUThe basic service model

The FEDERICA basic service (create “virtual infrastructures” with full user control) is only lightly dependent on the underlying architecture.

The project made a choice to have two characteristics of the service that imply manual intervention in the initial phase of user access :- the User Policy Board to accept, register, prioritize and counsel the users’ proposals (AAI is included here)

- the overall reproducibility requirement which requires a manual mapping from physical to virtual resources. Advanced brokers / technologies / overprovisioning may overcome this limit (see ongoing work in clouds).

Once the user has access to his slice he has full control.

Page 11: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

11FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EU

Virtual Internet

Virtual to Physical resource mapping

The step to map to the physical resources the virtual resources has been chosen to be performed manually in FEDERICA.

The motivations are:

- the request to ensure reproducibility - optimization of the use of the infrastructure.

Page 12: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

12FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFEDERICA versus other projects Project:

Feature:

Onelab2/

PlanetlabEmulab FEDERICA

Allowed Operating system

fixed fixedUser’s choice

(almost any)

Control of lower layers

No emulationcontrol down to

raw Ethernet

IP Mandatoryused to connect then emulation

Used to connect, then not needed

Choice of physical delay and capacity

No, unless in SW emulationYes

(up to 1 Gb)

reproducibility guarantees

No emulation Yes

User access

limitations

Almost none,

at any time

Almost none,

at any timeregulated by a User

Policy Board

Cost limited none none

Scalability medium/large large limited

Page 13: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

13FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUHow To Request Access

A user information pack is available in the web site, containing :

– Simple Memorandum of Understanding (*)

– Acceptable User Policy, Access Rules

– Guide for proposals, brief Introduction to FEDERICA

– Technical template(*), feedback template

Requests have to be addressed at

fed-upb (at) fp7-federica.eu

Information can be requested at

info (at) fp7-federica.eu

(*) mandatory documents

Page 14: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

14FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUResearch areas (Challenges)

There are a some key challenges for the evolution of the project and tightly connected to virtualization :

1. “Real” versus “Virtual”, i.e. reproducibility/QoS

2. Virtualization service definition and automation of procedures, in particular resource mapping.

3. Federation

4. Complexity

These areas are coupled through e.g. definition and standardization of resources, control, management and monitoring, security and policies for resiliency.

Page 15: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

15FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUResearch areas: Real v.s. Virtual

The reproducibility and the stability in time of the behaviour of the virtual resources is a fundamental requirement for quantitative evaluations of new ideas. As an example, a virtual circuit may not be capable of offering a constant, fixed amount of bit per second, and a virtual computer image may not provide a constant CPU percentage and/or a constant disk access capacity.

The quality of a virtual resource can then be defined as the measured reproducibility and stability of its behaviour when external conditions change (e.g. a virtual machine is added or the total network traffic increases).

The difference between the behaviour of the virtual and the physical resource is another parameter which may be considered as a scale factor. Yet the virtual machine may have a good “quality” even if it underperforms the specifications.

Page 16: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

16FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUAgenda

– FEDERICA– introduction and user requirements– Framework, architecture– Infrastructure status– Service model, how to access– challenges

– Federating FEDERICA

– Evolution and Conclusions

Page 17: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

17FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFederating FEDERICA

Proposal to differentiate between various forms of federation:

1. integrated ( the facilities can be used as one with a inter-domain common control plane)

2. partially integrated (only part of the control is exchanged, e.g. calendar, AAA information)

3. overlay (each facility just uses the services of the other without a common control plane, just a data plane. here Exchange of information related to monitoring, faults, and so on is possible)

All these types present challenges.

Page 18: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

18FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFederating FEDERICA (cont)

Issues for federations:

Having a common control plane in a multidomain environment is very difficult, as it places many constraints to each facility (in time, technology and developments) (Integrated)

Need to develop standard resources representation schemas for virtual resources and virtual resource sets to exchange services. The inter-facility exchange of information and synchronization between facilities has to scale gracefully (all schema).

The Intra-facility control plane is complex, due to resource scheduling and resources mapping from virtual topology (slice) to physical topology, especially if reproducibility or guarantees are mandated. (all schema, related to dynamic provisoning)

Page 19: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

19FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EU

FEDERICA - Onelab pre-federation(overlay)

FEDERICA substrate

NRENs andGlobal Internet

Onelab Slice

OneLab nodes can be hosted in a slice. Those node have full control of their network interface and circuits up to the egress from FEDERICA into General Internet.

Page 20: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

20FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFederating slices, e.g.

FEDERICA substrate (only CORE is shown)

NRENs andGlobal Internet

User’s management slice (VLAN)

FEDERICA can create a slice containing fully meshed routers.The test topology between them can be chosen by the user enabling or disabling interfaces on the routers.

Virtual routers’ slice

Page 21: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

21FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFederating FEDERICA plans

- Continue to federate at the slice level in the overlay model

- Consider brokering slices (need to understand SLA) and extend collaboration to other projects

- Evaluate challenges of federating at the substrate level. The main issue is the virtual resources mapping to the physical substrate (reproducibility).

- Agree and develop federated monitoring and resource representation

- Discuss user's requirements for physical interconnection including the optical layer

Page 22: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

22FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUAgenda

– FEDERICA– introduction and user requirements– Framework, architecture– Infrastructure status– Service model, how to access– challenges

– Federating FEDERICA

– Evolution and Conclusions

Page 23: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

23FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EU

Proposed e-Infrastructure evolution(under evaluation)

FEDERICA

GARRIT

DFNDE

CESNETCZ

SWITCHCH

Red.esES GRNET

ICCS GR

HungarnetHU

PSNCPL

HEAnetIE

i2CATES

KTHSE

NORDUNET

SUNET

FCCNPT

II

Univ. of ESSEX

JanetUK

RENATERFR

University of Essex as advanced optical PoP

Page 24: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

24FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUConclusions

For Future (and present) Internet research and evolution, FEDERICA-like infrastructures, enable innovative paths, exploiting virtualization both in computers and networks.

FEDERICA creates virtual infrastructures, behaving almost like real ones, which can be seen as generalised, “cloud” infrastructures. The user access is simple from any place connected to Internet. Universities, Private Enterprises even schools may benefit from such ready-to-use environment.

Many challenges and research areas are still to be explored, analyzed to create a common set of standards.

Virtualization facilitates and draws a smoother path to federation too.

Page 25: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

25FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUMore Information

Main source of information is http://www.fp7-federica.eu (all deliverables and documents, user access portal redirection)

1. July 2008 - EURESCOM mess@ge, issue 2/2008, "The FEDERICA Project - A federated infrastructure for Future Internet research" - page 11

2. Dae Young Kim, Laurent Mathy, Mauro Campanella, Rick Summerhill, James Williams, Shinji Shimojo, Yasuichi Kitamura, Hideaki Otsuki, "Future Internet: Challenges in Virtualization and Federation," aict, pp.1-8, 2009 Fifth Advanced International Conference on Telecommunications, 2009, Venice/Mestre, Italy, May 24-May 28, ISBN: 978-0-7695-3611-8

3. P. Sezgedi, S. Figuerola, M. Campanella, V. Maglaris, C. Cervello-Pastor: "With Evolution for Revolution: Managing FEDERICA for Future Internet Research", IEEE Communications Magazine Vol.47 No.7 pp. 34-39, July 2009

4. M.Campanella, "The FEDERICA Project: creating cloud infrastructures", In Proceedings of Cloudcomp 2009 (CloudComp), October 19-21, 2009, Munich, Germany. ISBN 978-963-

9799-77-6,

Page 26: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

26FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EUFEDERICA Consortium

National Research & Education NetworksCESNET Czech Rep.DFN GermanyFCCN PortugalGARR (coordinator) ItalyGRNET GreeceHEAnet IrelandNIIF/HUNGARNET HungaryNORDUnet Nordic countriesPSNC PolandRed.es SpainSWITCH Switzerland

Small EnterpriseMartel Consulting Switzerland

NRENs organizationsTERENA The NetherlandsDANTE United Kingdom

Universities - Research Centersi2CAT SpainKTH SwedenNTUA (ICCS) GreeceUPC SpainPoliTO Italy

System vendorsJuniper Networks Ireland

Page 27: FEDERICA Federated e-Infrastructure supporting research experiments on new Internet architectures and protocols Experience and next

27FEDERICA APAN 29th, Sydney, 10th March 2010

WWW.FP7-FEDERICA.EU

Thank youfor your attention