1 ©2010 HP Created on xx/xx/xxxxof 222

Nick Bastin, Andy Bavier, Jessica Blaine, Joe Mambretti, Rick McGeer, Rob Ricci, Nicki WattsPlanetWorks, HP, University of Utah, NorthwesternMarch 13, 2012

THE INSTAGENI INITIATIVE

2 ©2010 HP Created on xx/xx/xxxxof 222

THE INSTAGENI RACK

• Designed for GENI Meso-scale deployment• Eight 2012 deployments, 24 2013 deployments

• ProtoGENI and FOAM as native Aggregate Managers and Control Frameworks

• Boots to ProtoGENI instance with OpenFlow switch

• Designed for wide-area PlanetLab federation• PlanetLab image provided with boot• InstaGENI PlanetLab Central stood up

• Designed for expandability• Approx 30U free in rack

3 ©2010 HP Created on xx/xx/xxxxof 222 3

THE INSTAGENI RACK

• Designed for easy deployability• Power: 220V L6-20 receptacle• Network: 10/100/1000 Base-T

• Designed for Remote Management• HP iLO on each node

• Designed for flexible networking• 4 1G NICs/node, 48 1G NICs, 4 10G NICs on the OpenFlow

switch

4 ©2010 HP Created on xx/xx/xxxxof 222 4

INSTAGENI RACK HARDWARE

• Control Node for ProtoGENI Boss, ProtoGENI users, FOAM Controller, Image storage…

• HP ProLiant DL 360G7, quad-core, single-socket, dual NIC (1 Gb/sec), 12GB RAM, 4TB Disk (RAID), iLO

• Five Experiment Nodes • HP ProLiant DL 360G7, six-core, dual-socket, quad

NIC (1 Gb/sec), 48GB RAM, 1TB Disk, iLO• OpenFlow Switch

• HP E 6600, 48 1 Gb/s, 4 10 Gb/s• Hybrid mode

5 ©2010 HP Created on xx/xx/xxxxof 222 5

INSTAGENI PLANNED DEPLOYMENT

–GENI funding•8 sites in Year 1•24 sites in Year 2•All in USA

–Other Racks•US: Attempting program with relevant HP units•Abroad: see me.

6 ©2010 HP Created on xx/xx/xxxxof 222 6

INSTAGENI YEAR 1 SITES

7 ©2010 HP Created on xx/xx/xxxxof 222 7

INSTAGENI RACK DIAGRAM

8 ©2010 HP Created on xx/xx/xxxxof 222 8

INSTAGENI RACK TOPOLOGY

9 ©2010 HP Created on xx/xx/xxxxof 222 9

INSTAGENI SOFTWARE ARCHITECTURE

ProtoGENI (Hardware as a Service, Infrastructure as a Service)

FOAM (Networks as a Service)

ProtoGENI Image

ProtoGENI Image

PlanetLab

Image

InstaGENI PLC

Layer 2 and 3 connectivity

GENI L2/L3 Slice

10 ©2010 HP Created on xx/xx/xxxxof 222 10

CONTROL INFRASTRUCTURE

Control / External switch

Data Plane Switch

Control Node: Xen Hypervisor

ProtoGENI “boss”

ProtoGENI “ops”

FOAM

FlowVisor

11 ©2010 HP Created on xx/xx/xxxxof 222 11

(RE)PROVISIONING NODESProtoGENI

SharedProtoGENIExclusive

ProtoGENIExclusive

ProtoGENIExclusive

PlanetLabShared

12 ©2010 HP Created on xx/xx/xxxxof 222 12

GENI INTEGRATION

– Will ship with full support for GENI AM (likely v3)• Updates as GENI APIs evolve

– Support for Tom Lehman’s RSpec stitching extension– Will have local FOAM and FlowVisor instances for OpenFlow

integration– Will start by affiliating with the ProtoGENI clearinghouse– Switch affiliation to the GENI Clearinghouse once up

13 ©2010 HP Created on xx/xx/xxxxof 222 13

SOFTWARE MANAGEMENT

– Frequent control software updates• Rarely affects running slivers• VM snapshots to roll back failed updates• Major software changes, rather than on a set schedule

– All updates done by InstaGENI personnel• (Sites can make local modifications, but this “voids the warranty”)• Testing period on Utah rack first

– Updating disk images• New version of standard images distributed nightly• Voluntary updates for exclusive-use nodes and VM images• Scheduled updates for VM host images• Security updates will be handled differently on case-by-case basis

14 ©2010 HP Created on xx/xx/xxxxof 222 14

OPERATIONS AND MANAGEMENT

– Providing GMOC with:• Visibility into current users and slices• Health and historical data• “Kill switch” credentials for emergency shutdown

– Local administrators get the same access– Automatic verification of slices upon setup• Local admins get mail about hardware failures

– PlanetFlow-based mapping of address/packets to slices

15 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1University of Utah, Princeton University, GPO, Northwestern University,

Clemson University, Georgia Tech , University of Kansas , New York UniversityUniversity of Victoria

GENInet(GENI

Backbone) SL/MREN

MAGPI

NOX

GPNUEN

SOX

NYSERNET

CANARIE

BCNET

MAX

16 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1University of Utah

GENInet(GENI

Backbone) SL/

MREN

UEN MAX

17 ©2010 HP Created on xx/xx/xxxxof 222

University of Utah

18 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1Princeton University

GENInetSL/MREN

MAGPI

19 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1Princeton University

Princeton University Campus Network

MAGPI

Internet2 ION

L2 Path or L3 Tunnel

VLAN 1750

InstaGENI RackWith OF SW

20 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1GPO

GENInet(GENI

Backbone) SL/MREN

NOX

VLAN 1750

InstaGENI RackOF SW

21 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1Northwestern University

GENInet(GENI

Backbone) SL/MREN

InstaGENI RackOF SW

22 ©2010 HP Created on xx/xx/xxxxof 222

StarLight/MREN

University of IllinoisUrbana

Champaign

I2 at StarLight

ESnet at StarLight

GENInet atStarLight/MREN Facility

MRENE1200lSwitch

OpticalSwitch

ICCN/I-WIRE

StarLightE1200Switch

NLRAt

StarLightOpticalSwitch

I2ION

ESnet

OpticalSwitch

Multiple EU, Asian, South

American Sites

NDDI

DYNES

InstaGENI RackWith OF SWiCAIR

GENI OF SW

iCAIR

Multiple National Regional,

State Net Connections

23 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1

Clemson University, Georgia Tech GENInet

(GENI Backbon

e) SL/MREN

SOX

InstaGENI RackWith OF SW Georgia Tech

InstaGENI RackWith OF SWClemson

2*10 G

24 ©2010 HP Created on xx/xx/xxxxof 222

25 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1New York University

GENInet(GENI

Backbone) SL/MREN

NYSERNET

26 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1New York University

New York University Campus Network

NYSERNET

Internet2 ION

L2 Paths

VLAN 1750

InstaGENI RackWith OF SW

NLR

27 ©2010 HP Created on xx/xx/xxxxof 222

InstaGENI Sites and Network: Y1University of Victoria

GENInet(GENI

Backbone)

SL/MREN

BCNET

CANARIE

28 ©2010 HP Created on xx/xx/xxxxof 222

StarLight/MREN

I2 at StarLight

CANARIE StarLight

GLIF GOLEMRENE1200lSwitch

OpticalSwitch

StarLightE1200Switch

NLRAt

StarLightOpticalSwitch

I2ION

GLIF

OpticalSwitch

NDDI

DYNES

InstaGENI RackWith OF SW

GENI OF SWUniversity of

Victoria

CANARIEBCNET

UniversityOf Victoria

Campus Network

VLAN 1750

VLAN 1750

VLAN 1750 VLAN 1750

VLAN 1750

29 ©2010 HP Created on xx/xx/xxxxof 222

Selected Other Interconnections

30 ©2010 HP Created on xx/xx/xxxxof 222

THANKS!