exploring networks of the future...sponsored by the national science foundation geni introduction 21...

34
Sponsored by the National Science Foundation GENI Exploring Networks of the Future www.geni.net

Upload: others

Post on 25-Aug-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation

GENI Exploring Networks of the Future

www.geni.net

Page 2: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 2 GENI Introduction www.geni.net

Outline

What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

Page 3: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 3 GENI Introduction www.geni.net

GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Presenter
Presentation Notes
GENI is a nationwide suite of infrastructure for�“at scale” experiments in networking, distributed systems, security, and novel applications.� GENI opens up huge new opportunities Leading-edge research in next-generation internets Rapid innovation in novel, large-scale applications Key GENI concept: slices & deep programmability Internet: open innovation in application programs GENI: open innovation deep into the network
Page 4: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 4 GENI Introduction www.geni.net

GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Presenter
Presentation Notes
GENI is a nationwide suite of infrastructure for�“at scale” experiments in networking, distributed systems, security, and novel applications.� GENI opens up huge new opportunities Leading-edge research in next-generation internets Rapid innovation in novel, large-scale applications Key GENI concept: slices & deep programmability Internet: open innovation in application programs GENI: open innovation deep into the network
Page 5: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 5 GENI Introduction www.geni.net

Multiple GENI Experiments run Concurrently

Resources can be shared between slices

Experiments live in isolated

“slices”

Page 6: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 6 GENI Introduction www.geni.net

GENI is “Deeply Programmable”

I install software I want throughout my network slice (into routers, switches, …) or control

switches using OpenFlow

OpenFlow part of the experiment not only the infrastructure

Presenter
Presentation Notes
Experimenters set up custom: topologies protocols forwarding
Page 7: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 7 GENI Introduction www.geni.net

GENI Compute Resources

GENI Racks GENI Wireless compute nodes

Existing Testbeds

Emulab

Planetlab

ORBIT

Page 8: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 8 GENI Introduction www.geni.net

Creating and deploying GENI racks

Ilia Baldine RENCI More resources / rack, fewer racks

Rick McGeer HP Labs

Fewer resources / rack, more racks

Latest addition

Rajesh Narayanan DELL

KC Wang Clemson

Page 9: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 9 GENI Introduction www.geni.net

GENI Networking Resources

Networking within a Rack

National Research Backbones (e.g. Internet2)

Regional Networks (e.g. CENIC)

WiMAX Base Stations

4G/3G GENI network

Page 10: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 10 GENI Introduction www.geni.net

Federation GENI grows by GENI-enabling heterogeneous infrastructure

Avoid technology “lock in” and grow quickly by incorporating existing infrastructure

Backbone #1

Regional

GENI Rack

GENI Rack

Access #1

Commercial Clouds

Corporate GENI suites

Non-US Testbeds

Research Testbed

Campus

My experiment runs across the evolving GENI federation.

My GENI Slice

This approach looks remarkably familiar . . .

Page 11: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 11 GENI Introduction www.geni.net

GENI Architecture

• Flexible network / cloud research infrastructure

• Also suitable for physics, genomics, other domain science

• Distributed cloud (racks) for content caching, acceleration, etc.

Metro Research

Backbones

Internet ISP U N I V E R S I T YU N I V E R S I T Y

U N I V E R S I T YU N I V E R S I T Y

Regional Networks Campus

g

g

g Legend

GENI-enabled hardware

Layer 3 Control Plane

Layer 2 Data Plane

Page 12: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 12 GENI Introduction www.geni.net

Current GENI buildout

• More WiMAX base stations with Android handsets

• GENI-enable 5-6 regional networks

• Inject more OpenFlow switches into Internet2

• Add GENI Racks to 50-80 locations within campuses, regionals, and backbone networks

GENI Racks serve as programmable routers, distributed clouds, content

distribution nodes, caching or transcoding nodes, etc

Page 13: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 13 GENI Introduction www.geni.net

GENI Operations

GMOC: GENI Meta-operation Center • Keeps track of outages • Notification system for resource reservation • Monitors most GENI Aggregates

GMOC Google Calendar keeps track of reservations/outages

Page 14: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 14 GENI Introduction www.geni.net

Federation Extends the Reach of GENI and International Peer Testbeds

Initial plan to federate testbeds on five continents

Page 15: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 15 GENI Introduction www.geni.net

Testbeds Involved

Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/GEC18_brecht_vermeulen_International_Fe

deration.pdf

Page 16: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 16 GENI Introduction www.geni.net

Outline

What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

Page 17: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 17 GENI Introduction www.geni.net

How is GENI being Used?

Research • Future Internet

architectures • Software defined

networking • Large scale evaluation of

smart grid protocols

Education • Over 50 classes using

GENI in all levels • Networking and

Distributed systems classes

• Cloud computing classes • WiMAX classes

As of October 2014, GENI has over 2700 users!

Page 18: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 18 GENI Introduction www.geni.net

Outline

What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

Page 19: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 19 GENI Introduction www.geni.net

GENI: Terms and Definitions

– An experiment uses resources in a slice

– Slices isolate experiments

– Experimenters are responsible for their slices

Slice Abstraction for a collection of resources capable of running experiments

Page 20: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 20 GENI Introduction www.geni.net

Slice credentials

Clearinghouse and Aggregates

• Clearinghouse: Manages users, projects and slices – Standard credentials shared via custom API or new Common CH API – GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH

• Aggregate: Provides resources to GENI experimenters – Typically owned and managed by an organization – Speaks the GENI AM API – Examples: PlanetLab, Emulab, GENI Racks on various campuses

Create & Register Slice

Researcher

Aggregate Manager API - listResources - createSliver … Aggregate

Manager Aggregate Resources

users

slices

clearinghouse

projects

Tool

Page 21: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 21 GENI Introduction www.geni.net

GENI: Terms and Definitions

• A slice : One or more resources provided by an aggregate – E.g. Bare machines, virtual machines, VLANs

Backbone #1

Backbone #2

GENI Rack #3

GENI Rack #2

Access #1

Commercial Clouds

Corporate GENI suites

Other-Nation Projects

Research Testbed

GENI Rack #1

My GENI Slice

My slice contains slivers from many aggregates.

Page 22: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 22 GENI Introduction www.geni.net

Resource Specifications (RSpecs)

• RSpecs: Lingua franca for describing and requesting resources – “Machine language” for negotiating resources between experiment

and aggregate – Experimenter tools eliminate the need for most experimenters to

write or read RSpec

<?xml version="1.0" encoding="UTF-8"?> <rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node> </rspec> RSpec for requesting a single node

Page 23: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 23 GENI Introduction www.geni.net

Resource Reservation using RSpecs and the AM API

• Advertisement RSpec: What does an aggregate have?

• Request RSpec: What does the experimenter want? • Manifest RSpec: What does the experimenter have?

Aggregate Manager

Client

ListResources(…)

Advertisement RSpec

CreateSliver(Request RSpec, …)

Manifest RSpec

ListResources(SliceName, …)

Manifest RSpec

Page 24: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 24 GENI Introduction www.geni.net

Outline

What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

Page 25: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 25 GENI Introduction www.geni.net

Access to GENI

For many experimenters: • no new passwords • familiar login

screens

Leverage InCommon for single sign-on authentication

Experimenters from 304 educational and research institutions have InCommon accounts

GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.

Presenter
Presentation Notes
The GENI Portal trusts identity providers who are members of the InCommon federation. Students, faculty and staff will have an account provided by their school (for example, the University of Utah) which they use to access campus resources. They can then use that account to login to GENI as long as their school is a member of InCommon (with some caveats). **This is exactly like using your Facebook or Google account to access other websites.** For those experimenters, there are no new passwords. For all others, we are happy to make you an account on the GPO’s identity provider. Anyone with an account at a supported identity provider (usually your school or employer) can log in, but they will have no privileges If you don’t have such an account, we will make you an account at the GPO Identity Provider You must be a member of a project to do anything interesting
Page 26: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 26 GENI Introduction www.geni.net

NTUA is now federated …

1. Choose National Technical University of Athens from the drop down list

2. Use your NTUA username and password to login

Presenter
Presentation Notes
The GENI Experimenter Portal is fundamentally about managing experimenters, projects and slices (we’ll define these terms in a minute). But it also has tools for doing resource reservation. (Note that new tools are being integrated with the Portal all the time.)
Page 27: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 27 GENI Introduction www.geni.net

Putting it all Together: Demo

• Demo – Create a slice – Create a sliver at one

aggregate • Two computers (raw PCs),

connected by a LAN

– Install and run software on the machines

– View output of software – Delete sliver

• Experimenter tool: Jacks

server (VM)

client (VM)

Page 28: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 28 GENI Introduction www.geni.net

Ways to Get Help

• Sign Up for : [email protected]

• Use #geni IRC chatroom

• HowTo pages on the GENI Wiki

http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp

Page 29: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 29 GENI Introduction www.geni.net

Other Important Lists

• geni-announce – GENI news and events

• Experimenters

– Announcements of interest to GENI experimenters

• Experimenter-ops – Announcements about infrastructure maintenance

Full list at: http://groups.geni.net/geni/wiki/GENICommunicationChannels

Page 30: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 30 GENI Introduction www.geni.net

Answer is [email protected]

Have a question?

Sarah Edwards Niky Riga Vic Thomas

which is an email list which only goes to members of the GPO including…

(However, the archive of the list is public)

Presenter
Presentation Notes
Have a question? The answer is always [email protected]. [email protected] goes to a number of friendly faces including Niky, Sarah & Vic. We’ll answer your question or redirect it the appropriate place. Always email [email protected] instead of emailing us directly, as it ensures a more timely response.
Page 31: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 31 GENI Introduction www.geni.net

QUESTIONS?

Page 32: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 32 GENI Introduction www.geni.net

BACKUP SLIDES

Page 33: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 33 GENI Introduction www.geni.net

“At scale” GENI prototype

Campus photo by Vonbloompasha

Build GENI at sufficient scale

Infeasible to build a testbed as big as the Internet

GENI-enabled campuses, students as early adopters

HP ProCurve 5400 Switch

NEC WiMAX Base Station

GENI-enabled equipment

GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks

Page 34: Exploring Networks of the Future...Sponsored by the National Science Foundation GENI Introduction 21 GENI: Terms and Definitions • A slice : One or more resources provided by an

Sponsored by the National Science Foundation 34 GENI Introduction www.geni.net

Current GMOC Operational Support

• Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale)

• Emergency Stop • GENI Experimenter Support • Manage network/systems alarms, outages, maintenances,

– Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem)

• Notifications, Escalation and Reporting • Engineering configuration (Internet2, MOXI, Indiana) and

new Aggregate site, regional and GENI rack turn-up • GMOC Measurement API for GENI Aggregates • Develop new tools for network monitoring and

measurement Modified slide from:

http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC%20Prese

ntation pdf