future internet research and cloud computing€¦ · icclab cloud second swiss openstack...

47
Future Internet Research and Cloud Computing Thomas Michael Bohnert, Christof Marti, Andy Edmonds www.cloudcomp.ch ICCLab

Upload: others

Post on 20-May-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Research and Cloud Computing

Thomas Michael Bohnert, Christof Marti, Andy Edmonds

www.cloudcomp.ch

ICCLab

Page 2: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

www.cloudcomp.ch

„The Internet is broken.“David D. Clark, MIT

In an article in MIT Technology Review, 2005

ICCLab

Page 3: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

ICCLab www.cloudcomp.ch

Page 4: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

ICCLab

Europe USA

www.cloudcomp.ch

Page 5: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

ICCLab

Appr 5B Euro investment in R&D worldwide over the past 7years

Switzerland?

www.cloudcomp.ch

Page 6: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

ICCLab www.cloudcomp.ch

Page 7: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

ICCLab

In Europe roughly 100 concurrent Future Internet projects (challenge one alone)

www.cloudcomp.ch

Page 8: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Future Internet Genesis

ICCLab

Very good, but: The (Future) Internet is no set of individual domains

Hence:How to consolidate existing research results into a

Future Internet

www.cloudcomp.ch

Page 9: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

The Future Internet PPP

ICCLab www.cloudcomp.ch

Page 10: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

The Future Internet PPP

ICCLab www.cloudcomp.ch

Page 11: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Switzerland andthe Future Internet PPP

ICCLab

Total funding : 2.2 MEuro (based on proposal data)

ABB Schweiz AGZurich University of Applied Sciences (ZHAW)

IBM Research (USA)Kuehne + Nagel (DE)Walt Disney Studios Schweiz (USA)Martel Consulting (UK)

www.cloudcomp.ch

Page 12: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

The Future Internet PPP

ICCLab

Mind: It's a Public-Private Partnership

Pub-Priv power sharing ...

… unique opportunity

… (nearly) lost opportunity

www.cloudcomp.ch

Page 13: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

The Future Internet PPP

ICCLab

… lost opportunity …

… only nearly ...

www.cloudcomp.ch

Page 14: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

The Future Internet PPP

ICCLab

Cloud Computing : very prominent in the FI-PPP

www.cloudcomp.ch

Page 15: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

The Future Internet PPP

ICCLab

Cloud Computing : A Swiss Strength

www.cloudcomp.ch

Page 16: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Cloud Computing Swiss Perspective

Many more: www.cloud-finder.ch

www.cloudcomp.chICCLab

Page 17: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Cloud Computing Swiss Perspective

www.cloudcomp.chICCLab

Page 18: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Cloud Computing Swiss Perspective

Cloud Service Center in Zurich

Many more: www.cloud-finder.ch

Develops OpenShift in Switzerland

Cloud evangelist in Zurich CloudStack evangelist in Geneva

Cloud Center in Zurich

CloudFoundry evangelist in Geneva

www.cloudcomp.chICCLab

Page 19: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Cloud Computing Swiss Academic Perspective

Slowly building momentum

Mind: Cloud Computing result of applied research

www.cloudcomp.chICCLab

Page 20: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Proposal: Cloud Computing SIG

Cloud Computing: Swiss Group for Infrastructure, Platform, and Software-as-a-Service

www.cloudcomp.chICCLab

Page 21: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Proposal: Cloud Computing SIG

Cloud Computing: Swiss Group for Infrastructure, Platform, and Software-as-a-Service

Dieses Gruppierungsreglement wurde an der SI-Generalversammlung vom 7. Mai 2012 in Bern zusammen mit der SI-Statutenänderung genehmigt und in Kraft gesetzt.

www.cloudcomp.ch

Page 22: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Proposal: Cloud Computing SIG

Cloud Computing: Swiss Group for Infrastructure, Platform, and Software-as-a-Service

Proposed next steps

December 2012 Proposal and evaluationFebruary 2013 Initial members of CC SIG identifiedFebruary 2013 Initial draft of CC-SIG mission statementMarch 2013 Governance structure establishedMarch 2013 Formal integration into SI completedApril 2013 Kick-off Meeting (KOM)April 2013 Mission statement approved and publishedApril 2013 Liaisons with Swiss OpenStack User Group, /CH-Open/SwissICT

www.cloudcomp.chICCLab

Page 23: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Questions

http://linkd.in/os-ugch @openstackch

Swiss OpenStack User Grouphttp://tinyurl.com/bpd4jab

www.cloudcomp.chICCLab

Page 24: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Backup

www.cloudcomp.chICCLab

Page 25: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

ICCLab Applied Research Approach

www.cloudcomp.ch

“From Research Themes

to Projects creating Impact

and Transferfor Educational Excellence”

Page 26: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Research Themes and Assets

www.cloudcomp.ch

Dependable Cloud, Interoperable Cloud

Infrastructure as a Service Platform as a Service Mobile Cloud Computing

Rating, Charging, Billing

SDN for Clouds

Open Cloud Computing Interface

Hadoop as a Service

Virtualization and Performance

Cloud Automation

Cloud Monitoring

Cloud Resource Orchestration

Object-based Storage Efficient Cloud Middleware

Research Activities and Assets

Themes

Page 27: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

ICCLab Cloud

Second SWISS OpenStack Proof-of-Concept (next to CERN)

Fully operational Cloud (IaaS)

● Computing units, 8×2.4 Ghz Cores, 64GB RAM and 4×1TB local storage per unit.

● 12TB NFS or iSCSI Storage

● 10Gbit Ethernet (data) 1Gbit (ctrl)

www.cloudcomp.ch

Open Cloud Computing Interface

Hadoop as a Service

Cloud Monitoring

Object-based Storage

Page 28: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

ICCLab IaaS Deployment

www.cloudcomp.ch

Page 29: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Commercial Cloud Provider

www.cloudcomp.ch

Page 30: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Challenges

Diversity

Availability

www.cloudcomp.ch

Page 31: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

IT Department

Developer

User

Tech Skill, Control

Ease of Use, Reliance

Considerations

www.cloudcomp.ch

Page 32: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Threats

Lock-in

www.cloudcomp.ch

Page 33: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Alternatives

Open Source &

Open Standards

www.cloudcomp.ch

Page 34: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Cloud Computing Enablement

Open Source• Xen, Xen Cloud Platform (XCP)

• KVM – Kernel-based Virtualization

• VirtualBox - Oracle supported Virtualization Solutions

• OpenVZ - Container-based, Similar to Solaris Containers or BSD Zones

• LXC – User-space chroot’ed installs

www.cloudcomp.ch

Page 35: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Open Source Software-as-a-Service

Very fuzzy …

Is Hotmail a Cloud Service? → Cloud Washing!

www.cloudcomp.ch

Page 36: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Genesis Sponsors Supported Plattforms

2011 VMware

Java/Spring, Node.js, Grails, Ruby/Rails, Ruby/Sinatra, *)

2011 RedHat

JavaEE6/JBoss, Ruby, PHP, Python, Perl, Node.js

2010 WSO2 JavaEE6, JBoss

2011 Joyent Node.js

OSS Platform-as-a-Service

*) some derived products (AppFog, Stackato,...) also support PHP, Perl, Python, Erlang, Scala, Clojure, .Net

www.cloudcomp.ch

Page 37: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Genesis License Supported Hypervisors

2006 GPL Xen, KVM, VMware*

2008Apache 2 (since 2012)

Xen, KVM, VMware, OracleVM

2008 Apache 2 Xen, KVM, VMware

2010 Apache 2

Xen, KVM, VMware, VirtualBox, Hyper-V, qcow2

OSS Infrastructure-as-a-Service

*) not in OpenSource Version www.cloudcomp.ch

Page 38: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Genesis of OpenStack

Oct, 2012:OpenStack 2012.2 (Folsom)

Delivers Pluggable Cloud Operating System to Power Global Clouds

with Powerful Networking, Compute, and Storage Capabilities

Page 39: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

OpenStack Architecture

Everything has an API

Message based

Discrete Pluggable

Components

www.cloudcomp.ch

Page 40: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Key Component: Compute

• Nova: Provides virtual servers on demand

– KVM, Xen, VMware, HyperV, VirtualBox,LXC

• Looks after scheduling, networking & Block Storage

www.cloudcomp.ch

Page 41: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Key Component: Image

• Glance: Virtual Machine Image Registration and Storage

– Storage via pluggable backends

www.cloudcomp.ch

Page 42: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Key Component: Object Storage

• Swift: Store & Retrieve data

• Data (objects) are stored in buckets (containers)

• Eventually consistent design

www.cloudcomp.ch

Page 43: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Key Component: Identity

• Keystone: authentication and authorization

– all the OpenStack services.

• Service type catalog of services.

• Pluggable front and back ends

www.cloudcomp.ch

Page 44: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Key Component: Dashboard

• Horizon: A modular web-based user interface for all the OpenStack services

• Core functionality

– Other via cmd. line

www.cloudcomp.ch

Page 45: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Usable ... Useful ... Used

www.cloudcomp.ch

Page 46: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

Commercially relevant?

46%

19%

27%

IaaSStorage as a ServiceIT Management as a ServicePaaS

Estimated 2012 Cloud Revenue Breakdown by Subsector – Total $4.3bn (220+ vendors)Source: Cloud Adoption in the Enterprise:

From the Playground to ProductionWilliam Fellows, VP Research, 451 Research

www.cloudcomp.ch

Page 47: Future Internet Research and Cloud Computing€¦ · ICCLab Cloud Second SWISS OpenStack Proof-of-Concept (next to CERN) Fully operational Cloud (IaaS) Computing units, 8×2.4 Ghz

How can YOU take part?

Swiss OpenStack User Group!

Join in!

http://linkd.in/os-ugch

@openstackch

www.cloudcomp.ch