openstack architecture: past and future

OpenStack Architecture

Past and Future

Ken Pepple Chief Technology Officer http://www.solinea.com

HAPPY 3RD BIRTHDAY

AUTOMATE ALL THE THINGS

About Me

  CTO, Solinea   Former Director of Cloud

Development, Internap Public Cloud

  Author of O’Reilly “Deploying OpenStack”

  OpenStack Code contributor since Bexar release

  Twitter @ken_pepple   IRC kpepple

2

Early Development (Austin – Diablo)

  OpenStack started with Nova and Swift   No interaction between two services until Glance in

Bexar release   Developed completely on Launchpad   My humble first commit

3

commit 16eeac71055ffa9fe0fc7a13032da4e6397121b1 Author: Ken Pepple <[email protected]> Date: Sat Jan 8 17:40:06 2011 -0800 fixed doc make process for new nova version (rev530) mechanism

Bexar/Cactus/Diablo Architecture (2011)

4

ImageCompute

ObjectStorage

Stores images in

Stores disk files in

Conceptual Architecture Logical Architecture

Essex Development

  Web interface released   Centralization of authentication released on

second try when “keystone light” was made the full keystone –  https://lists.launchpad.net/openstack/msg07063.html

  Moved codebase to GitHub

5

Essex Architecture (2012)

ObjectImageCompute

Dashboard

Identity

authenticateswith

authenticateswith authenticates

with

retrieves / stores images in

provides UI forprovides UI forprovides UI for

retrieves/stores disk files in

http://ken.pepple.info

7

OpenStack Object StoreOpenStack Image Service

OpenStack Compute

OpenStackDashboard

OpenStack Identity Service

OpenStack Compute API /

Admin API

keystone(service & admin APIs)

nova-api(OS, EC2, Admin)

nova-consoleauth

nova-cert/objectstore

nova-console

VNC/VMRC

OpenStack Object API

Queue

nova-compute

nova-network

nova-volume

nova-scheduler

novadatabase

volumeprovider

(iSCSI, etc)

OpenStackCompute API

OpenStack Image API

Horizon

OpenStack Image API

identity backend

(kvs, pam, sql, etc.)

swift-proxy

objectcontaineraccount

objectstore

accountDB

containerDB


HTTP(S)

OpenStackObject API

HorizonDatabase

OpenStack Identity API

OpenStack Identity

API

OpenStack Identity

API

OpenStack End Users

OpenStackImage API

Amazon Web Services

EC2 API

OpenStack Identity

API

OpenStack Image API

catalog backend

(kvs, catalog , etc.)

token backend(kvs, memcache,

etc.)

OpenStack Identity

API

hypervisor

libvirt, XenAPI, etc.

HTTP(S)

glance-api

glance-registry

glancedatabase

http://ken.pepple.info/openstack/2011/04/22/openstack-nova-architecture/

Folsom Development

  Development and project pace quickens   Cinder and Quantum (now Neutron) introduced   Major influx of industry vendors support new services

8

Folsom Architecture (2012)

Identity

Dashboard

ImageCompute

ObjectStorage

BlockStorage

Network

Provides UI for

Provides UI for

Provides UI for Provides

UI for

Provides UI for

Provides Auth for

Provides Auth for Provides

Auth for

Provides Auth for

Provides Auth for

Provides Auth for

Provides volumes

for

Provide network

connectivityfor

Stores images in



OpenStack Object StoreOpenStack Image Service

OpenStack Compute

OpenStackDashboard



Admin API


nova-api(OS, EC2, Admin)

nova-consoleauth


nova-console

VNC/VMRC



Queue

nova-compute

nova-network

nova-volume

nova-scheduler

novadatabase


OpenStack Image API

Horizon

OpenStack Image API

identity backend

(kvs, pam, sql, ldap, etc.)

swift-proxy


objectstore

accountDB

containerDB


HTTP(S)

OpenStackObject API

HorizonDatabase


OpenStack Identity

API

OpenStack Identity

API

OpenStack End Users

OpenStackImage API

OpenStack Identity

API

OpenStack Image API

catalog backend(kvs, sql,

etc.)

token backend(kvs, memcache,

etc.)

OpenStack Identity

API

hypervisor


HTTP(S)

Amazon Web Services

EC2 API

OpenStack Network Service

glance-api

glance-registry

glancedatabase

OpenStack Block Storage

OpenStack Block Storage API

cinder-api

cinder-volume

OpenStack Identity

API

quantum-server

quantum plugin(s)

OpenStack Identity

API

cinder-scheduler

cinderdatabase

OpenStack Network API

AMQP

AMQP

networkprovider



policy backend

(rules, custom)

Queue


quantumdatabase

quantum agent(s)

volumeprovider

9 http://ken.pepple.info/openstack/2012/09/25/openstack-folsom-architecture/

Grizzly Development

  No new services   Simplification of some services   Maturing of code on others

–  nova-conductor introduced to isolate nova-compute from database access

10

Grizzly Architecture (2013)

11

Identity

Dashboard

ImageCompute

ObjectStorage

BlockStorage

Network


UI for


UI for

Provides UI for

Provides Auth for


Auth for

Provides Auth for

Provides Auth for

Provides Auth for

Provides volumes

for

Provide network

connectivityfor

Stores images in


http://www.solinea.com

http://www.solinea.com/2013/06/15/openstack-grizzly-architecture-revisited/

OpenStack Object Store

OpenStack Image Service OpenStack Compute

OpenStackDashboard



Admin API


nova-api(OS, EC2, Metadata, Admin)

nova-consoleauth


nova-consolenova-*proxy

VNC/VMRC/Spice



Queue

nova-compute

nova-scheduler

novadatabase


OpenStack Image API

Horizon

OpenStack Image API

identity backend

swift-proxy


objectstore

accountDB

containerDB


HTTP(S)

OpenStackObject API


OpenStack Identity

API

OpenStack Identity

API

Internet

OpenStackImage API

OpenStack Identity

API

OpenStack Image API

catalog backendtoken backend

OpenStack Identity

API

hypervisor


HTTP(S)

Amazon Web Services

EC2 API

OpenStack Network Service

glance-api

glance-registry

glancedatabase

OpenStack Block Storage


cinder-api

cinder-volume

quantum-server

quantum plugin(s)

OpenStack Identity

API

cinder-scheduler

cinderdatabase


networkprovider



policy backend

Queue


quantumdatabase

quantum agent(s)

nova-conductor

memcached

OpenStack Identity

API

⁃ OpenStack Command Line Tools (nova-client, swift-client, etc.)⁃ Cloud Management Tools (Rightscale, Enstratius, etc.)⁃ GUI tools (Cyberduck, iPhone client, etc.)

volume provider

cinder-backup


OpenStack Identity

API

Queue


Havana Development

  Ceilometer is a metering project. The project offers metering. Metering lets you know what actions have taken place, rating enables pricing and line items, and billing gathers the line items to create a bill to send to the consumer and collect payment.

  Heat provides a REST API to orchestrate multiple cloud applications implementing standards such as AWS CloudFormation.

12

Havana Architecture (~Oct 2013)

13

Dashboard

Compute

BlockStorage

Network


UI forProvides

UI for

Provides UI for

Provides UI for

Provides Auth for

Provides Auth for

Provides Auth for


Auth for

Provides Auth for

Provides volumes

for

Provide connectivity

for

Stores images in


Identity

ObjectStorage

Image


Orchestraton

Metering

Meters usage of

Meters usage of

Meters usage of

Meters usage of

Automates Automates

Automates

Automates

14

  November 5-8, 2013 – Hong Kong!   Registration and sponsorships now open

–  New: Two tiers of registration, please read carefully

  Call for speakers deadline July 31   Book your travel early, room blocks are filling up!   Travel Assistance Program – applications in July   More details at openstack.org/summit

Ken Pepple [email protected]


Accelerating the adoption of Cloud Computing

openstack architecture: past and future

Technology

stores disk

server quantum

provide network

cert objectstore

stores images

network nova

volume nova

meters usage