OpenStack, Eucalyptus, Docker–How Open Source Technologies ...

Download OpenStack, Eucalyptus, Docker–How Open Source Technologies ...

Post on 03-Feb-2017

215 views

Category:

Documents

2 download

TRANSCRIPT

  • Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    OpenStack, Eucalyptus, Docker How Open Source Technologies are Changing the Intelligence Cloud Landscape

    Sujit Mohanty

    HP Cloud Chief Technologist

    sujit.mohanty@hp.com

  • The Promises of Cloud

    1 Forrester Thought Leader Paper commissioned by HP, Better outcomes, faster results. Continuous delivery and the

    race for better business performance, December 20131 Forrester Thought Leader Paper commissioned by HP, Better outcomes, faster results. Continuous delivery and the race for better business performance, December 20132 http://www.bain.com/Images/BAIN_BRIEF_Five_faces_of_the_cloud.pdf3 http://research.gigaom.com/report/survey-enterprise-development-in-the-cloud/

    Cloud Services provisioned and de-provisioned in Minutes not Days

    4 52 120

    000110101001111100000011101001101010101

    11010101111000000111010011010101011

    01001000111100000011101001101010101

    01011010111100110011101001000000101

    0101000111100011100010011010101010

    1001110111100110011101001101010101

    01101101111000000111010011010101010

    00110101111111000111010011010101011

  • The Promises of Cloud in Government

    Optimizing government business processes

    Protecting sensitive and citizen data

    Delivering universal, always-available access

    Disaster avoidance vs. disaster recovery

    Improving quality of government service and management

    Enhancing collaboration of internal departments

    Enhancing interactions between government and public

    Enhancing interactions government-to-government

    Accelerating collaboration of information resources

    Lowering costs

  • Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4

    Cloud Adoption to Accelerate led by Hybrid Cloud

    Expected 4 year adoption curve

  • Hybrid Cloud gives you flexibility

    Private

    Cloud

    Managed Private

    CloudVirtual Private

    CloudPublic

    Cloud

    Hybrid cloud is the secure consumption of services from two or more resources

    On Premise or Cloud-Enabled Hosting

    Control Cloud

    Brokering

    Technology compatibility &

    enabling

  • The Path to Hybrid begins with Private

    Traditional IT environments

    82-90% of IT budgets for Operating IT

    Common Platform

    Service

    Catalog

    Private Cloud

    Cloud Enabled Hosting

    Service Brokering

    Cloud Native

    Integrated platform that is application centric

    https://PaaS

    Rapid development

    IaaS

    Distributed & scale out

    Efficient delivery of IT operations and user centric

  • Top Private Cloud Customer Objectives

    Brokering Services

    Internal Services Providers broker cloud for their business

    Hybrid IT

    Use the right destination for the right application

    Developer Centric

    Enable developers to rapidly develop cloud-native applications

    Public Cloud Private Cloud

    Traditional IT

    Security

    Cost

    Availability

    Compliance

    Performance

    Public Cloud

    SaaS

    Private Cloud

    Managed Cloud

    IaaS PaaS

  • Use the right destination for the right application

    Hybrid IT

    C o m m o n f o u n d a t i o n & O p e n t e c h n o l o g y

    Private

    Cloud

    Managed Private

    Cloud

    Managed Virtual

    Private Cloud

    Public

    Cloud

    Centralized Management Layer

    Classic ITapplications

    Cloud Nativeapplications

    Security

    Availability

    Compliance

    Data Sovereignty

    Performance

    Open

    Cost

    Bridge old and new

    Key Factors:

  • A Transformation of Architecture and Principles

    Scale Out Not scale-up

    Open Source Not closed

    Simple Not complex

    Distributed Not monolithic

    Grassroots Not top-down

    API Not integrationhttps://Cloud Native Concepts

  • A Transformation to an Internal Service Provider

    Public Cloud

    SaaS Private Cloud

    IaaS PaaS Public Cloud

    Private Cloud

    SaaS

    Todays IT Reality

    Employees and citizens are becoming more technology aware

    Alternatives exist in the market for direct consumption

    Technology is viewed in terms of service value from the user

    Users & developers want simple

    Security, compliance, availability

    ServiceCatalog

    Dev Platform

    Compliance

    Governance

    Competence

    Data sovereignty

    Budget constraints

    IP protection

    Culture

    Agility

    Secure data transfer

    Considerations

    Internal Service Provider providing the right destination for the right application

  • Faster application deployment enables accelerated innovation

    Transforming to put Developers First

    Agility is paramount

    30x increase in application releases

    Even when delivering at cadences of less than a week, 20% of organizations want to go even faster 1

    Developers need flexibility

    Expects to deploy 50%-70% of code to cloud environments by 20151

    Want open flexible architectures for application portability and prevent lock-in

    1 Forrester Thought Leader Paper commissioned by HP, Better outcomes, faster results. Continuous delivery and the

    race for better business performance, December 2013

    2010

    4 releases/year/app2015

    36 releases/year/app2020

    120 releases/year/app

  • Rapid application and service creation

    Simplified Operations

    APIs

    Cloud NativeInfrastructure Services IT provides the underlying infrastructure

    for development services

    Install, Configure and Manage

    Service portability and flexibility

    Building an Application-Centric Cloud Stack

  • Rapid application and service creation

    Simplified Operations

    APIs

    Cloud Native Development Platform Developers focus on developing

    Cloud NativeInfrastructure Services IT provides the underlying infrastructure

    for development services

    Install, Configure and Manage

    Service portability and flexibility

    Building an Application-Centric Cloud Stack

  • Service Catalog Automate the delivery of services

    Rapid creation of servicesRapid application and service creation

    Simplified Operations

    APIs

    Cloud Native Development Platform Developers focus on developing

    Cloud NativeInfrastructure Services IT provides the underlying infrastructure

    for development services

    Install, Configure and Manage

    Service portability and flexibility

    Building an Application-Centric Cloud Stack

  • 16

  • Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17

  • What is OpenStack Software

    Massively scalable cloud operating system that controls large pools of compute, storage and networking resources

    Community open source with contributions from 2000+ developers and 350+ participating organizations

    Open web-based API Programmatic Infrastructure as a Service

    Plug-in architecture; allows different hypervisors, block storage systems, network implementations, hardware diagnostics, etc.

    Fastest growing and rapidly adopted Open Source project

    HP is a Platinum member gaining transparency into governance, roadmap, blueprints, and development.

  • Open Source Cloud Computing platform

    What is OpenStack technology?

    Your applications

    OpenStackCloud Operating System

    Compute Network Storage

    OpenStack shared services

    OpenStack dashboard

    Standard hardware

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20

    UI

    OpenStack ArchitectureBased on OpenStack platforms highly modular design

    UI

    Execution EnvironmentOperation Environment

    Ke

    rnel

    Ser

    vic

    es

    Identity Service (Keystone)

    Physical Infrastructure

    Centralized Logging(Log stash, Elastic Search)

    Op

    era

    tio

    na

    l S

    erv

    ices

    Deployment (TripleO)Service

    Deployment Artifacts Machine Images Boot Images Deployment Templates

    Su

    bS

    yst

    ems

    Object StorageService

    (Swift)

    Image (Glance)Library Service

    Compute (Nova)Service

    Network (Neutron)Service

    Block Storage (Cinder)Service

    Linux

    Operational(Horizon) Dashboard

    KVMFC

    DB LDAP (Hybrid)

    Swift

    Sherpa

    Administrative Dashboard (Horizon)

    Infrastructure & ServiceMonitoring Service (Icinga)

    ESX

    iSCSILHN

    3PAR

    VMDK

    Recovery Management (Backup/Restore)

    Service Fail-over Management (HAProxy, Keepalived)

    MySQL

    Rabbit MQ

    EON

    Sirius

    Nova ESX (EON)Configuration

    Cinder Storage (Sirius)Configuration

    Storage (Store Virtual CMC/Dashboard 3PAR IMC)

    Sherpa

    Logging Search (Kibana)Dashboard

    Orchestration Service (Heat)

    DVR VXLAN

    VLAN

    Monitoring (Icinga)Dashboard

    Bare metal Service (Ironic)

    AD (Hybrid)

    OVSvApp

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21

    Interfaces for HP OpenStack

    Open interfaces OpenStack Target audience

    GUI (Graphical User Interface)

    Horizon (Dashboard)

    Cloud Administrator Administrator Tenants

    CLI (Command Line Interface)

    CLI(Python clients)

    Cloud Administrator

    API (Application programming interface)

    RESTful API DevOps Developers

    Helion OpenStack

    ESX, KVM

    Physical Infrastructure

    GUI CLIRESTful

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22

    KVM deployment

    HP Helion OpenStack Deployment Configuration

    Overcloud (Compute)

    Seed Host Undercloud

    Overcloud

    Controller

    Overcloud

    Controller

    Overcloud

    Mgmt

    Controller

    Overcloud

    (Swift)

    HP 3PAR StoreServ

    2 X

    3 X2 X

    Seed VM

    1 X

    1 X

    Object Storage

    HP StoreVirtual VSA

    N

    Block storage options

    Scale outSwift

    HP P4000

    Compute Scale-out

    Swift

    Block/Object

    Storage

    (Ceph)

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23

    Storage Decisions

    Block storage (HP StoreVirtual VSA, P4000

    HP 3PAR StoreServ, Ceph)

    Object storage(Swift, Ceph)

    Used toAdd additional persistent storage to a virtual machine (VM)

    Store data, including VM images

    Accessed throughA Block Storage device that can be partitioned, formatted, and mounted

    RESTful API

    Accessible from Within a VM Anywhere

    Managed by OpenStack Block Storage (Cinder) OpenStack Object Storage (Swift)

    Persists until Deleted by user Deleted by user

    Sizing determined by User specification in initial request Amount of available physical storage

    Example of typical usage 1 TB disk 10s of TBs of dataset storage

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24

    HP 3PAR StoreServ and Cinder

    HP Helion OpenStackBlock storage drivers

    HP 3PAR StoreServ

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.25

    HP 3PAR Device Deployment using OpenStack CinderQoS Based Provisioning

    Thin Provisioning QoS (min /max BW, IOPS, Priority , latency)

    HP 3PAR volume type settings

    Volume create/delete Volume attach/detach Snapshot Create/Delete Create Volume from Snapshot Get Volume Stats Copy Image to Volume Copy Volume to Image Clone Volume Extend VolumeeVolume Migration (backend

    assists)

    iSCSI / FC

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26

    Why Swift?

    Swift is Highly Scalable Object Storage Scales as the cluster grows Designed to run on commodity hardware No single point of failure

    Proxy ServerProxy Server

    Proxy Server

    ObjectServer

    ObjectServer

    ObjectServer

    object object object

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27

    Swift Use Cases

    Video Backup Recovery

    Storing large amounts of unstructured data - Large images, video, audio, document

    Backup Recovery & Archive Scientific data Web Mobile applications Infrastructure as a Service

    Scientific data

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28

    Storage Tier

    Access Tier (Concurrency)

    Zone 1 Zone 2 Zone 3 Zone 4 Zone 5

    Clients

    RESTful API

    ReadWrite

    Hash

    Obj AAuth

    Service

    OpenStack Swift Architecture

    Obj A

    Obj AObj A

    Obj A

    All object in Swift have a URL RESTful API over HTTP to operate on objects Objects have metadata

    Objects replication3x in unique zones which could be a node, drive, rack

    Cluster scales by adding nodes No data migration required Failed nodes remove, new nodes added

    without down time

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.29

    VM snapshot

    VM Images

    OpenStack Swift High Level Architecture

    Proxy ServerProxy Server

    Proxy Server

    Keystone(Identity)

    ObjectServer

    ObjectServer

    Glance(Images)

    Cinder (Volume)

    object

    object object object

    Get, put, delete, object/Volume

    Authentication Authorization

    Triple-o (installation)

    Vol backup

    Deploy Configure Swift

    TokenToken

    ObjectServer

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30

    Identity Service

    Provides OpenStack service access authentication and authorization (who can access what) Based on the OpenStack Keystone service 2 primary use cases

    Initial Login Access to assigned resources

    What is it?

    Authentication options Local Keystone LDAP or Microsoft Active Directory

    Initial configuration option for Keystone Configuration via editable script file OpenStack user information need to be added to LDAP / AD prior to installation Not easily changeable after installation All or nothing service wide setting

    What will be supported

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31

    Identity ServiceFunction DescriptionSupport multi-region/physical data center deployments including: Private public cloud

    Multi-data center (private and

    public)

    Drive support for multiple authentication sources and inter-cloud identify federation.Provide designs and installation support for service high availability and resiliency for both private and inter-cloud deployments.Continue to identify and drive lower authentication latency.Research, develop, and evangelize blueprints for resource federation.

    Support identity and resource multi-tenancy.

    Must be able to host multiple customers in a single environment with appropriate protections to keep access and data separate.Drive implementation of Keystone v3 API and push for the inclusion of community advanced user and system roles, and domain administration.

    Expanded Identity Management Support for multiple domain-IdP implementations, keystone-based federation, and federated (SSO) identity use cases.

    Extended Account Management Provide expanded RBAC support and user settings. Provide support for support-based

    roles and access.

    Flexible UI with improved usability

    Identify opportunities to improve current usability and support new user account management and identity management features. Support more dynamic loading of customer / extended UI panels.

  • Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32

    Metering Service

    Collects and stores OpenStack service usage information

    Based on the OpenStack Ceilometer service 2 primary use cases

    General Usage Reporting Billing / Chargeback

    What is it?

    Not included in initial release engineering dedicated database for scalable performance No special installation required Coll...

Recommended

View more >