cloud foundry marketplace

33
‹#› © Copyright 2015 EMC Corporation. All rights reserved. CLOUD FOUNDRY SERVICE MARKETPLACE - KNOWN AS OPENSTACK MANAGED CF SERVICE MARKETPLACE BEFORE EMC OCTO & CHINA MOBILE SOFTWARE TECHNOLOGY

Upload: layne-peng

Post on 11-Apr-2017

293 views

Category:

Technology


0 download

TRANSCRIPT

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

CLOUD FOUNDRY SERVICE MARKETPLACE - KNOWN AS OPENSTACK MANAGED CF SERVICE MARKETPLACE BEFOREEMC OCTO & CHINA MOBILE SOFTWARE TECHNOLOGY

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Runtime & Framework

Services

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Runtime & Framework

Services

Garden, Buildpacks, images and more…

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Runtime & Framework

Services

Garden, Buildpacks, images and more…

BOSH Deploy, Docker, Third-party provided

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Runtime & Framework

Services

Garden, Buildpacks, images and more…

BOSH Deploy, Docker, Third-party provided

bind/unbind

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Runtime & Framework

Services

Garden, Buildpacks, images and more…

BOSH Deploy, Docker, Third-party provided

bind/unbind Rigid Demand

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Rigid Demand

• Cloud Foundry manages stateful stuffs as services

• There are rules to make Cloud Foundry understand your services

• Cloud Foundry managed only stateless containers

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Why not make Cloud Foundry support Stateful containers?

Rigid Demand

• Cloud Foundry manages stateful stuffs as services

• There are rules to make Cloud Foundry understand your services

• Cloud Foundry managed only stateless containers

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Rigid Demand

• ClusterHQ has some try on making Cloud Foundry support stateful apps

Why not make Cloud Foundry support Stateful containers?

• Cloud Foundry manages stateful stuffs as services

• There are rules to make Cloud Foundry understand your services

• Cloud Foundry managed only stateless containers

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Why not make Cloud Foundry support Stateful containers?

stateless stateful

mature solutionsmeans backup, recovery, high availability, etc.

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Why now? Why we recreate the wheel?

Rigid Demand

• Cloud Foundry manages stateful stuffs as services

• There are rules to make Cloud Foundry understand your services

• Cloud Foundry managed only stateless containers

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT IS CLOUD FOUNDRY SERVICE

Why now? Why we recreate the wheel?

• China Mobile Big Cloud collaboration:

✦ CMST (Suzhou) and EMC China CoE

✦ Open Source Technology Joint Lab

‹#›© Copyright 2015 CMST. All rights reserved.

BIG CLOUD INTRO• IaaS solution integrated with computing,storage and network products

✦ Customized development for China Mobile needs Based OpenStack

✦ 4 products at resource layer – BC-EC, BC-oNest, BC-EBS and BC-vNetwork

✦ 2 management systems – BC-OP and BC-CloudMaster

✦ 1 security product – BC-Security

StorageCompute Network

BC-ECBC-oNest

BC-EBS

BC-vNetwork

BC-OP

BC-Cloudmaster

BC-Security

Cloud Applications

BC-Linux

‹#›© Copyright 2015 CMST. All rights reserved.

BC-EC• Provide computing services and integrate other products as the core

✦ Support heterogeneous hypervisor – kvm, vmware, hyper-v and container

✦ High scalability – 500 nodes in single OpenStack

✦ High availability – 3 level HA mechanism, services, VMs and host machines

✦ Live migration on shared storage and local storage

✦ Autoscaling based on resource metering

✦ Data availability based on BC-EBS and BC-oNest

‹#›© Copyright 2015 CMST. All rights reserved.

BC-EBS AND BC-ONEST• BC-EBS provides block storage based on SheepDog

✦ Support iSCSI and sheepdog protocols

✦ Thin-provision and erasure codes functions

✦ Volume backup and restore based BC-oNest

• BC-oNest provides object storage

✦ Provides Rest API and SDK compatible with S3

✦ Peta-scale object storage system

✦ ACL on user, container and object level

✦ Service availability 99.95%

✦ Singe object: Max 5TB, <100ms latency for read 4KB object in Gigabit network

‹#›© Copyright 2015 CMST. All rights reserved.

BC-VNETWORK• Two network type

✦ simple network: user can not define network information

✦ SDN network: provides VPC service by user defined

✦ L2 virtual switch based open vSwitch

✦ L3 virtual router,virtual firewall,vLB and VPN services

✦ Integrate with commercial SDN products – Nuage and H3C SDN products

‹#›© Copyright 2015 CMST. All rights reserved.

BC-OP AND BC-CLOUDMASTER• BC-OP Cloud Operation Platform

✦ Self-service portal

✦ Multiple datacenter management

✦ Production management , CRM, order management and billing system

• BC-CloudMaster

✦ Single datacenter management

✦ Performance monitoring and alerting

✦ Configuration management for assets

‹#›© Copyright 2015 CMST. All rights reserved.

WHAT DOES BIG CLOUD LACK OF ?• PaaS and Services for end users

✦ Use Cloud Foundry as our PaaS platform ?

✦ Use Cloud Foundry as service marketing ?

• Reality - We have already use OpenStack

IT’S NATURAL FOR US THAT WE MUST MAKE

EFFORTS TO INTEGRATE CLOUD FOUNDRY

WITH OPENSTACK!

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

WHAT THE WHEEL FOR?

• Unified service broker for all developer/operator/services contributors

✦ Unified authentication and authorities

✦ Unified log and billing mechanism

✦ Unified services keys provider

✦ more…

• Leverage efforts from CMST Big Cloud and OSS communities:

✦ OpenStack driver: Trove/Zaqar/Munaro/…

✦ CMST Service Marketplace

✦ Public Cloud Integration

✦ Third-party service contributors

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

Make Cloud Foundry can consume services:• APIs for Cloud Foundry Cloud Controller• Python implements for interfaces

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

Implements the Python CF Broker Framework:• Implementations of interfaces• Call Service Marketplaces’ REST APIs

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace CoreService Marketplace, which manages services:• Related fixed

core interfaces;• Different

implementation of drivers.

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

Service Marketplace Core:• Define the interfaces every drivers need to implement• Expose REST APIs• Currently only 4 mayor parts, will be add more later

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

APIs for:✦ User authentication and authority✦ User register and management (if driver support)✦ Of course, driver’s contributor can add more logics to bridge

Service Marketplace and IaaS

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

APIs for:✦ Billing related✦ We are working on this…

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

APIs for:✦ Aggregating the logs from hosts providing services

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

APIs for:✦ Features list provided by driver;✦ Provision/destroy the services;✦ Getting the connection keys of the services;✦ Extra features provided by drivers

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace CoreDrivers:• Implement the interfaces defined in Service Marketplace Core

through “bridges”• Two layers design:

Driver for one organisation, who providing services or one way to provide servicesBridges compose to OpenStack bridge to provide services.

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

REST API

User Management

Billing Service Adapter …

Keystone-bridge

Logging

Ceilometer-bridge

Firehose-bridge

OpenStack-bridge

Trove-bridge Murano-bridge … OpenStack Driver

Service Marketplace Core

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

OpenStack DriverService Marketplace Core

Every single line of codes, we will Open Source! (working on…)

‹#›© Copyright 2015 EMC Corporation. All rights reserved.

HIGH LEVEL ARCHITECTURE

Python CF Broker Framework

Service Marketplace Broker

OpenStack DriverService Marketplace Core

Please follow: https://github.com/emc-labs-chinaor WeChat: