scaleio: simplifying openstack with scaleio software ... · features for multiple apps. provide a...

ScaleIO: Simplifying OpenStack With ScaleIO Software Defined Storage

What is OpenStack?

© Copyright 2017 Dell Inc.3

Mission Statement

The OpenStack Mission: to produce the ubiquitous Open Source Cloud Computing platform that will meet the needs of public and private cloudsregardless of size, by being simple to implement and massively scalable.

The OPEN in OpenStack (aka the four opens)

Open Source

Open Design

Open Development

Open Community

What is OpenStack?


OpenStack Business Drivers

http://www.openstack.org/assets/survey/April-2016-User-Survey-Report.pdf



Enterprises Success With OpenStack• Deploy Across Diverse Use Cases

Enterprise Private Cloud

Telecom&

NFV

PublicCloud

Research&

Big Data


OpenStack Adoption is Growing



What is ScaleIO?


What is ScaleIO?

What can ScaleIO do?

• Lower TCO by 50%• Accelerate storage deployment by 83%• Reduce unplanned downtime by 96%• Enable 32% faster application deployment1

Dell EMC ScaleIO software-defined storage abstracts, pools, and automates the storage on x86 servers, delivering enterprise grade resilience and performance

Where is ScaleIO used?

• IaaS / Private Cloud• DevOps• Consolidated block storage infrastructure

ScaleIO Benefits

Build the data center with x86 and Ethernet

Simplify management and automate storage

with SDS

Utilize enterprise-class features for multiple apps

Provide a resilient, high performance data service for

block workloads

Reduce TCO of buying, managing, and

operating storage

Eliminate data migrations and move to

a perpetual lifecycle

1IDC, “The Business Value of VxRack and ScaleIO”, https://www.emc.com/collateral/white-papers/idc-business-value-of-vxrack-and-scaleio.pdf

https://www.emc.com/collateral/white-papers/idc-business-value-of-vxrack-and-scaleio.pdf


SDS allows enterprises to operate like web scalers –w/ruthless efficiency

• Software automation

• Standard x86 servers & Ethernet

• Minimal variation of components

• Rolling upgrades, no data migration


Supports Any ApplicationTraditional, modern or cloud

True SDS flexibility

Operating systems Hypervisors Platforms

SSDHDD PCIeFlash

Media

On Any OS, Hypervisor, Platform or Media

NVMeFlash

At any scale


Datacenter wide abstracting, pooling and automationBrings higher efficiency, flexibility and performance

Stack Integrated Infrastructure Service


ScaleIO Building Blocks

SDC

ScaleIO Data Client (SDC)• Manages connection to ScaleIO’s pool of

storage• Installed on servers consuming storage

SDS

ScaleIO Data Server (SDS)• Abstracts local storage and presents it

to SDCs • Installed on servers supplying storage

MDM Metadata Manager (MDM)• Coordinates and monitors storage• Installed on multiple servers for HA

Extremely light weight pieces of software

Think of this as a Consumer of storage

Think of this as a Supplier of storage

GW ScaleIO Gateway• Provides RESTful API• Provides Call Home• Can be used for remote support

Think of this as a Manager of storage

Think of this as a management Gateway to storage


ScaleIO Storage Architecture & Data Flow

• ScaleIO uses a mesh layout

• Any SDC (Client) will be communicating with many SDS (Storage Server) nodes and many storage devices

• Massively parallel approach to maximize throughput and minimize latency

• No hot spots; default is all-to-all and storage layout is rebalanced with every change

• A ScaleIO volume can span multiple SDSes

SDC

SDS

SDC

SDS

SDC

SDS

SDC

SDS

SDC

SDS

app app app app app

ScaleIO Volume


SDS

SDC

ScaleIO Approach to Block Storage I/O

SDC

SDS

ScaleIO and OpenStack Integration


ScaleIO with OpenStack - Cinder Interaction

VM VM

Ethernet

SSD HDD SSD HDD SSD HDD

OpenStack Host 1

VM VM

ScaleIO

OpenStack Host 2

ScaleIO

OpenStack Host 3

ScaleIO

KVM Containers

ScaleIO Volume 1ScaleIO Volume 2ScaleIO Volume 3

Vol 1 Vol 2 Vol 3

CinderDriver

Rest API

ScaleIO Management

Create Volume

Map Volume

Delete Volume

ScaleIO Cinder driver has been built into OpenStack since the Liberty release


ScaleIO Deployment - Automation & OpenStack

VM VM

Ethernet

SSD HDD SSD HDD SSD HDD

OpenStack Host 1

VM VM

ScaleIO

OpenStack Host 2

ScaleIO

OpenStack Host 3

ScaleIO

KVM Containers

ScaleIO Volume 1ScaleIO Volume 2ScaleIO Volume 3

Vol 1 Vol 2 Vol 3

• ScaleIO makes deploying storage easy

• Storage can run:– Modern (Hyper-converged)

› Compute and storage on same server– Traditional (2-layer)

› Compute and storage separated– Mixed

› Any combination of these

• Many automation options to choose from:• Canonical native automation (Juju)• Mirantis native automation (Fuel)• Other automation: Ansible, Puppet, Go• Redhat native automation (Director)

• In planning

• Can be automated to the level of deploying OpenStack and ScaleIO with a single command

Why ScaleIO for OpenStack?


Why ScaleIO for OpenStack?

Greater AgilityEasy to grow storage and/or compute

Cost effective Better utilization of hardware and people

Greater flexibility Run on any platform and consume on any platform

$

Enterprise Grade

Performance & Scale (1000+)

AgilityFluid expansion of

compute and/or storage

SimplifyAutomated

deployments,Full storage UI

Business Value

Run HCI or Not,Lower TCO


Enterprise Grade

• Consistent, high performance block storage

• Data center scale (1000+ nodes)

• Automated backend processes to ensure six 9’s availability

• Enterprise storage features, including:– QoS– Consistency Groups– D@RE


Agility

• Deployed on industry-standard servers

• Deployment flexibility– Any OS, hypervisor, media is supported

• Add new servers and remove old with No Migrations

• Try it now, for free

• Scales in any direction


Simplify

• Integrated and fully contributed to OpenStack

• Partner plugins available for easier deployment

• Simplify the storage management lifecycle

• Little technical expertise required

• Automation enables simultaneous deployment of both OpenStack and storage


Business Value

• Enables hyper-converged OpenStack deployments

• Scales as business needs change

• Simplified data center operations

• Significantly reduces TCO of storage

• Lower hardware requirements

ScaleIO Customer Success Stories


Solution/Environment

Results

Challenges

• ScaleIO simultaneously delivering OpenStack and ESX IaaS / private cloud • Majority of workloads run on OpenStack• Utilizing containers on OpenStack platform in conjunction with ScaleIO

• ScaleIO SDS providing the agility needed to enable faster time to market• Achieved cost reduction objectives • Success of SDS / ScaleIO expanding to other IT systems

• Require high IOPS and throughput• Needed a simplified architecture • Support next gen workloads

Leading APJ Telco & Service ProviderTaps SDS and ScaleIO to deliver Openstack IaaS / Private Cloud

3 PB1.6 PB in Production

Faster Time To Market & TCO

Focused


Solution/Environment

Results

Challenges

• Dell EMC ScaleIO Software • SDS architecture supports both DevOps (gaming platform) and enterprise

IT (internal) environment • Leveraging Ansible, Cobbler, and Puppet for automation

• ScaleIO delivered key operational objectives of scale, resource pooling, all-flash, performance, ease of use, and stability

• Enabled significantly easier provisioning model• Provides storage agility needed in a fast moving DevOps environment

• Data growth of 30-50% • Big mandate to reduce OPEX

Top Five Gaming Company Enables DevOps on OpenStack by leveraging Dell EMC ScaleIO

3.6 PB All Flash

DevOps FocusedAgility and flexibility enabled


Our Belief

Dell EMC ScaleIO is the most performant, most scalable block

storage solution for OpenStack Cinder deployments


Next Steps

Join the ECN ScaleIO Product CommunityFollow Us on Twitter @DellEMCStorage

VISIT www.dellemc.com/scaleiowhere you’ll have access to whitepapers, videos, demos etc.

Reach out to your local sales team!

DOWNLOADFree & Frictionless version of ScaleIO

http://emc.com/products-solutions/trial-software-download/scaleio.htm

http://emc.com/products-solutions/trial-software-download/scaleio.htm


More Resources• Watch the ScaleIO sessions from the last two OpenStack Summits

– EMC - Battle of the Titans: Real-time Demonstration of Ceph vs. ScaleIO Performance for Block Storage– EMC - Using ScaleIO in an OpenStack Environment

• Download ScaleIO and try it for free!– http://www.emc.com/getscaleio

• Don’t have hardware, try it out in our virtual lab– https://community.emc.com/community/products/scaleio#learn

• ScaleIO related open-source projects– http://codedellemc.com

• Visit the “Everything OpenStack at Dell EMC” community– https://community.emc.com/community/connect/everything-openstack

• Check out all the collateral in the ScaleIO Product Enablement Center– http://www.emc.com/auth/rpage/ec-for-scaleio.htm

https://www.openstack.org/summit/tokyo-2015/videos/presentation/emc-battle-of-the-titans-real-time-demonstration-of-ceph-vs-scaleio-performance-for-block-storage

https://www.openstack.org/videos/video/emc-using-scaleio-in-an-openstack-environment

http://www.emc.com/getscaleio

https://community.emc.com/community/products/scaleio#learn

http://codedellemc.com/

https://community.emc.com/community/connect/everything-openstack

http://www.emc.com/auth/rpage/ec-for-scaleio.htm


Want More ScaleIO?• EMC ScaleIO In The Enterprise: The Citi Experience

(storage.28)– Monday @ 3:00 PM; Tuesday @ 8:30 AM

• ScaleIO: Architecture Deep Dive (storage.29)– Monday @ 4:30 PM; Thursday @ 1:00 PM

• ScaleIO: Architecting For Availability, Performance & Networking With ScaleIO (storage.30)

– Monday @ 1:30 PM; Thursday @ 10:00 AM

• ScaleIO: Simplying OpenStack With ScaleIO Software Defined Storage (storage.32)

– Monday @ 08:30 AM

• ScaleIO & vSAN: Software-Defined Storage - The Revolution is Here! (storage.33)

– Monday @ 12:00 PM; Wednesday @ 12:00 PM

• ScaleIO: Customer Panel: How Is Software Defined Storage Helping My Data Center? (storage.34)

– Monday @ 4:30 PM; Wednesday @ 3:00 PM

• ScaleIO: Software-Defined Storage Lifecycle Management Viewed Through Demos (storage.36)

– Monday @ 8:30 AM; Thursday @ 8:30 AM

Birds of a Feather• ScaleIO: Redefining Software-Defined

Storage & Hyper-Convergence– Tuesday @ 1:30 PM

Try our Hands-on-Labs• Build A 100-Node ScaleIO SDS Cluster In

Minutes! • Operations & Lifecycle Management Of

Dell EMC ScaleIO Software Defined Storage

• Use REX-Ray & ScaleIO With Docker, Mesos & Kubernetes (Hands-on Lab)

Visit us in Booth! #757


Want to win a Levitating Death Star Speaker?

• Follow @DellEMCStorage while at Dell EMC World

• 2 Winners will be chosen daily from Monday May 8 through Thursday May 11

• All winners will be notified through Twitter Direct Message

NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/


OpenStack MitakaDell EMC ScaleIO New Features

• Released April 2016

• ScaleIO updates to Mitaka include:– Full support of QoS– Support for Consistency Groups– Option to bring existing ScaleIO volumes under OpenStack management


OpenStack NewtonDell EMC ScaleIO New Features

• Released October 2016

• ScaleIO updates to Newton include:– QoS Scaling

› A specific amount of IOPs or Bandwidth can be allocated per GB provisioned› A maximum can also be specified

– Improved usage reporting› Improved capacity statistics for thin and thick provisioning

– Supporting Oversubscription in thin provisioning– Cinder backend for Glance using ScaleIO– Bring existing snapshots under OpenStack management

scaleio: simplifying openstack with scaleio software ... · features for multiple apps. provide a...

Documents