cloud data at epic scale with datastax enterprise and pivotal cloud foundry

28
Cloud Data at Epic Scale with DataStax Enterprise and Pivotal Cloud Foundry Gilbert Lau, Partner Architect, DataStax [email protected] Pieter Humphrey, Principal PMM, Pivotal @pieterhumphrey

Upload: pivotal

Post on 13-Apr-2017

174 views

Category:

Technology


2 download

TRANSCRIPT

PCF Metrics – App Dev

Providing App Developers insight into app performance

Cloud Data at Epic Scale with DataStax Enterprise and Pivotal Cloud Foundry

Gilbert Lau, Partner Architect, DataStax [email protected] Pieter Humphrey, Principal PMM, Pivotal @pieterhumphrey

DataStax offers proven technology

500+ #1 Customers 30+

Percent

Ranked #1 in multiple operational database

categories

Building on the shoulders of giants at DataStax

•  Cluster Architecture

•  Partitioning •  Replication •  Gossip •  Anti-Entropy •  Hints

Schema Memtables Compaction SStables Commit Log

You’re already using DataStax Enterprise!

Filling a prescription Watching movies online

Browsing news sites

Shopping Online

Depositing a check electronically

Playing popular video games

powered by

A Multi-Model Platform for a Variety of Use Cases

Apache Cassandra Software

Extensions Data Models Cassandra

We start with Cassandra, that gives you a high-performance, distributed, always-on database that remains operationally simple when scaled in a single datacenter or across multiple datacenters and clouds.

Data Models Software

Extensions Cassandra Data Models

We then provide multiple, flexible data models that allow you to service your applications’ need for different data storage and access requirements in a single platform.

Software Extensions Cassandra Data Models

Finally, we wrap around that commercial software extensions that are purpose built to deliver everything you need to confidently run and manage web, mobile, and IoT applications throughout your enterprise.

Software Extensions

Delivering Value Across Core Use Cases

Customer Experience Internet of Things Machine Learning

Customer 360

Personalization

Time Series

Messaging

Fraud Detection

Predictive

Powering Cloud Applications with DSE

Responsive Intelligent Distributed

+ +

Masterless Architecture

Private, Public & Hybrid

Continuous Availability

Active Everywhere

Local Low Latency

Linear Scale

Multi-Model

Mixed Workloads

Operations Automation

What is for DataStax for PCF?

Unmanaged Service Broker for your

existing DSE

We are looking for feedback & understanding of real world

DataStax Enterprise in PCF use cases

PCF-Managed (on-demand)

Service Broker for DSE

Hold on. ... a what? a Service Broker?

Application state on Pivotal Cloud Foundry

Application State

File system not shared across

container instances

Short lived, ephemeral

local file system

State is managed externally to the platform

What is DataStax Enterprise for PCF?

•  We have partnered with Pivotal to explore options for supporting DataStax Enterprise as a service offering on Pivotal Cloud Foundry (PCF)

•  Requires a Bring Your Own License (BYOL) for DataStax Enterprise

•  Multiple service options under consideration:

•  Unmanaged Service Broker – supports automatic integration of applications with externally managed DSE cluster

•  Managed Service Broker – supports on-demand BOSH managed creation of DSE Enterprise service instances

Service Brokers and Pivotal Cloud Foundry

What types of services does PCF offer? •  Managed - Fully integrated, with

full lifecycle management •  User-Provided – Created and

managed external to the platform (unmanaged)

What is a service? •  Allows resources to be easily

provisioned on-demand •  Often middleware and other

“components” necessary for applications

•  Can be a persistent, stateful layer

USER PROVIDED

(UNMANAGED)

FULLY PCF MANAGED

Service Brokers and Applications

1.  Upload app bits and metadata

push app

Router2.  Create and bind services

3.  Stage application

4.  Deploy application

5.  Manage application health

Blobstore DB

Cloud Controller Service Broker Node(s)

DEA DEA

DEA Cell

+ app MD

+ =

Service credentials

Container Management - DIEGO

Brain

Service Brokers and Applications

Router

Pla+ormRun.me

DB Service credentials

reserve resources create service (HTTP) create service (HTTP)

bind service (HTTP) bind service (HTTP) obtain connection data

CLI Cloud Controller

Service Broker

Data Service

DataStax Enterprise Service Brokers

•  Unmanaged Service Broker – supports automatic integration of applications with externally managed DSE Enterprise cluster

•  Managed Service Broker – supports on-demand BOSH managed creation of DSE Enterprise service instances

Unmanaged Service Broker Overview

Pivotal Cloud Foundry Elastic Runtime

Unmanaged Service Broker Benefits

•  For use with externally managed DSE clusters •  Automatic integration of applications with externally managed DSE cluster •  Allows applications on Pivotal Cloud Foundry to discover external DSE cluster IP

addresses •  Creation & delivery of unique database user credentials based on DSE roles

through service plans Use cases: •  On-board existing production and non-production DSE cluster(s)

Managed Service Broker Overview

Pivotal Cloud Foundry Elastic Runtime

Managed Service Broker Benefits

App Developers:

•  Self service marketplace empowers

application developers to create and scale

out their own dedicated DSE clusters

when required.

•  Automatic integration of applications with

databases; creation and delivery of

database user credentials to applications

via environment variables.

For IT Operators:

•  Multiple resources based

service plans to fit different

application requirements

•  Service plan quota limits govern

resource exposure

Some Managed Service Broker Use Cases

TEST / DEV

Dedicated Cluster

CI

Managed Service Broker Sample Service Plans

Plan Description Sample Bronze Plan Deploy a dedicated DSE 5.x service instance suitable for development or light workloads

demanding moderate networking performance. Defaults: Cluster Size: 3 (configurable up to 40) Instance Type: m3.large

Sample Silver Plan Deploy a dedicated DSE 5.x service instance suitable for moderate workloads demanding high networking performance. Defaults: Cluster Size: 5 (configurable up to 40) Instance Type: m3.xlarge

Sample Gold Plan Deploy a dedicated DSE 5.0 C* service instance suitable for heavy workloads demanding high networking performance. Defaults: Cluster Size: 5 (configurable up to 40) Instance Type: m3.2xlarge

* Instance types can be changed by Operator

Demo

DataStax for PCF Summary

Unmanaged & managed (on-demand)

Service Broker options

Supports DataStax Enterprise 5.x

(incl. OpsCenter 6.x)

PoT available for demonstration and

evaluation

We are looking for feedback & understanding of real world

DataStax Enterprise in PCF use cases

© Copyright 2016 Pivotal Software Inc. All rights reserved. © Copyright 2016 Pivotal Software Inc. All rights reserved. © Copyright 2016 Pivotal Software Inc. All rights reserved.

•  Share the demos with your colleagues

•  Unmanaged Service Broker - https://www.youtube.com/watch?v=-qOcrTsws7g •  Managed Service Broker - https://www.youtube.com/watch?v=k13rIia6qqo

•  The Unmanaged Service Broker tile for DSE will be available soon at http://network.pivotal.io

•  If you are interested in test-driving our Managed Service Broker integration, please contact me by [email protected] or your sales representatives from either Pivotal or DataStax

Next Steps