build a killer app ecosystem - big data everywhere

20
Build a Killer App Ecosystem with Docker on Apache Mesos Paul Otto [email protected] @potto007

Upload: ngonguyet

Post on 13-Feb-2017

228 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Build a Killer App Ecosystem - Big Data Everywhere

Build a Killer App Ecosystem with Docker

on Apache MesosPaul Otto

[email protected] @potto007

Page 2: Build a Killer App Ecosystem - Big Data Everywhere

But wait…

How is this connected to big data??

Page 3: Build a Killer App Ecosystem - Big Data Everywhere

B E R K E L E Y D ATA A N A LY T I C S S TA C K ( B D A S )

Page 4: Build a Killer App Ecosystem - Big Data Everywhere

What We Needed

Elastic scaling

High availability

Multi-tenancy

Easy deployment

Page 5: Build a Killer App Ecosystem - Big Data Everywhere

The Problem

Page 6: Build a Killer App Ecosystem - Big Data Everywhere

Choose One

OR

Page 7: Build a Killer App Ecosystem - Big Data Everywhere

Focus on Meta

Page 8: Build a Killer App Ecosystem - Big Data Everywhere

One Size Does Not Fit All

Page 9: Build a Killer App Ecosystem - Big Data Everywhere

Containers!

Page 10: Build a Killer App Ecosystem - Big Data Everywhere

Docker on Mesos

Page 11: Build a Killer App Ecosystem - Big Data Everywhere

Multiple Frameworks

MapR-FS

Page 12: Build a Killer App Ecosystem - Big Data Everywhere

Continuous Deployment

GitHubJenkins Docker Build

Docker Private Registry

Jenkins Deploy

JobMarathon Mesos

Cluster

Page 13: Build a Killer App Ecosystem - Big Data Everywhere

Why Mesos?

Page 14: Build a Killer App Ecosystem - Big Data Everywhere

Evolution of Infrastructure

Dedicated Servers Datacenter

Page 15: Build a Killer App Ecosystem - Big Data Everywhere

Evolution of Infrastructure

Virtualization Datacenter

• more machines to manage • lower performance • utilization problem still

unsolved

Page 16: Build a Killer App Ecosystem - Big Data Everywhere

Evolution of Infrastructure

Mesos Datacenter (One Pool of Resources)

Page 17: Build a Killer App Ecosystem - Big Data Everywhere

Mesos Architecture

Page 18: Build a Killer App Ecosystem - Big Data Everywhere

Mesos Architecture

Page 19: Build a Killer App Ecosystem - Big Data Everywhere

Why Use Mesos?

• allows services to scale

• think about services, not machines

• fault tolerant - no SPoF

Page 20: Build a Killer App Ecosystem - Big Data Everywhere

Thank You!

Paul [email protected]

@potto007

www.OttoOps.com