mesos con 2015 recap meetup-v2

© 2015 IBM Corporation

Platform Computing

1

SEATTLE MESOSCON 2015 RECAP

Guangya Liu (liugya@cn.ibm.com)

Senior Software Engineer

© 2015 IBM Corporation

Platform Computing

2

Reference

© 2015 IBM Corporation

Platform Computing

3

Reference

Seattle Mesos Conf 2015Vancouver OpenStack Summit 2015

© 2015 IBM Corporation

Platform Computing

4

Brief Introduction

• Apache Mesos community

– 260 attendees in 2014 vs 700+ attendees

– Mesosphere and Twitter are still the two main contributors to core Mesos

• Real-world adoption happening

– Tire kicking last year vs. real production examples this year

• Vibrant ecosystem developing

– Lots of work going on above and around the core Apache Mesos project

– People building frameworks, management tools around core Apache Mesos

– Industry players like Vmware, Cisco, Verizon, Huawei, Apple Siri all active

© 2015 IBM Corporation

Platform Computing

5

Brief Introduction

• MesosSphere progress update

– Announced new product Infinity for IoT

– Announced Verizon was a paying Mesosphere DCOS customer

– Rumor of 1B Microsoft buyout of Mesosphere, Windows support

– Leveraging Apache Mesos as seeding strategy to reach paying customers

• Significant re-invention of HPC history

– Grid Computing

– More than Grid Computing

• Social Time

– Twitter, IBM, Huawei，mesosphere etc

• How to get involved

– Suggested start with Jira tickets tagged “newbie”

– Small bug fix, feature enhancement

© 2015 IBM Corporation

Platform Computing

6

© 2015 IBM Corporation

Platform Computing

7

Mesosphere

© 2015 IBM Corporation

Platform Computing

8

Mesos Support Windows

© 2015 IBM Corporation

Platform Computing

9

Customer Case

• Verizon

– Demonstrated Mesos running in 500 nodes in production data center starting 50K

tasks in 1 minute in keynote

– MesosSphere announced Verizon as paying customer

– Intends to standardize on Mesos as RM layer across multiple data centers supporting

on-line customer facing web and mobile apps

• Baloomberge

– Gave talk on deployment of an app to monitor internal emails/chats to detect internal

fraud

– Leverage Mesos to manage multiple Kafka, Hadoop

– Had to build tooling around Mesos for monitoring, access control

• Paypal

– Using Mesos for internal CI environment with Jenkins

– Not mission critical , small scale deployment

• Digital Ocean

– Deploying Mesos internally while Mesosphere offers DCOS on top

© 2015 IBM Corporation

Platform Computing

10

Project Fenzo from Netflix

• Developed by ex-SUN HPC

engineer familiar with Platform

LSF

• Attempts to solve cross-

framework scheduling concerns

(bin-packing, rack/DC

affinity/anti-affinity)

• Provided as library that can be

leveraged by other frameworks

© 2015 IBM Corporation

Platform Computing

11

Framework Landscape – What can we do?

Mesos

Marathon(

Mesosphe

re)

Chronos

(AirBnb)

Aurora

(Twitter)Singularity

(Hubspot)

Fenzo (Netfix)

Other

Frameworks

Opensource Frameworks

Any Allocator Plugin

Customized

Framework1

Long

running

services

Distributed

Cron

Jobs

Batch Jobs

& ServicesServices &

Tasks

Customized

Framework2

Customized

Frameworkn

Customized Frameworks

Customized

Framework

© 2015 IBM Corporation

Platform Computing

12

THANKS