leanops idg cloudworld korea

Post on 19-May-2015

2.007 Views

Category:

Business

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

LeanOps PresentationDTO SOlutions

TRANSCRIPT

Open Source Tools and Operations Methodologies for Unlocking the Business

Value of the Cloud

Saturday, April 23, 2011

• Open Source Tools• Operations Methodologies• Business Value of Cloud

Saturday, April 23, 2011

Buying or Building a Cloud Does Not Make Your

Business Agile!

Saturday, April 23, 2011

Buying or Building a Cloud Does Not Make Your

Business Agile!

Building a Cloud is EasyManaging a Cloud is Not!

Saturday, April 23, 2011

Agenda

• Introductions

•Devops

•Devops Stories

•A LeanOps Success Story

•How You Can Deliver LeanOps

Saturday, April 23, 2011

Company Background

• Founded in 2004 from:

• eTrade, NASA, Fidelity, Schwab

• Canonical, Opscode

•Agile IT and Operations Team

• Over 100 person-years and 6 books

• Financials, telco, transpiration, etc.

•Headquartered in San Mateo CA

• Offices in Atlanta, and San Francisco

Saturday, April 23, 2011

Our Customers

Saturday, April 23, 2011

john@dtosolutions.com

John Willis

twitter.com/botchagalupe

Saturday, April 23, 2011

Operations: The Elephant in the Room

Once we move to software as a service, everything we thought we knew about competitive advantage has to be rethought.

Tim O'Reilly - Operations: The New Secret Sauce

Saturday, April 23, 2011

XaaS

Saturday, April 23, 2011

XaaS

"anything as a service" or "everything as a service." The acronym refers to an increasing number of services that are delivered over the Internet rather than provided locally or on-site.

Saturday, April 23, 2011

The New Face of a Rock Star

John Allspaw - VP of Technical Operations at Etsy

Saturday, April 23, 2011

Devops is a cultural and professional movement!

Saturday, April 23, 2011

Devops is About Velocity

Saturday, April 23, 2011

Devops is About Velocity

Velocity of Innovation

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Devops

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Devops

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

DevopsAgile IT

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

DevopsAgile IT

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Devops

Lean Startup

Agile IT

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Devops

Lean Startup

Agile IT

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Devops

Lean Startup

Agile IT

EnterpriseLean Startup

Saturday, April 23, 2011

LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.

Devops

Lean Startup

Agile IT

EnterpriseLean Startup

Saturday, April 23, 2011

Devops Lifecycle

ah ha! ka ching!

Dev

Business Process

Remove

Shorten

Ops

Saturday, April 23, 2011

Devops Lifecycle

ah ha! ka ching!

Dev

Business Process

Remove

Shorten

Ops

Compressed SDLC

Saturday, April 23, 2011

Typical Ops Resources

Saturday, April 23, 2011

Typical Ops Resources

LeanOps

Saturday, April 23, 2011

Typical Ops Resources

LeanOps

Saturday, April 23, 2011

Typical Ops Resources

LeanOps

Saturday, April 23, 2011

LeanOps Loosely Coupled Toolchain

Saturday, April 23, 2011

LeanOps Staff Allocation to Value Generation

DeploymentTestingDevelpment

Before

After

Build

TestingDevelpment

DeploymentBuild

Measuring how your team's time is allocated

Saturday, April 23, 2011

LeanOps Necessities

Saturday, April 23, 2011

LeanOps Necessities

Saturday, April 23, 2011

LeanOps Necessities

Fully Automated

Infrastructure

Saturday, April 23, 2011

LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Saturday, April 23, 2011

LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Test Driven

Development

Continuous

Deployment

Fully Automated

Infrastructure

Saturday, April 23, 2011

LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Test Driven

Development

Continuous

Deployment

Fully Automated

Infrastructure

Test Driven

Development

Immune

System

Continuous

Deployment

Fully Automated

Infrastructure

Saturday, April 23, 2011

LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Test Driven

Development

Continuous

Deployment

Fully Automated

Infrastructure

Test Driven

Development

Immune

System

Continuous

Deployment

Fully Automated

Infrastructure

Test Driven

Development

Immune

System

Continuous

Deployment

Agile

Culture

Fully Automated

Infrastructure

Saturday, April 23, 2011

LeanOps Ingredients

Saturday, April 23, 2011

LeanOps Ingredients

Saturday, April 23, 2011

DevOps Examples

Saturday, April 23, 2011

•Model Driven Configuration

•Automated Deployment

•Continuous Delivery

•Built Their Own Private Cloud

• Self Service Infrastructure

• SVN, Hudson, Puppet

•Nagios, JMX, CassandraSaturday, April 23, 2011

•Agile Infrastructure

• Every Two Weeks They Re-factor Apps and Infrastructure

•Chef

Saturday, April 23, 2011

•Built a Self Service SaaS Cloud

•Chef, Puppet, Amazon, Azure, Splunk, Zookeeper, RabbitMQ

•Cloudkick

Saturday, April 23, 2011

• First Push to Production on Interview

• 50 to 100 Production Deploys per day

• Puppet, Hudson, Zookeeper, Nagios, Esper

•Behavior Driven Monitoring

• Immune System Deploys

Saturday, April 23, 2011

LeanOps Case Study

Saturday, April 23, 2011

“Very” Large Game CompanyStarted Out Small With a Cloud

Saturday, April 23, 2011

apache/phpmemcached

mysql

Dev

“Very” Large Game CompanyStarted Out Small With a Cloud

Saturday, April 23, 2011

Rightscale

AWS s3apache/phpmemcached

mysql

Dev

“Very” Large Game CompanyStarted Out Small With a Cloud

Saturday, April 23, 2011

Rightscale

AWS s3

s3putssh

apache/phpmemcached

mysql

Dev

“Very” Large Game CompanyStarted Out Small With a Cloud

Saturday, April 23, 2011

Rightscale

AWS s3

s3putssh

apache/phpmemcached

mysql

Dev

“Very” Large Game CompanyStarted Out Small With a Cloud

winning.com

Saturday, April 23, 2011

“Very” Large Game CompanyVery Fast Growth

apache/phpmemcached

mysql

Rightscale

AWS s3

winning.com

Saturday, April 23, 2011

“Very” Large Game CompanyVery Fast Growth

apache/phpmemcached

mysql

Rightscale

AWS s3

winning.com

Rightscale

AWS s3

warlock.com

apache/phpmemcached

mysql

s3put

tigerblood.com

Rightscale

AWS s3

apache/phpmemcached

mysql

s3put

ssh

Saturday, April 23, 2011

“Very” Large Game CompanyVery Fast Growth

apache/phpmemcached

mysql

Rightscale

AWS s3

winning.com

Rightscale

AWS s3

warlock.com

apache/phpmemcached

mysql

s3put

tigerblood.com

Rightscale

AWS s3

apache/phpmemcached

mysql

s3put

ssh

yuMpUppEt

3rd party

,

&middle

ware

Saturday, April 23, 2011

victims of successCOMPLAINTS

BEGAN TO MOUNT

Saturday, April 23, 2011

SOFWARE DOESN'T WORK

RIGHT !

victims of successCOMPLAINTS

BEGAN TO MOUNT

Saturday, April 23, 2011

SOFWARE DOESN'T WORK

RIGHT !

victims of successCOMPLAINTS

BEGAN TO MOUNT

MY BOXES GOT CLOBBERED !

Saturday, April 23, 2011

SOFWARE DOESN'T WORK

RIGHT !

victims of successCOMPLAINTS

BEGAN TO MOUNT

GIVE ME MY ENVIRONMENT!

MY BOXES GOT CLOBBERED !

Saturday, April 23, 2011

SOFWARE DOESN'T WORK

RIGHT !

ANOTHER DEAD MACHINE ?

victims of successCOMPLAINTS

BEGAN TO MOUNT

GIVE ME MY ENVIRONMENT!

MY BOXES GOT CLOBBERED !

Saturday, April 23, 2011

started asking questions

Saturday, April 23, 2011

people ?

started asking questions

Saturday, April 23, 2011

process?

people ?

started asking questions

Saturday, April 23, 2011

process?

people ?

started asking questions

tools ?Saturday, April 23, 2011

studio devs

middlewaredevs

NOC

systemadmins

EC2

servertemplates

yum repo

RS deploymentRS

deployment

puppet

S3

code,content

code

TARTAR

TARTAR

platform

TARRPM

TARRPM

servertemplates

EXE

AUTO

TOOLS

Provision-time builds

CONTROL

restarts

deploys

reconfigs

PROVISION RELEASE

“Very” Large Game CompanyBefore LeanOps Implementation

Saturday, April 23, 2011

“Very” Large Game CompanyAfter LeanOps Implementation

processmessaging,queuing

apache/phpmemcached

mysql

app middleware 3rd party

buildsprod

rundeck

jenkins"promote"

job

"Deploy" & "Release"job

code,content, metas

winning.com

yum

yum yum

dev

Saturday, April 23, 2011

pup

pet

SVN

active

directory

splunk

instance create

resource model

users packages

new node Node a

commands

right

scale

run

deck

hud

son

yum

repo

nag

ios

packages

sys cfg

eventslog data

agent cfg

CONTROL PROVISION RELEASE

“Very” Large Game CompanyInfrastructure as SDLC

Saturday, April 23, 2011

Ops part of the architecture

mysqlweb[server array] memcached[server array]

rundeck puppetyum

new Rightscale deployment

operations middleware tools

Saturday, April 23, 2011

How it is done• Discovery process through workshop

sessions and individual meetings

• Formal decision modeling to align strategies to business goals

• Cost-benefit analysis

• Validate against reference process architecture and Open-Source application and system provisioning tool-chain (process vs platform rationalization)

Discover

Align

Act

Saturday, April 23, 2011

Program Organization

Saturday, April 23, 2011

Program Organization

Program Management Assessment engineers

Saturday, April 23, 2011

Program Organization

Program Management Assessment engineers

Individual Interviews&

Working groups

SVPs

IT Architecture, Software Engineering, Software QA, Systems Engineering

Saturday, April 23, 2011

Program Organization

AdvisoryCommittee

Various VPs

Program Management Assessment engineers

Individual Interviews&

Working groups

SVPs

IT Architecture, Software Engineering, Software QA, Systems Engineering

Saturday, April 23, 2011

Program Organization

SponsorCIO

AdvisoryCommittee

Various VPs

Program Management Assessment engineers

Individual Interviews&

Working groups

SVPs

IT Architecture, Software Engineering, Software QA, Systems Engineering

Saturday, April 23, 2011

Priority

Saturday, April 23, 2011

Example AnalysisBottleneck

Dislocation

Inconsistency

Instability

Opacity

Rigidity

Traceability

0 3.75 7.50 11.25 15.00

Systemic Issues

Planning

Requirement

Design

Development

Build

Testing

Release

Delivery

0 5 10 15 20

Life-Cycle PhasesBusiness Scale

Control & Auth

Failure Rate

Operational Throughput

Resource Util

0 7.5 15.0 22.5 30.0

Business Issues

Consensus Raw

•8 group sessions•11 individual interviews

•133 problems identified•41 candidate strategies

Saturday, April 23, 2011

Example Strategies

Saturday, April 23, 2011

Example Prioritization/Budget Proposal

Saturday, April 23, 2011

Devops Workshop

‣ Two Day Workshop

‣ Devops and LeanOps Theory

‣ Devops Modeling

‣ Devops Team Build

‣ LeanOps Team Build

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Saturday, April 23, 2011

dtosolutions.comJohn Willis

john@dtosolutions

Saturday, April 23, 2011

top related