leanops idg cloudworld korea

Open Source Tools and Operations Methodologies for Unlocking the Business

Value of the Cloud

Saturday, April 23, 2011

• Open Source Tools• Operations Methodologies• Business Value of Cloud


Buying or Building a Cloud Does Not Make Your

Business Agile!


Buying or Building a Cloud Does Not Make Your

Business Agile!

Building a Cloud is EasyManaging a Cloud is Not!


Agenda

• Introductions

•Devops

•Devops Stories

•A LeanOps Success Story

•How You Can Deliver LeanOps


Company Background

• Founded in 2004 from:

• eTrade, NASA, Fidelity, Schwab

• Canonical, Opscode

•Agile IT and Operations Team

• Over 100 person-years and 6 books

• Financials, telco, transpiration, etc.

•Headquartered in San Mateo CA

• Offices in Atlanta, and San Francisco


Our Customers


[email protected]

John Willis

twitter.com/botchagalupe


mailto:[email protected]

mailto:[email protected]

Operations: The Elephant in the Room

Once we move to software as a service, everything we thought we knew about competitive advantage has to be rethought.

Tim O'Reilly - Operations: The New Secret Sauce


XaaS


XaaS

"anything as a service" or "everything as a service." The acronym refers to an increasing number of services that are delivered over the Internet rather than provided locally or on-site.


The New Face of a Rock Star

John Allspaw - VP of Technical Operations at Etsy


http://etsy.com/

http://etsy.com/

Devops is a cultural and professional movement!


Devops is About Velocity


Devops is About Velocity

Velocity of Innovation


LeanOps

Is a commodity based software infrastructure that focuses on eliminating

waste and reducing the time between market assumptions and customer

delivery.


LeanOps



delivery.

Devops


LeanOps



delivery.

DevopsAgile IT


LeanOps



delivery.

Devops

Lean Startup

Agile IT


LeanOps



delivery.

Devops

Lean Startup

Agile IT

EnterpriseLean Startup


Devops Lifecycle

ah ha! ka ching!

Dev

Business Process

Remove

Shorten

Ops


Devops Lifecycle

ah ha! ka ching!

Dev

Business Process

Remove

Shorten

Ops

Compressed SDLC


Typical Ops Resources


Typical Ops Resources

LeanOps


LeanOps Loosely Coupled Toolchain


LeanOps Staff Allocation to Value Generation

DeploymentTestingDevelpment

Before

After

Build

TestingDevelpment

DeploymentBuild

Measuring how your team's time is allocated


LeanOps Necessities


LeanOps Necessities

Fully Automated

Infrastructure


LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure


LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Test Driven

Development

Continuous

Deployment

Fully Automated

Infrastructure


LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Test Driven

Development

Continuous

Deployment

Fully Automated

Infrastructure

Test Driven

Development

Immune

System

Continuous

Deployment

Fully Automated

Infrastructure


LeanOps Necessities

Fully Automated

Infrastructure

Test Driven

Development

Fully Automated

Infrastructure

Test Driven

Development

Continuous

Deployment

Fully Automated

Infrastructure

Test Driven

Development

Immune

System

Continuous

Deployment

Fully Automated

Infrastructure

Test Driven

Development

Immune

System

Continuous

Deployment

Agile

Culture

Fully Automated

Infrastructure


LeanOps Ingredients


DevOps Examples


•Model Driven Configuration

•Automated Deployment

•Continuous Delivery

•Built Their Own Private Cloud

• Self Service Infrastructure

• SVN, Hudson, Puppet

•Nagios, JMX, CassandraSaturday, April 23, 2011

•Agile Infrastructure

• Every Two Weeks They Re-factor Apps and Infrastructure

•Chef


•Built a Self Service SaaS Cloud

•Chef, Puppet, Amazon, Azure, Splunk, Zookeeper, RabbitMQ

•Cloudkick


• First Push to Production on Interview

• 50 to 100 Production Deploys per day

• Puppet, Hudson, Zookeeper, Nagios, Esper

•Behavior Driven Monitoring

• Immune System Deploys


LeanOps Case Study


“Very” Large Game CompanyStarted Out Small With a Cloud


apache/phpmemcached

mysql

Dev



Rightscale

AWS s3apache/phpmemcached

mysql

Dev



Rightscale

AWS s3

s3putssh

apache/phpmemcached

mysql

Dev



Rightscale

AWS s3

s3putssh

apache/phpmemcached

mysql

Dev


winning.com


“Very” Large Game CompanyVery Fast Growth

apache/phpmemcached

mysql

Rightscale

AWS s3

winning.com



apache/phpmemcached

mysql

Rightscale

AWS s3

winning.com

Rightscale

AWS s3

warlock.com

apache/phpmemcached

mysql

s3put

tigerblood.com

Rightscale

AWS s3

apache/phpmemcached

mysql

s3put

ssh



apache/phpmemcached

mysql

Rightscale

AWS s3

winning.com

Rightscale

AWS s3

warlock.com

apache/phpmemcached

mysql

s3put

tigerblood.com

Rightscale

AWS s3

apache/phpmemcached

mysql

s3put

ssh

yuMpUppEt

3rd party

,

&middle

ware


victims of successCOMPLAINTS

BEGAN TO MOUNT


SOFWARE DOESN'T WORK

RIGHT !


BEGAN TO MOUNT



RIGHT !


BEGAN TO MOUNT

MY BOXES GOT CLOBBERED !



RIGHT !


BEGAN TO MOUNT

GIVE ME MY ENVIRONMENT!




RIGHT !

ANOTHER DEAD MACHINE ?


BEGAN TO MOUNT

GIVE ME MY ENVIRONMENT!



started asking questions


people ?



process?

people ?



process?

people ?


tools ?Saturday, April 23, 2011

studio devs

middlewaredevs

NOC

systemadmins

EC2

servertemplates

yum repo

RS deploymentRS

deployment

puppet

S3

code,content

code

TARTAR

TARTAR

platform

TARRPM

TARRPM

servertemplates

EXE

AUTO

TOOLS

Provision-time builds

CONTROL

restarts

deploys

reconfigs

PROVISION RELEASE

“Very” Large Game CompanyBefore LeanOps Implementation


“Very” Large Game CompanyAfter LeanOps Implementation

processmessaging,queuing

apache/phpmemcached

mysql

app middleware 3rd party

buildsprod

rundeck

jenkins"promote"

job

"Deploy" & "Release"job

code,content, metas

winning.com

yum

yum yum

dev


pup

pet

SVN

active

directory

splunk

instance create

resource model

users packages

new node Node a

commands

right

scale

run

deck

hud

son

yum

repo

nag

ios

packages

sys cfg

eventslog data

agent cfg

CONTROL PROVISION RELEASE

“Very” Large Game CompanyInfrastructure as SDLC


Ops part of the architecture

mysqlweb[server array] memcached[server array]

rundeck puppetyum

new Rightscale deployment

operations middleware tools


How it is done• Discovery process through workshop

sessions and individual meetings

• Formal decision modeling to align strategies to business goals

• Cost-benefit analysis

• Validate against reference process architecture and Open-Source application and system provisioning tool-chain (process vs platform rationalization)

Discover

Align

Act


Program Organization



Program Management Assessment engineers




Individual Interviews&

Working groups

SVPs

IT Architecture, Software Engineering, Software QA, Systems Engineering



AdvisoryCommittee

Various VPs



Working groups

SVPs




SponsorCIO

AdvisoryCommittee

Various VPs



Working groups

SVPs



Priority


Example AnalysisBottleneck

Dislocation

Inconsistency

Instability

Opacity

Rigidity

Traceability

0 3.75 7.50 11.25 15.00

Systemic Issues

Planning

Requirement

Design

Development

Build

Testing

Release

Delivery

0 5 10 15 20

Life-Cycle PhasesBusiness Scale

Control & Auth

Failure Rate

Operational Throughput

Resource Util

0 7.5 15.0 22.5 30.0

Business Issues

Consensus Raw

•8 group sessions•11 individual interviews

•133 problems identified•41 candidate strategies


Example Strategies


Example Prioritization/Budget Proposal


Devops Workshop

‣ Two Day Workshop

‣ Devops and LeanOps Theory

‣ Devops Modeling

‣ Devops Team Build

‣ LeanOps Team Build

http://www.flickr.com/photos/asten/2159525309/sizes/l/




dtosolutions.comJohn Willis

john@dtosolutions


leanops idg cloudworld korea

Business

software infrastructure

market assumptions

teams time

devopsleanopsagile itis

leanops necessitiessaturday

leanops success story

leanops staff allocation

technical operations