Copyright © 2010 Opscode, Inc - All Rights Reserved 1
John WillisVP of [email protected]/botchagalupe
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 2
IT Management PodcastDevopsCafeCloudCafe
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 2
IT Management PodcastDevopsCafeCloudCafe
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 3
The Agile EnterpriseCloud and Devops
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 4
CambrianExplosion
IndustrialRevolution
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 5
Hierarchy Theory
“The rate of evolution of any system is dependent upon the organisation of
its subsystems”
Herbert Simon, Theory of Hierarchy and componentisation.
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 6
A Parable of Two Watch Makers
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 6
A Parable of Two Watch Makers
•Technological evolution (and revolution).
•Introductions of new products
•Strong and unpredictable fluctuations of the demand.
Saturday, November 6, 2010
Saturday, November 6, 2010
A Period of Combinatorial Innovation
Saturday, November 6, 2010
A Period of Combinatorial Innovation
• Abstract and fault tolerant components
Saturday, November 6, 2010
A Period of Combinatorial Innovation
• Abstract and fault tolerant components
• Integrated network accessible services
Saturday, November 6, 2010
A Period of Combinatorial Innovation
• Abstract and fault tolerant components
• Integrated network accessible services
• Unlimited infrastructure
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 8
Agile Infrastructure
• Operating at Cloud Scale • Ephemeral Infrastructure • Frictionless Infrastructure• Self Service Operations
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 9
Agile Operations
• Products not Projects• Walk on Walk off Projects• Velocity of Innovation• Continuos Delivery• Enterprise Lean Startup
Saturday, November 6, 2010
Devops
Saturday, November 6, 2010
Devops: Why Should You Care?
Short Answer:
It’s a way to make your business
more agile
Saturday, November 6, 2010
Devops: Why Should You Care?
Short Answer:
It’s a way to make your business
more agile
Rut Rorit’s rabout ra
business rupid
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
Devops is a cultural and professional movement!
12Saturday, November 6, 2010
Ah-ha! Ka-ching!Wall o
f C
onfu
sio
n
OpsDev
Ah-ha!
IT Anti-Pattern
Saturday, November 6, 2010
DevOps
Wall of iononfusC
Dev Ops
Saturday, November 6, 2010
Devops is About Velocity
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 16Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 16
CultureAutomation
MeasurementSharing
Saturday, November 6, 2010
So What’sYourCultureDog
Saturday, November 6, 2010
Saturday, November 6, 2010
Culture Before Tools
• Leadership • Behavior• Communication• Passion• Having Fun
Saturday, November 6, 2010
Leadership
Saturday, November 6, 2010
Devs Ops
Leadership
Saturday, November 6, 2010
Leadership
Saturday, November 6, 2010
Behavior
Saturday, November 6, 2010
Behavior
Saturday, November 6, 2010
Behavior
Saturday, November 6, 2010
Communication
Saturday, November 6, 2010
Communication
Saturday, November 6, 2010
Passion
Saturday, November 6, 2010
Passion
Saturday, November 6, 2010
Have Fun!
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 31
Cloudy Operations and Devops
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 32
Till the Meatball Hits the Fan
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 32
Till the Meatball Hits the Fan
I did not have “cloudy” meatballs with that provider
Saturday, November 6, 2010
Automa4on
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 34
FullyAutomated Infrastructure
ReleaseControl
Orchestration
Dispatcher
Provisioning
Deploy
Config management
OS boot/install
Artifact repository
Build
CI Server Issue tracker
SCM Repository
Model
Asset inventory
Host naming
Identity
CMDBMonitoring
Events
Trending Reporting
Trending
Workflows
Resources
Topology
Configuration
Code
Sources
Scheduler
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 34
FullyAutomated Infrastructure
ReleaseControl
Orchestration
Dispatcher
Provisioning
Deploy
Config management
OS boot/install
Artifact repository
Build
CI Server Issue tracker
SCM Repository
Model
Asset inventory
Host naming
Identity
CMDBMonitoring
Events
Trending Reporting
Trending
Workflows
Resources
Topology
Configuration
Code
Sources
Scheduler
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 35
What Do Developers
Want?
Saturday, November 6, 2010
For Developers...
• Self Service Operations
• The infrastructure is the application (and vice versa)
• Minimize Bottlenecks
• The “Right” Tools
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 37
What Does Operations Want?
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 38Saturday, November 6, 2010
Operations• Say “Yes”.
• You never liked rack and stack that much anyway.
• You have never been more critical.
• Just get out of the way.
http://covers.oreilly.com/images/9780596007836/lrg.jpg
Saturday, November 6, 2010
Automate Everything
•Integration•Builds•Tests•Deploys•Orchestration
Saturday, November 6, 2010
Infrastructure as Code
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Saturday, November 6, 2010
Infrastructure as Code
‣ Version control
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Saturday, November 6, 2010
Infrastructure as Code
‣ Version control
‣ Process control
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Saturday, November 6, 2010
Infrastructure as Code
‣ Version control
‣ Process control
‣ Application control
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Saturday, November 6, 2010
A Tornado Hits Your Data
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
• Change DNS to point to “Hit by Tornado” page
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
• Change DNS to point to “Hit by Tornado” page
• Restore the customer and application data
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
• Change DNS to point to “Hit by Tornado” page
• Restore the customer and application data
• Remove the “Hit by Tornado” page
http://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
• Change DNS to point to “Hit by Tornado” page
• Restore the customer and application data
• Remove the “Hit by Tornado” page
• Unpause moviehttp://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
• Change DNS to point to “Hit by Tornado” page
• Restore the customer and application data
• Remove the “Hit by Tornado” page
• Unpause moviehttp://www.flickr.com/photos/gi/518613153/sizes/o/
Saturday, November 6, 2010
A Tornado Hits Your Data
• Pause your movie
• Sign into your cloud provider
• Download your offsite backups
• Provision, config and integrate the new servers
• Change DNS to point to “Hit by Tornado” page
• Restore the customer and application data
• Remove the “Hit by Tornado” page
• Unpause moviehttp://www.flickr.com/photos/gi/518613153/sizes/o/
Chapter 5 Infrastructure
as CodeAdam Jacob
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
In a Cloudy WorldYour Prime Constraint Should Be
43
http://www.flickr.com/photos/visualage/2126833132/sizes/o/
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
In a Cloudy WorldYour Prime Constraint Should Be
43
The time it takes to
restore your application
data
http://www.flickr.com/photos/visualage/2126833132/sizes/o/
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
Cloudy Configuration Management
44Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
Cloudy Configuration Management
44
Provisioning
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
Cloudy Configuration Management
44
Provisioning
Configuration
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved
Cloudy Configuration Management
44
Provisioning
Configuration
Systems Integration
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 45
Nodes
opslb01
opsws01opsws02
opsdm01opsds01opsds02
Provisioning
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 46
Roles
loadbalancerwebserverdbmasterdbslave
Configuration Management
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 47
Load Balancer
Web Server Web Server
DB Master
DiskDisk
DB Slave DB Slave
Disk
Recipes
haproxyapache2myssql
Systems Integration
Saturday, November 6, 2010
name "webserver"description "Systems that serve HTTP traffic"
run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")
default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })
Role Based Configuration
Saturday, November 6, 2010
name "webserver"description "Systems that serve HTTP traffic"
run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")
default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })
Role Based Configuration
Saturday, November 6, 2010
name "webserver"description "Systems that serve HTTP traffic"
run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")
default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })
Role Based Configuration
Saturday, November 6, 2010
name "webserver"description "Systems that serve HTTP traffic"
run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")
default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })
Role Based Configuration
Saturday, November 6, 2010
name "webserver"description "Systems that serve HTTP traffic"
run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")
default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })
Role Based Configuration
opsws01
Saturday, November 6, 2010
name "webserver"description "Systems that serve HTTP traffic"
run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")
default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })
Role Based Configuration
opsws01 opsws02
Saturday, November 6, 2010
•
Systems Integration
Saturday, November 6, 2010
•
Systems Integration
Saturday, November 6, 2010
•
Systems Integration
Saturday, November 6, 2010
•
Systems Integration
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 50
Load Balancer
Web Server Web Server
DB Master
DiskDisk
DB Slave DB Slave
Disk
Fully Automated InfrastructureProvisioning Configuration Integration
Saturday, November 6, 2010
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Infrastructure as Data
Saturday, November 6, 2010
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Discoverable Data
Saturday, November 6, 2010
•
Using a Search API
Saturday, November 6, 2010
•
Using a Search APIText
Saturday, November 6, 2010
• Text
Using a Search APIText
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Non Discoverable Data
Saturday, November 6, 2010
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Non Discoverable Data
Saturday, November 6, 2010
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Non Discoverable Data
Saturday, November 6, 2010
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Non Discoverable DataLoad Balancer
Web Server Web Server
DB Master
DiskDisk
DB Slave DB Slave
Disk
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg
Saturday, November 6, 2010
Metrics
Measurement
Saturday, November 6, 2010
Measure Everything
• Performance Metrics• Process Data• People Data•Heuristics
Saturday, November 6, 2010
Continuos Improvement
Saturday, November 6, 2010
Old School is Still Cool
•Change•Incident•TTR/TTD
Saturday, November 6, 2010
Sharing
Saturday, November 6, 2010
Thinking that secrecy
makes you better
Anti-Pattern:
Saturday, November 6, 2010
Share Everything
• Share Metrics• Share Ideas• Share Stories•Give Developers Access• Allow Operations to Leverage
Saturday, November 6, 2010
P
Be bold-and mighty forces will come to
your aidBasil King
Saturday, November 6, 2010
Case Studies
Saturday, November 6, 2010
Homework...1. Web Operations (John Allspaw)1. Lean Startup (Eric Ries)2. Continuous Deployment (Jez Humble)2. Agile Planning (Scrum, Kanban)3. Test Driven Development / Operations
Extra Credit:5. DevOps Cafe Podcast (DevOpsCafe.org)6. Follow me on Twitter (@botchagalupe)
Saturday, November 6, 2010