devops adoption in the enterprise

1

Presented by:

© IBM Corporation

Adopting DevOps at Enterprise Scale

Sanjeev Sharma CTO, DevOps Technical Sales and Adoption IBM Distinguished Engineer @sd_architect

2 © IBM Corporation

DevOps: Origins

3 3 © IBM Corporation

DevOps in the Enterprise: Multiple Bottlenecks

Product Owner

Senior Executives

Users Domain Experts Auditors

Gold Owner Support Staff

External System Team

Operations Staff

Team Member Team Lead

Team Member Team Member

Line-of-business

Customer


DevOps approach: Apply Lean principles accelerate feedback and improve time to value

People

Process

Line-of-business

Customer

1

3

2

1.  Get ideas into production fast 2.  Get people to use it 3.  Get feedback

Continuously Improve: I.  Application Delivered II.  Environment Deployed III.  Application and Environment Delivery

Process


Lean & Agile are at the heart of IBM’s DevOps approach

–  Balance efficiency and effectiveness to –  deliver the right things right!

Reduce work Eliminate

bottlenecks and waste

Fast response times

Small batch sizes Continuous feedback

LEAN

AGILE

Efficiency

Effectiveness


Voice of the IT – Senior Application Development Executive

Steve Farley, VP Application Development Center, Nationwide Insurance

Carmen DeArdo, Director, Build Technology Leader, Nationwide Insurance


More executive perspectives on DevOps

Gareth Wharton, CTO, Hiscox

Snehal Antani, CIO CDF & CIO EA, GE Capital Americas

“We built software and apps, such as our award-winning bank – GECapitalBank.com – from scratch in weeks to months – instead of months to years.”


Patterns of DevOps Adoption


Patterns of DevOps Adoption

Three Key Business Drivers

1.  Driving Business Agility 2.  Scaling for the Enterprise 3.  Driving Innovation


Adoption Pattern #1: Driving Business Agility


Adoption Pattern #1: Scenarios

Driving Business Agility

•  Continuous Delivery •  Shift Left Test •  Shift Left Ops Engagement •  ‘Lean' Application Delivery


Where does DevOps Adoption Start?

Production Develop Build Test Deploy Plan

By the end of 2015, 75% of large organizations are expected to have adopted agile DevOps practices (IDC)

Agile Adoption

Water-SCRUM-fall


Going from Agile to DevOps

End-to-End Delivery Pipeline

14 © IBM Corporation 14

Collaborative Development •  Continuous Integration •  ‘Single Source of Truth’ – Requirements, Source Code, Tests,

Deployable assets, Software Defined Environments •  Common Dashboards to show metrics


Deployment Automation

•  Manage application components and versions

•  Manage configurations across all environments

•  Offer secure ‘self-service’ capabilities

•  Increase transparency •  Ensure governance and compliancy


Databases Internal Messages

Third-party Services

virtual components

Simultaneously test across multiple test

stages

Dev QA

Test Virtualization

IBM UrbanCode Deploy

Test Automation

integrated with

Test Environments

Dynamic Infrastructure

§  Deploy what is ready, virtualize the rest

§  Continuously test in production-like env.

§  Deploy private, secure right sized test data

Test Data Management

Rational Test Workbench

Quality Management §  Manage quality across the delivery lifecycle

Shift Left Test: Deploy what is ready, Virtualize the rest


Deploying Infrastructure is the biggest bottleneck for the Delivery Pipeline

•  Software Defined Environments enable you to capture infrastructure as a software artifact

Extending the Agile Manifesto: Working software over comprehensive documentation -> Working software (in Production or production-like environment) over comprehensive documentation

‘Shift Left’ Ops Engagement

Application !Changes!

Infrastructure!Changes!


‘Lean’ Delivery Pipeline

Case Study: Large Bank Challenge:

–  Developers were creating daily builds –  QA team had a 3 – 5 day cycle time

Bottlenecks Identified: –  Large Sizes of Testing Deployments –  Lack of Deployment Automation –  Ticket based manual environment provisioning –  Lack of reliable source of Test Data

Solution: –  Deployment Automation with IBM UrbanCode Deploy –  Cloud hosted ‘on-demand’ environments with IBM

UrbanCode Deploy with Patterns –  Test Automation and Service Virtualization with IBM

Rational Test Workbench –  Test Data Management with IBM Optim Test Data

Management


End-to-end testing with Continuous Delivery and Test Virtualization

Databases Mainframe applications


Rational Test Virtualization Server


Virtualized Services

SCM Build

Deploy

Rational Test Workbench Test

RTW plugin

RTVS plugin

Actual Services

Optim plugin

Optim Test Data Management

UAT

UrbanCode Deploy

Extract Data, Insert Data, Convert/Mask Data Update Data

Configure and start Virtual Services

Deploy App and Configure Middleware

19

Cloud Pla+orm



Adoption Pattern #2: Scaling for the Enterprise



Scaling for the Enterprise

•  Release Automation for 2-speed IT •  Standardization across the

enterprise


Applications, teams and environments are “hybrid”: 2-Speed IT

Rapid iterations

Cloud

Slower iterations

Behind the firewall

Alignment Continuous synchronization and planning

Continuous testing Continuous deployment and monitoring

Plan Develop Build Test Deploy Production

Plan Develop Build Test Deploy Production


•  Keep track of the inventory across the entire life cycle of the release •  Control the entire release lifecycle in an easy to use view

Orchestrating Complex Releases


Application Deployment to Hybrid Environments

IBM UrbanCode Deploy with Patterns

IBM Bluemix

Cloud Foundry

On-prem IaaS

On-prem Traditional IT

IBM Cloud Orchestrator IBM PureApplica8on System

IBM Cloud Manager with OpenStack

24

Virtual Machines

Docker Containers

IBM UrbanCode Release

Systems of Engagement

Systems of Record


Adopting DevOps for 2-speed IT

Case Study: Multinational Financial Services Provider Challenges:

–  Delivering a Business Capability with multiple services and applications across Hybrid Environments

Bottlenecks Identified: –  Lack of Release Planning –  Inability to test when needed, as services are not available/ready –  Coordinating complex Releases, made up of deployments across

Hybrid Environments Solution:

–  Release Planning with IBM UrbanCode Release –  Deployment Automation a cross Hybrid environments with IBM

UrbanCode Deploy with Patterns –  Test Automation and Service Virtualization with IBM Rational Test

Workbench –  Rapid Deployment across distributed datacenters with Aspera


IBM UrbanCode Release

Legacy Stack On-Prem Cloud

Rational Test Workbench IBM UrbanCode Deploy with Patterns

Provision Application

Infrastructure

Private Cloud

Pattern Engine

Provision Application + Infrastructure

Platform as a Service (Public)

BlueMix

Infrastructure

System z and/or Distributed Applications

On-prem Customer Data Centers


IBM Cloud Orchestrator as a Service

Public Data Centers

AP

I Gatew

ay

CloudFoundry ‘Community’ Buildpacks

IBM DevOps Services

APIs

APIs

Off-Prem Cloud

Infrastructure

IBM Cloud Orchestrator

Pattern Engine


Application Deployment for Hybrid environments

Aspera


Adoption Pattern #3: Driving Innovation



Driving Innovation

•  Rapid Delivery for Innovation/Experimentation

•  Architecting for the Cloud


Innovation: Rapid Deployment and Feedback for Experimentation

Line-of-business Customer

1

3

2

1.  Get ideas into production fast 2.  Get people to use it 3.  Get feedback 4.  Improve and Iterate

•  Canary Testing, A/B Testing •  Containerization •  Microservices


Build your apps, your way Bluemix is powered by a full open cloud architecture Bluemix supports a wide diversity of workloads by offering developers a range of

choices associated with how they build and run their apps.

App-centric runtime environments

Flexible and powerful VMs

Portable and consistent containers

•  Pure PaaS•  Support for node.js, Java, Go,

Python, Ruby, Ruby on Rails, .php and includes the ability to bring your own buildpack

•  Focus on your code and your data, the platform manages the rest

•  Deploy and manage VMs consistently for dedicated and public clouds through a single dashboard using open source technologies.

•  A user-specific repository of images which are trusted and secure

•  High availability of the IBM-hosted container images

•  Integrated networking and storage

IBM Bluemix


IBM Bluemix DevOps Services

Agile Planning

Continuous Integration

Web IDE

Hosted Git Jazz SCM

Monitoring & Analytics

Mobile Quality

Source Control

Plan and code

Feedback

Build and Deploy Continuous Delivery


Static website Web frontend User DB Queue Analytics DB

Development VM

QA server Public Cloud Contributor’s laptop

Docker – A shipping container system for code

Mul$p

licity

of

Stacks

Mul$p

licity

of

hardware

environm

ents

Production ClusterCustomer Data Center

Do services and apps interact appropriately?

Can I migrate

smoothly and quickly

…that can be manipulated using standard operations and run consistently on virtually any hardware platform

An engine that enables any payload to be encapsulated as a lightweight, portable, self-sufficient container…


Dan the Developer Worries about what’s “inside” the container •  His code •  His Libraries •  His Package Manager •  His Apps •  His Data All Linux servers look the same

Why it works — DevOps Nirvana?

Oscar the Ops Guy Worries about what’s “outside” the container •  Logging •  Remote access •  Monitoring •  Network config

All containers start, stop, copy, attach, migrate, etc. the same way


IBM’s Delivery Pipeline for Containers

IBM Container Image Build

Service

Image Registry

IBM UrbanCode Deploy with Patterns


Creating a DevOps Culture And now for the hard part…


It’s all about the people!

Building a DevOps Culture grounded in lean and agile principles •  Everyone is responsible for Delivery •  Common measures of Success •  Setup a DevOps Center of Excellence

Product Owner

Senior Executives

Users Domain Experts Auditors

Gold Owner Support Staff

External System Team

Operations Staff

Team Member Team Lead

Team Member Team Member


Start Here: Value Stream Mapping for Identifying and Addressing bottlenecks


Bottlenecks in your Delivery Pipeline Address issue of congestion in software delivery

1 per min 1 per min

4 per min 1 per min

4 per min 4 per min


Mapping your Delivery Pipeline

Idea/Feature/Bug Fix/ Enhancement

Production

Development Build QA SIT UAT Prod

PMO

Requirements/ Analyst

Developer

Customers Line of Business

Build Engineer

QA Team Integration Tester User/Tester Operations

Artifact Repository

Deployment Engineer

Release Management

Code Repository

Deploy

Get Feedback

Infrastructure as Code/ Cloud Patterns

Feedback

Customer or Customer Surrogate

Metrics - Reporting/Dashboarding

Tasks

Artifacts

Bottleneck: Rigid ‘One-size-fits-all’ Development process

Solution: Agile Transformation with ‘Risk-Value’ based Process Variants

Bottleneck: Ticket Based Environment Provisioning

Solution: Cloud Hosted Developer ‘Self-Service’

Bottleneck: Weekend long Deployments that often fail

Solution: Frequent Deployment of Small Batches of Change Bottleneck: Late Discovery of

Architectural Fragility

Solution: Agile ‘Shift Left’ Integration Testing to early in LifeCycle


For Dummies books: http://ibm.co/devopsfordummies http://ibm.co/agilefordummies http://ibm.co/ServiceVirtualizationForDummies http://ibm.co/ARDfordummies DevOps Lean Assessment (Beta): http://bit.ly/IBMLeanAssess IBM DevOps Page: http://ibm.com/DevOps IBM DevOps YouTube Playlist: http://bit.ly/1fiDOtl

Resources Continuing your DevOps Adoption journey


Questions?


Acknowledgements and disclaimers

© Copyright IBM Corporation 2013. All rights reserved. – U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM, the IBM logo, ibm.com, Rational, the Rational logo, Telelogic, the Telelogic logo, Green Hat, the Green Hat logo, and other IBM products and services are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml If you have mentioned trademarks that are not from IBM, please update and add the following lines: [Insert any special third-party trademark names/attributions here] Other company, product, or service names may be trademarks or service marks of others.

Availability: References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.


© Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

Thank You


Backup Slides








SCM Build

Deploy


RTW plugin

RTVS plugin

Actual Services

Optim plugin


UAT

UrbanCode Deploy




46

Cloud Pla+orm


IBM UrbanCode Deploy: •  Continuous Delivery to Dev – Test

environments •  Configure Middleware and

Environments •  Configure Virtual Test Servers •  Inventory Management •  Security Management

Challenge Addressed: •  Developer Self Service for end-

to-endTesting








SCM Build

Deploy


RTW plugin

RTVS plugin

Actual Services

Optim plugin


UAT

UrbanCode Deploy




Deploy what is ready, virtualize the rest 47

Cloud Pla+orm


IBM Rational Workbench: •  Virtualize Services for testing •  Manage Virtualized Test

environments •  Integration testing •  Performance testing •  Security Testing with AppScan

Challenge Addressed: •  Early testing (Shift-left) •  Continuous end-to-end testing •  Remove dependencies on back-

end service availability for testing •  Remove dependencies on test

environment availability •  Virtualize expensive mainframe

services








SCM Build

Deploy


RTW plugin

RTVS plugin

Actual Services

Optim plugin


UAT

UrbanCode Deploy




48

Cloud Pla+orm


IBM InfoSphere Optim: •  Test Data management •  Mask and provide sets of test

data for Continuous Testing

Challenge Addressed: •  Test Data Management








SCM Build

Deploy


RTW plugin

RTVS plugin

Actual Services

Optim plugin


UAT

UrbanCode Deploy




49

Cloud Pla+orm


IBM UrbanCode Deploy with Patterns: •  Dev-Test-Prod Environment

Provisioning •  Full Stack Deployment •  Environment Portability

Challenge Addressed: •  Full Stack Provisioning


Standardization Across the enterprise: Patterns and Templates

What to deploy?

Where to deploy (Physical or Cloud Resources) - Patterns

How to deploy?

Application Blueprints in IBM UrbanCode Deploy

with Patterns

devops adoption in the enterprise

Software

ibm corporation voice

test shift

test automation

devops technical sales

devops gareth wharton

application components

business customer

agile efficiency effectiveness