devops enterprise summit: my great awakening: top “ah-ha” moments as former dev manager

© Copyright 2014 Pivotal. All rights reserved.© Copyright 2015 Pivotal. All rights reserved.

My Great Awakening: Top “Ah-ha” Moments As Former Dev ManagerDevops Enterprise Summit October 2015

1

Cornelia Davis ● @cdavisafc ● [email protected] CTO, Transformation Practice

© Copyright 2014 Pivotal. All rights reserved.© Copyright 2015 Pivotal. All rights reserved. 2

When I first started working on PaaS…

“For us, PaaS is a set of services aimed at developers that helps them develop and test apps without having to worry about the underlying infrastructure. Developers don't want to have to worry about provisioning the servers, storage and backup associated with developing and launching an app.”

… but then I learned

[1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html [2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696

http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html

http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696


• One month on the ops team • Production platform deployment • 24 x 7 x 365

Lessons!!


My very first morning…


App App

App App

Log

Log


App App

App App

Log

Log

/dev/null

App App

App App


App App

App App

Log

Log

App App

App App

Log

Log


App App Log

Cloud Ops

App Team


App App Log

Cloud Ops App Team

!! OK


• Ops team has a backlog and a Product Manager • (just as app team)

• Ops team has a “prod pair” • App team has a “prod pair” • A very sensible way of

managing deployments


More About Deployments…


1. Do deployments during working hours

HOW??? 2. Immutable Infrastructure

NO SNOWFLAKES!!! 3. Single deployable artifact

BUILDS DONE BEFORE DEPLOY

Runtime: Dev ! Mast Services: Dev ! Mast

Svc: Mast ! CR; RT: Mast ! CR

Dijon Tabasco

A1

Prod

Services: Dev; Runtime: CR Services: CR; Runtime: Dev

Services: Mast; Runtime: Mast

Services: Rel; Runtime: Rel

Svc: CR ! Rel; RT: CR ! Rel

Shared Package Cache


1. Do deployments during working hours

HOW??? 2. Immutable Infrastructure

NO SNOWFLAKES!!! 3. Single deployable artifact

BUILDS DONE BEFORE DEPLOY4. Declarative deployment specification

EVENTUAL CONSISTENCY!

Amend

(Re)deploy

(Re)configure

(Re)connect

Monitor

Current State Desired

State


More About Single Deployable Artifact…


Env Vars

Cust DB

mock

Env Vars

Cust DB

Env Vars

Cust DB


Let’s Come Back to Ops and Dev Responsibilities…


App App

App App

Log

Log


App App

App App


A AA A


A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

A AA A

...

Started updating job runner_z1 > runner_z1/91. Done (00:01:06) Started updating job runner_z1 > runner_z1/92. Done (00:01:06) Started updating job runner_z1 > runner_z1/93. Done (00:01:06) Started updating job runner_z1 > runner_z1/94. Done (00:01:06) Started updating job runner_z1 > runner_z1/95. Done (00:01:06) Started updating job runner_z1 > runner_z1/96. Failed

!!


On the… BOSH Agent port: Directory Server port:

… healthy DEA 35560 34567

… unhealthy DEA 34567 Port binding failed

23

Ephemeral Port Range: 32768 to 61000

Developer should not have used port 34567

Dynamically Assigned

Statically Assigned


Your Application Code

Platform

Virtualized Infrastructure

Platform Operations

Application Development Application Operations

Creates deployable artifact

• Config Prod space • Deploys application to Prod • Monitors application • Scales application

(capacity) • Deploys new app version

with zero downtime.

• Deploys platform • Makes standard runtimes and

services available • Monitors platform • Scales platform

(ensuring sufficient capacity) • Upgrades platform with zero-

downtime


The Takeaways


• Treat Ops as any other product • backlog, prod pair

• Workday deployments • Single deployable artifact • Separate application operations

from platform operations • App team = App Dev + App Ops


• Revelations From the Field – Life in the Operations Team (the one about the loggregator scaling)

http://blog.pivotal.io/cloud-foundry-pivotal/p-o-v/revelations-from-the-field-life-in-the-operations-team

• Is Continuous Delivery a First Class Concern of Your Platform? (the one about dashboards)

http://blog.pivotal.io/cloud-foundry-pivotal/products/is-continuous-delivery-a-first-class-concern-of-your-platform

• Cloud Foundry Ops: Ephemeral Ports and the Value of a Platform as a Service (the one about, well, ephemeral ports)

http://blog.pivotal.io/cloud-foundry-pivotal/p-o-v/cloud-foundry-ops-ephemeral-ports-and-the-value-of-a-platform-as-a-service

http://blog.pivotal.io/cloud-foundry-pivotal/p-o-v/revelations-from-the-field-life-in-the-operations-team

http://blog.pivotal.io/cloud-foundry-pivotal/products/is-continuous-delivery-a-first-class-concern-of-your-platform

http://blog.pivotal.io/cloud-foundry-pivotal/p-o-v/cloud-foundry-ops-ephemeral-ports-and-the-value-of-a-platform-as-a-service


Here’s what I need help with

https://www.washingtonpost.com/news/innovations/wp/2014/02/14/silicon-valleys-gender-imbalance-in-one-chart/

Changing the distribution will take effort from all of us!

https://www.washingtonpost.com/news/innovations/wp/2014/02/14/silicon-valleys-gender-imbalance-in-one-chart/


Thank you!Devops Enterprise Summit October 2015

29

Cornelia Davis ● @cdavisafc ● [email protected] CTO, Transformation Practice

devops enterprise summit: my great awakening: top “ah-ha” moments as former dev manager

Technology