building devops with beer & whiteboards

BUILDING DEVOPS

WITHBEER AND

WHITEBOARDSJOHN MARTIN@tekBuddha

STEVE BURTON@BurtonSays

CALL OF DUTY:DEV OPS

the challenge

GAME SELECT

DEVELOPERDEVELOPER

OPERATIONSOPERATIONS

DEVOPSDEVOPS

NOOPSNOOPS

AA

DEVOPS

MISSION PARAMETERS:

MISSION OBJECTIVESKILL YOUR COMPETITORS

- DEVELOP, TEST, DEPLOY, OPERATE- AUTOMATION & BUSINESS AGILITY

RECOMMENDED ESSENTIALS BEER, WHITEBOARDS, COMMUNICATION

but what is success?

“success is going from failure to failure without

losing enthusiasm”

Winston Churchill

failure

mean time to innocence (MTTI)

mean time to resolution (MTTR)

Weeks, Days, Hours or Minutes?

mean time between failure (MTBF)

Weeks, Days, Hours or Minutes?

availability?

99.9%The most meaningless metric in IT today.

business metrics

> revenue

> throughput

> performance

> productivity

Edmunds.com

EXPERT CAR ADVICE

FOUNDED IN 1966

550 EMPLOYEES

650K DAILY UNIQUES

whoami

SR DIRECTOR PRODUCTION ENGINEERING

A DECADE SUPPORTING JAVA ARCHITECTURES

FUELED BY METRICS, WHITEBOARDS, LOGS, AND BEER

Our environment.

Compelling Events

Source: http://is.gd/iJU4et

Growing Pains

Communication

2010 Redesign

Source: http://is.gd/L77vl1

COMPLETE REWRITE OF PLATFORM

QA & BETA WORKED GREAT!

BETA BECOMES PROD

3 MONTHS IN A WAR ROOM

NOT LIKE THIS

Source:http://is.gd/PFLRmW

LIKE THIS

Source: http://is.gd/iJU4et

OUT OF HERE

Source: http://is.gd/oFCXNH

IN TO HERE

Source: http://is.gd/iJU4et

ONE OF THE MOST UNDER RATED TOOLS YOU ALREADY HAVE.

THE WHITEBOARD

TEARING IT DOWN

Source: http://is.gd/Vrnwu4

The Toolshed

Communicating with Metrics

Source: http://is.gd/L77vl1

DATA DRIVEN CULTURE

CHECK THE GUT

DRIVE ACCOUNTABILITY

LEARN FROM FAILURE

CLOUDY SKIES

Source: http://is.gd/arBZ4M

Putting It All Together

Source: http://is.gd/L77vl1

UNCHARTED WATERS

FAMILIAR TOOLING

IMPROVED COMMUNICATIONS

MEASURABLE SUCCESS STORIES

A Personal Note

Source: http://is.gd/L77vl1

A Personal Note

Source: http://is.gd/L77vl1

The Business Proposition

Source: http://is.gd/L77vl1

THE CLOUD ISN’T FREE

COST PER HOST CAN GET SCARY

LOOK FOR THE FREEBIES

AWESOMENESS

Source: http://is.gd/iJU4et

Measuring Success

Source: http://is.gd/L77vl1

Before After Benefit $ Savings

Application Availability % 99.91% 99.95% > 0.04% $167k revenue protection

# of High Severity Incidents 21 10 < 50% $307k productivity

# of Help desk Tickets 196 99 < 50%

MTTR in Pre-Production 5 Days 2 Days < 45% $320k productivity

Time To Build Runways 3 Months < 1 Week Seriously?!

Operating Costs $$$$ TBD

Team Morale Bummered Beer

OUT OF HERE

Source: http://is.gd/oFCXNH

IN TO HERE

Source: http://is.gd/iJU4et

Source: http://is.gd/xKdI6E

WHERE NEXT?

JOHN MARTINjmartin@edmunds.com@tekBuddha

STEVE BURTONsburton@appdynamics.com@BurtonSays

QUESTIONS?We’re hiring!

Stop by our booth!