transform. innovate

54
Transform. Innovate. How DevOps and Cloud are changing Engineering Melody Meckfessel Engineering Director [email protected]

Upload: dangtruc

Post on 13-Feb-2017

244 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Transform. Innovate

Transform. Innovate. How DevOps and Cloud are changing Engineering

Melody Meckfessel Engineering Director [email protected]

Page 2: Transform. Innovate

Cloud Computing

Innovation in Engineering

The Road Ahead

Agenda

Page 3: Transform. Innovate

Cloud Computing

Page 4: Transform. Innovate

Big Trends

enabling a new world via mobile

global connections at any minute

connections virtually everywhere

Any PlaceAny Device

minds of many need to collaborate

vitally important to stay ahead

consumer leads, business follows

AdoptionSpeedAny Team

Any Time

Page 5: Transform. Innovate

75years

1957 2003 2013

500

25years

10years

(average age of a company joining the S&P 500)

Page 6: Transform. Innovate

95%using cloud services

230k Yearssocial media per month

40%own a smartphone

Page 7: Transform. Innovate

Google confidential | Do not distribute

Enterprise Cloud Platform market will exceed $22B globally by 2015.2013

Page 8: Transform. Innovate

Google confidential | Do not distribute

“People tend to overestimate what can be done in one year and to underestimate what can be done in five or ten years.”Amara's Law

Page 9: Transform. Innovate

IT Trends

The decreasing cost of storage enables virtually limitless storage in the cloud. $600 can buy enough storage for the world’s music.

(Source: McKinsey Global Institute May 2011)

Computing as a utility is now available for easy purchase, provided from massively efficient data centers.

(Source: Nicholas Carr, The Big Switch, 2008)

The internet allows for a model of real-time access to new innovation, information and applications from a wide range of devices.

AffordableCapacity

On-demandcomputing

Instantaccess

Page 10: Transform. Innovate

IaaS PaaS SaaSInfrastructure-as-a-Service Platform-as-a-Service Software-as-a-Service

Google Cloud Platform

Cloud Computing

Page 11: Transform. Innovate

IaaS PaaS SaaSInfrastructure-as-a-Service Platform-as-a-Service Software-as-a-Service

Google

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

PackagedSoftware

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

Cloud ComputingYou Manage Vendor Managed

Page 12: Transform. Innovate

Save Scale Succeed

Concentrate on yourcore mission

Leverage massive, scalable computing power

Save on capitaland operational costs

Build Your Apps in the Cloud

Page 13: Transform. Innovate

Storage App ServicesCompute

Cloud Storage

Cloud SQL

Cloud Datastore

Compute Engine

App Engine

BigQuery

Cloud Endpoints

Google Cloud Platform

Page 14: Transform. Innovate

Innovation in Engineering

Page 15: Transform. Innovate

Google confidential | Do not distribute

Page 16: Transform. Innovate

Google confidential | Do not distribute

For the past 15 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.

Page 17: Transform. Innovate

Google confidential | Do not distribute

Cloud Platform is built on the same infrastructure that powers Google.

Page 18: Transform. Innovate

DevOps at Google

Page 19: Transform. Innovate

800KBUILDS

2PB+BUILD OUTPUTS

30K+CHANGELISTS

100M+TEST CASES RUN

EACH DAY...

Page 20: Transform. Innovate

Google confidential | Do not distribute

●●

Page 21: Transform. Innovate

Google confidential | Do not distribute

Page 22: Transform. Innovate

Google confidential | Do not distribute

Page 23: Transform. Innovate

Google confidential | Do not distribute

Page 24: Transform. Innovate

Google confidential | Do not distribute

Page 25: Transform. Innovate

Google confidential | Do not distribute

Page 26: Transform. Innovate

Google confidential | Do not distribute

Page 27: Transform. Innovate

DevOps you deserve

Page 28: Transform. Innovate

Continuous Delivery

Page 29: Transform. Innovate

Deploying to App Engine

$ gcloud auth login$ gcloud init your-project-name$ git push origin master # Pushes your changes to production.

$ gcloud app --help

Usage: gcloud app [optional flags] <command> command may be cancel-deployment | delete | deploy | download | get- logs | get-resource-limits | list-versions | run | set- default | set-managed-by | setup-managed-vms | start | stop

Page 30: Transform. Innovate

Push to Deploy

Page 31: Transform. Innovate

amount of time most developers spend finding issues in production (source)

Time Spent Troubleshooting: The Old Way

50%● High stakes and time critical

● Data rich; information scarce

● Imperfect system understanding

Page 32: Transform. Innovate

When Things Go Wrong in Production

Page 33: Transform. Innovate

● Reduce the guess work

● Speed up iteration cycle

● Provide system transparency

Time Spent Troubleshooting: The Modern Way

Page 34: Transform. Innovate

Eliminate Server Errors with Cloud Logs

Reduce Latency with Cloud Trace

Deep Understanding with Cloud Debugger

1

2

3

Debugging in the Cloud

Page 35: Transform. Innovate

SSH to machine to look at logs

GuessPager Goes Off

Problem log found

PROBLEM

Debugging with Logs: the Old Way

Now what?

Page 36: Transform. Innovate

Problem log found

Search aggregated

logs

Pager Goes Off

Seamlessly navigate to other tools

PROBLEM

Debugging with Logs: the Modern Way

Page 37: Transform. Innovate

● Search ALL your logs● Navigate to & from

○ Monitoring○ Trace○ Source

● Infiniscroll & Live streaming!

Google Cloud Logs

Page 38: Transform. Innovate

Logs Viewer

Page 39: Transform. Innovate

● Visualize and understand the time spent

● Compare performance from release to release with a detailed report

● Low Overhead - Always On

Google Cloud Trace

Image source info

Page 40: Transform. Innovate

Cycle of Debugging in the Cloud: the Old Way

PROBLEM

Search Logs Stare at Code

Add More LoggingRedeploy

Page 41: Transform. Innovate

Cycle of Debugging in the Cloud: the Modern Way

● Attaches (listens) to all instances

● Negligible performance impact

● Access stack and locals

PROBLEM

Stare at Code WatchPoint

Local Variables

Page 42: Transform. Innovate

● Enables modern production debugging

● Negligible performance impactEvaluations < 40usCaptures < 10ms

● Access to stack and locals

● No setup is required, on by default!

● Use today on Managed VMs for Java

Google Cloud Debugger: The Modern Debugger

Page 43: Transform. Innovate

Runtime Insights

https://cloud.google.com/appengine/articles/logging

https://cloud.google.com/tools/cloud-trace

https://cloud.google.com/tools/cloud-debugger

Cloud Logs

Cloud Debugger

Cloud Trace

Page 44: Transform. Innovate

The Road Ahead

Page 45: Transform. Innovate

Don’t deal with unnecessary “stuff”

Cliffs are for climbers

Ops should be easy

Cloud Computing

Photo by Connie Zhou

Page 46: Transform. Innovate

● The most important driver of long term TCO are early design decisions

● Factoring is critical● Help developers fall into the ‘pit of

operational success’

Operations, operations, operations

Page 47: Transform. Innovate

Developer Velocity / Efficiency

● Focus on application code

● Shift operations to Cloud

● Integrated development environment

and toolchain

Page 48: Transform. Innovate

Scale

● Built on single compute stack

● All performance innovation percolates

up

● Super low latency between all

application components

Page 49: Transform. Innovate

OpenSolutions

● Users can customize or replace

runtimes

● Open Source Software is huge

● Integration with any third-party

software

● Involve the community in shaping the

APIs

Page 50: Transform. Innovate

Google confidential | Do not distribute

Culture of launch and iterate is great…. but need right systems to support“In the cloud” means

Lower cost of Deployment and OperationsResilienceDevelopers choose

Page 51: Transform. Innovate

DevOps using the Cloud is about helping you, the developer, do what you love.

Image source info

Page 52: Transform. Innovate

Thank you!Melody Meckfessel Engineering Director [email protected]

Page 53: Transform. Innovate

$500 in Cloud Platform credit to build your idea!

Go to g.co/CloudStarterPack

Enter promo code: qcon-sf

With Cloud Platform you can access application, compute, storage and big data services. You’re now building on the same infrastructure that powers Google.

Page 54: Transform. Innovate

Questions?