the cloud native journey

© Copyright 2015 Pivotal. All rights reserved. 1

The Cloud Native JourneyMatt Stine (@mstine)

Consultant Engineer & Senior Product Manager


WARNING:

This may end up being a bit stream of

consciousness…

© Copyright 2015 Pivotal. All rights reserved.

My Cloud Native Journey

3

App Dev/Archfor 11 years

CLOUD NATIVE LAND


I wrote a little cloud book…

Available to you compliments of Pivotal!

Get the FREE e-book at http://bit.ly/cloud-native-book!


“Software is Eating the World”


Gartner predicts that by 2020, 75 percent of application purchases supporting digital business will be "build," not "buy."

http://www.gartner.com/newsroom/id/3119717


The ability to deliver software is no longer a differentiator.


It is a basic requirement for survival.


So what do the Cloud Natives do?

$6B $50B $41B

$25B $33.5B


SPEED

UBIQUITY*

SCALE

SAFETY

(MOBILE)


Continuous Delivery


Delivery Continuous


Day One Day Two and BeyondDeliver Continuously


Operations is the Secret Sauce


Continuously Delivered Microservices

15

Loosely coupled service oriented architecture with bounded contexts

If every service has to be updated in concert, it’s not loosely coupled!

If you have to know about surrounding services you don’t have a bounded context.


Without taking steps to ensure fault tolerance, 30 dependencies each with 99.99% uptime would result

in 2+ hours downtime/month (99.99%30 = 99.7% uptime = 2+ hours downtime in a month).

http://techblog.netflix.com/2012/02/fault-tolerance-in-high-volume.html


Build Reliable Systemsfrom

Unreliable Components


Microservices The Old Way

20


Cloud Native is NOT:

Configuring Infrastructure

Orchestrating Containers

Composing Distributed Systems

Supporting Ad-Hoc General Purpose Automation


https://twitter.com/littleidea/status/626767188653797376


GREAT JOB PROVISIONING SERVERS THIS YEAR!

…said no CIO ever.


And they’re not going tosay that about

containers either…


I’ve built homegrown application platforms twice:

The first took three years before it saw a production application.

The second took two years.

Maybe if I do it just two more times…


I regret to inform you, but…

You’re not that smart.

You’re not different.

You’re not special.


10:1the ratio of app developers to platform developers

at “web scale” companies


10:1this was also true of the two platforms I helped build


UNDIFFERENTIATEDHEAVYLIFTING


SIMPLE RULES

COMPLEX BEHAVIOR

EXPLICIT CONTRACTS

COMMODITY COMPONENTS


SIMPLE RULES

COMPLEX BEHAVIOR

EXPLICIT CONTRACTS


Grab Dirt w/ PheromoneBuild Bridge

Attach to Ant on Edge

1000’s of Ants

Hardwired into Brain

Colonies, Bridges, Rafts


What if our platformworked this way?


3-5 Different Server Builds

If your software doesn’t fit into one of these,your software is broken.

Zero Deviation or Customization


PLATFORMIS

OMAKASE


SPRING BOOT

39

OMAKASE TWELVE FACTOR APPS

http://start.spring.io


SPRING CLOUD

40

http://cloud.spring.io

https://network.pivotal.io/products/p-spring-cloud-servicesOMAKASE DISTRIBUTED SYSTEMS


SPRING CLOUD DATA FLOW

41

OMAKASE BATCH AND STREAM DATA PROCESSING

http://cloud.spring.io/spring-cloud-dataflow


PIVOTAL CLOUD FOUNDRY - OMAKASE RUNTIME PLATFORM


OMAKASE APPLICATION METRICS


OMAKASE CI/CD PIPELINES


If your software doesn’t fit into this platform, then your software is

probably broken.


PolyglotProgramming?


SIMPLE RULES

COMPLEX BEHAVIOR

EXPLICIT CONTRACTS



Simple Rules

Boot Property Resolution

Boot Config Precedence

Circuit Breaker FSM

Eureka Cache Server Resolution

Buildpack Detect/Compile/Upload

Java BP Memory Heuristic

LRP/Task Lifecycle

Desired/Actual State Convergence

STDOUT/ERR Log Aggregation

Routing Table Maintenance


CONTRACTS


Commodity Components?

51

THOUSANDSOF

MICROSERVICES!


So what does a platform like this allow you to do?


#1: Get your head around Conway’s Law.

53

Any organization that designs a system (defined broadly) will produce a design whose structure is a copy of the

organization's communication structure.

Melvyn Conway, 1967


#2: Invoke the Inverse Conway Maneuver


#3: Start Delivering Business Capabilities

55

ProductMgr UX Dev QA DBA Sys

AdminNet

AdminStorageAdmin

BUSINESS CAPABILITY TEAMSBUILDING MICROSERVICES

PLATFORM OPERATIONS TEAM

Adapted from: http://www.slideshare.net/adriancockcroft/goto-berlin

SelfService

API


But what if I don’t have a platform like this?

Probably going to make some things too complicated/hard…

Probably going to need specialization at multiple levels of your architecture…

Probably going to stay stuck in or rebuild your silos…


We need the platform to remind us:

We’re not that smart.

We’re not different.

We’re not special.


So we can get back to why we’re here…

58


Game On

http://pivotal.io/cloud-native