practical microservices - ndc 2014

PRACTICAL CONSIDERATIONS FOR MICRO SERVICESSam Newman NDC London, December 2014

1

14 PRACTICAL TIPS FOR MICROSERVICESSam Newman NDC London, December 2014

2

YOU WONT BELIEVE WHAT THEY DO WITH MICROSERVICES IN THIS TALK!Sam Newman NDC London, December 2014

3

SEE WHAT JENNIFER LAWRENCE THINKS ABOUT DISTRIBUTED SYSTEMS!Sam Newman NDC London, December 2014

4

@samnewman#ndclondon

Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service


Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Small


Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Small

Modelled Around Business Domain


Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Small

Modelled Around Business Domain

Autonomous


V1


V2


Go

Java

NodeJS

Ruby


Go

NodeJS

Ruby

Clojure!


Where To Standardise?

@samnewman#ndclondon 2013 Electronic Arts Inc.


Interfaces


Interfaces

Monitoring


Interfaces

Monitoring

Deployment & Testing


Architectural Safety


Free For All


Standardisation

Free For All


Standardisation

Free For All

TIP 1 / 14: Standardise in the gaps between services - be exible about what happens inside the boxes

@samnewman#ndclondon https://www.ickr.com/photos/garrymsmith/6108841070


Autonomy

Communication


Team Ownership


Team Ownership

???


Trusted Committer / Roving Custodian



???



???TIP 2 / 14: Have a clear custodian model!


Interfaces


Coupling Is Bad


Data Oriented Procedure Oriented Document Oriented

Resource Oriented

Integration Styles An Evolutionary View


Data Oriented Procedure Oriented Document Oriented

Resource Oriented

Integration Styles An Evolutionary View

TIP 3 / 14: Be careful of RPC-mechanisms/shared serialisation protocols to avoid coupling


Database


DatabaseDatabase


Database Database


Database Database

TIP 4 / 14: Separate the databases before separating services


The Customer Is Always Right


TIP 5 / 14: Adopt a consumer rst approach


Monitoring


http://www.flickr.com/photos/kalexanderson/5421517469/


???


You have to get *much* better at monitoring


You are not a badass if you use an SSH Multiplexer


Response TimeResponse Time

Response Time


TIP 6 / 14: Capture metrics, and logs, for each node, and aggregate them to get a rolled up picture


TIP 7 / 14: Use synthetic transactions to test production systems


ID: 123


ID: 123

ID: 123

ID: 123


ID: 123

ID: 123

ID: 123

TIP 8 / 14: Use correlation IDs to track down nasty bugs


Deployment


!


!

!


!

!

!


TIP 9 / 14: Abstract out underlying platform dierences to provide a uniform deployment mechanism


InventoryAccounts

Returns

Invoicing

Shipping

Customer Service


InventoryAccounts

Returns

Invoicing

Shipping

Customer Service

Inventory


Inventory Accounts

Mountebank http://www.mbtest.org


InventoryAccounts

Stub

Mountebank http://www.mbtest.org


Shipping

InventoryAccounts

Returns

Invoicing

Customer Service


Browsers


Timing

Browsers


Provisioning of Environments

Timing

Browsers



Networks

Timing

Browsers


Deployment


Networks

Timing

Browsers


Deployment


Networks

Timing

Browsers Diagnosis


Shipping Inventory

CONSUMER-DRIVEN CONTRACTS


Expectations

Shipping Inventory



Expectations

Prod

Shipping Inventory



https://github.com/realestate-com-au/pact


https://github.com/realestate-com-au/pact

TIP 10 / 14: Consumer Driven Tests to catch breaking changes

Pending Prod

Pending Prod

TIP 11 / 14: Dont let changes build up - release as soon as you can, and preferably one at a time!


Architectural Safety


http://www.flickr.com/photos/louish/5611657857/


Connection Pool


Connection Pool

Connection Pool


TIP 12 / 14: Use timeouts, circuit breakers and bulk-heads to avoid cascading failure


Special Service Behaviour



Integration



Integration

Downstream



Integration

Downstream

Metrics



Integration

Downstream

Metrics TIP 13 / 14: Consider Service Templates to make it easy to do the right thing!


ChoiceOpportunity


ChoiceOpportunity

Complexity


ChoiceOpportunity

ComplexityMonitoring

Deployment

SafetyIntegration


ChoiceOpportunity

ComplexityMonitoring

Deployment

SafetyIntegration

TIP 14 / 14: Find your own balance

62

Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS


Designing For Rapid Release

500 West Madison500 West Madison


From Macro To Micro




http://lanyrd.com/prole/samnewman/

From Macro To Micro



Any questions: @samnewman

[email protected]

THANKS!

practical microservices - ndc 2014

Technology

samnewman testing

clear custodian model

ndclondondatabase databasetip

evolutionary viewtip

practical tips

business domainautonomous

practical considerations

ndclondonteam ownership