netflixoss – a cloud native architecture

NetflixOSS – A Cloud Native Architecture

LASER Session 1 – Introduction September 2013 Adrian Cockcroft @adrianco @NetflixOSS

http://www.linkedin.com/in/adriancockcroft

Adrian Cockcroft

• Director, Architecture for Cloud Systems, Netflix Inc. – Previously Director for Personalization Platform

• Distinguished Availability Engineer, eBay Inc. 2004-7 – Founding member of eBay Research Labs

• Distinguished Engineer, Sun Microsystems Inc. 1988-2004 – 2003-4 Chief Architect High Performance Technical Computing – 2001 Author: Capacity Planning for Web Services – 1999 Author: Resource Management – 1995 & 1998 Author: Sun Performance and Tuning – 1996 Japanese Edition of Sun Performance and Tuning

• SPARC & Solarisパフォーマンスチューニング (サンソフトプレスシリーズ)

• More

– Twitter @adrianco – Blog http://perfcap.blogspot.com – Presentations at http://www.slideshare.net/adrianco

Content

Why Public Cloud?

Migration Path

Service and API Architectures

Storage Architecture

Operations and Tools

Example Applications

Software for the Cloud and Big Data

• Cloud – API based, automated, commodity

– Elastic capacity, shrinks as well as grows

– Self service immediate deployment

• Big Data – More than can be processed on one machine

– Unstructured flexible schemas

– Fast answers to new questions

Cloud Native

What is it?

Why?

Strive for perfection

Perfect code

Perfect hardware

Perfectly operated

But perfection takes too long…

Compromises…

Time to market vs. Quality

Utopia remains out of reach

Where time to market wins big

Making a land-grab

Disrupting competitors (OODA)

Anything delivered as web services

Observe

Orient

Decide

Act

Land grab opportunity Competitive

move

Customer Pain Point

Analysis

Get buy-in

Plan response

Commit resources

Implement

Deliver

Engage customers

Model alternatives

Measure customers

Colonel Boyd, USAF

“Get inside your adversaries'

OODA loop to disorient them”

How Soon?

Product features in days instead of months

Deployment in minutes instead of weeks

Incident response in seconds instead of hours

A new engineering challenge

Construct a highly agile and highly available service from ephemeral and

assumed broken components

Inspiration

"Genius is one percent inspiration and ninety-nine percent perspiration."

Thomas A. Edison

Our perspiration…

A Cloud Native Open Source Platform

See netflix.github.com

Establish our solutions as Best

Practices / Standards

Hire, Retain and Engage Top Engineers

Build up Netflix Technology Brand

Benefit from a shared ecosystem

Goals

Your perspiration – deadline Sept 15th

Boosting the @NetflixOSS Ecosystem

See netflix.github.com

Slideshare.net/Netflix Details

• Meetup S1E3 July – Featuring Contributors Eucalyptus, IBM, Paypal, Riot Games – http://techblog.netflix.com/2013/07/netflixoss-meetup-series-1-episode-3.html

• Lightning Talks March S1E2 – http://www.slideshare.net/RuslanMeshenberg/netflixoss-meetup-lightning-talks-and-

roadmap

• Lightning Talks Feb S1E1 – http://www.slideshare.net/RuslanMeshenberg/netflixoss-open-house-lightning-talks

• Asgard In Depth Feb S1E1 – http://www.slideshare.net/joesondow/asgard-overview-from-netflix-oss-open-house

• Security Architecture – http://www.slideshare.net/jason_chan/resilience-and-security-scale-lessons-learned/

• Cost Aware Cloud Architectures – with Jinesh Varia of AWS – http://www.slideshare.net/AmazonWebServices/building-costaware-architectures-jinesh-

varia-aws-and-adrian-cockroft-netflix

Takeaways

Cloud Native Manages Scale and Complexity at Speed

NetflixOSS makes it easier for everyone to become Cloud Native

http://netflix.github.com

http://techblog.netflix.com

http://slideshare.net/Netflix

http://www.linkedin.com/in/adriancockcroft

@adrianco #netflixcloud @NetflixOSS

Non-Cloud Topics for Discussion

Google Glass

Strange Beers

Electric Cars

Obscure Music