data @ nflx (tableau conference 2014 presentation)

DATA @ NFLXBuilding a Culture of Analytics EverywhereTableau Customer Conference2014.09.09

Blake IrvineManager, Device AnalyticsData Science & Engineeringbirvine@netflix.com

Albert WongManager, Reporting PlatformsCloud & Platform Engineeringalbwong@netflix.com

Netflix and data in the news...“Giving Viewers What They Want” --New York Times

“The Science Behind the Netflix Algorithms That Decide What You’ll Watch Next” --Wired

Data-Mining Boosts Netflix's Subscriber Base, Showbiz Clout

--AdAge

BIGDATA

Big Data at Netflix

Size● 50+ million members● 1000’s of devices● 100’s of systems● >300B data pipeline events daily● >10B row tables daily

Ubiquitous● Data is everywhere● Many complex systems● Many engineering teams

producing and consuming● Non-streaming teams produce

and consume data● Culturally data driven

How do we innovate with Big Data?

TOOLSCULTURE

Tools

Sting

DATA STORAGE DATA PROCESSORS DATABASE REPORTING

Team StructureData Science and Engineering

Marketing

analyst

reporting

data engineering

Finance Product Engineering ...

Business Functions

Team StructureData Science and Engineering

Marketing

analyst

reporting

data engineering

Finance Product Engineering ...

NOT WHAT WE DO

Netflix Team StructureData Science and Engineering

Marketing

analyst

reporting

data engineering

Finance Product Engineering ...

analyst

reporting

data engineering

analyst

reporting

data engineering

analyst

reporting

data engineering

Business Functions

Highly Aligned, Loosely Coupled

Finance

analyst

reporting

data engineering

Marketing

analyst/reporting

data architect

data engineering

Highly Aligned, Loosely Coupled

Finance

analyst

reporting

data engineering

Marketing

analyst/reporting

data architect

data engineering

Freedom & Responsibility

FreedomDon’t limit accessDon’t limit choicesReduce constraints

ResponsibilityTrustDon’t allow chaosReduce accidents

Protected access

CENTRAL DATA

Protected access

CENTRAL DATA

NOT WHAT WE DO

Unlocked access

CENTRAL DATA

OPERATIONAL DATA

Don’t limit choice

CENTRAL DATA LOCAL DATA

OPERATIONAL DATA

Don’t limit choice

CENTRAL DATA LOCAL DATA

Sting

Why is Tableau a good choice?

QuickIntuitiveRich Visual AnalysisStorytellingEmailed ReportingReusability

Who uses Tableau?

How do we use Tableau?

Examples

● Application build testing● Certification tracking● Operational Excellence

Application Build Testing (1/4)

● Team: Product Engineering● Context

○ Application automatically tested at every code checkin

○ Several dozen performance tests run to measure change and avoid regression

● Problem○ Limited graphing tool built into test tool○ Difficult / no customization

Application Build Testing (2/4){ "metadata" : {

"TestCaseName" : "Trunk.Rendering.Effects_Mask2","MarkerSetId" : 2472165,"ESN" : "DCQA01","UIBuild" : null,"Build" : "2689","JenkinsJob" : "http://builds.netflix.com/job/208/","Label" : "#2689 / 208","BuildTimestamp" : null,"Changelist" : "2177893"

}, "results" :

[{"MeanFps" : 60.284862537264004},{"MeanFps" : 60.264900662251655},{"MeanFps" : 60.234541577825162}]

}

Build / Test

Application Build Testing (3/4)

Application Build Testing (4/4)

Certification Tracking (1/3)

Team: Certification OperationsContext● We certify the Netflix implementation on many new

consumer electronics devices

Problem● Time consuming to generate insights across multiple

disconnected systems

Certification Tracking (2/3)

NTSCertification

Process

Certification Tracking (3/3)

Operational Excellence (1/3)

Team: Data Science & EngineeringContext● Ensure continuous development does not negatively

impact availability and resilience

Problem● Multiple programs and data sources● Need to link source data patterns to engineering tools

Operational Excellence (2/3)

Operational Excellence (3/3)

Where are we with Tableau?

● Netflix is known for being data driven● Big data is available everywhere● Our culture enables analysis everywhere

● Tableau complements our culture● We have organic growth throughout Netflix● Growing part of our reporting platform

DATA @ NFLX

Blake IrvineManager, Device AnalyticsData Science & Engineeringbirvine@netflix.com

Albert WongManager, Reporting PlatformsCloud & Platform Engineeringalbwong@netflix.com

What can we answer?