data @ nflx (tableau conference 2014 presentation)
DESCRIPTION
I presented this at a 2014 Tableau Conference session with Albert Wong. Netflix relies on data to make decisions ranging from buying and recommending content, to improving the streaming experience on devices. This presentation shares our Big Data analytics architecture and the tools used to make data accessible throughout our business, focusing on how Tableau fits into our organization and why it aligns well with our culture.TRANSCRIPT
DATA @ NFLXBuilding a Culture of Analytics EverywhereTableau Customer Conference2014.09.09
Blake IrvineManager, Device AnalyticsData Science & [email protected]
Albert WongManager, Reporting PlatformsCloud & Platform [email protected]
Netflix and data in the news...“Giving Viewers What They Want” --New York Times
“The Science Behind the Netflix Algorithms That Decide What You’ll Watch Next” --Wired
Data-Mining Boosts Netflix's Subscriber Base, Showbiz Clout
--AdAge
BIGDATA
Big Data at Netflix
Size● 50+ million members● 1000’s of devices● 100’s of systems● >300B data pipeline events daily● >10B row tables daily
Ubiquitous● Data is everywhere● Many complex systems● Many engineering teams
producing and consuming● Non-streaming teams produce
and consume data● Culturally data driven
How do we innovate with Big Data?
TOOLSCULTURE
Tools
Sting
DATA STORAGE DATA PROCESSORS DATABASE REPORTING
Team StructureData Science and Engineering
Marketing
analyst
reporting
data engineering
Finance Product Engineering ...
Business Functions
Team StructureData Science and Engineering
Marketing
analyst
reporting
data engineering
Finance Product Engineering ...
NOT WHAT WE DO
Netflix Team StructureData Science and Engineering
Marketing
analyst
reporting
data engineering
Finance Product Engineering ...
analyst
reporting
data engineering
analyst
reporting
data engineering
analyst
reporting
data engineering
Business Functions
Highly Aligned, Loosely Coupled
Finance
analyst
reporting
data engineering
Marketing
analyst/reporting
data architect
data engineering
Highly Aligned, Loosely Coupled
Finance
analyst
reporting
data engineering
Marketing
analyst/reporting
data architect
data engineering
Freedom & Responsibility
FreedomDon’t limit accessDon’t limit choicesReduce constraints
ResponsibilityTrustDon’t allow chaosReduce accidents
Protected access
CENTRAL DATA
Protected access
CENTRAL DATA
NOT WHAT WE DO
Unlocked access
CENTRAL DATA
OPERATIONAL DATA
Don’t limit choice
CENTRAL DATA LOCAL DATA
OPERATIONAL DATA
Don’t limit choice
CENTRAL DATA LOCAL DATA
Sting
Why is Tableau a good choice?
QuickIntuitiveRich Visual AnalysisStorytellingEmailed ReportingReusability
Who uses Tableau?
How do we use Tableau?
Examples
● Application build testing● Certification tracking● Operational Excellence
Application Build Testing (1/4)
● Team: Product Engineering● Context
○ Application automatically tested at every code checkin
○ Several dozen performance tests run to measure change and avoid regression
● Problem○ Limited graphing tool built into test tool○ Difficult / no customization
Application Build Testing (2/4){ "metadata" : {
"TestCaseName" : "Trunk.Rendering.Effects_Mask2","MarkerSetId" : 2472165,"ESN" : "DCQA01","UIBuild" : null,"Build" : "2689","JenkinsJob" : "http://builds.netflix.com/job/208/","Label" : "#2689 / 208","BuildTimestamp" : null,"Changelist" : "2177893"
}, "results" :
[{"MeanFps" : 60.284862537264004},{"MeanFps" : 60.264900662251655},{"MeanFps" : 60.234541577825162}]
}
Build / Test
Application Build Testing (3/4)
Application Build Testing (4/4)
Certification Tracking (1/3)
Team: Certification OperationsContext● We certify the Netflix implementation on many new
consumer electronics devices
Problem● Time consuming to generate insights across multiple
disconnected systems
Certification Tracking (2/3)
NTSCertification
Process
Certification Tracking (3/3)
Operational Excellence (1/3)
Team: Data Science & EngineeringContext● Ensure continuous development does not negatively
impact availability and resilience
Problem● Multiple programs and data sources● Need to link source data patterns to engineering tools
Operational Excellence (2/3)
Operational Excellence (3/3)
Where are we with Tableau?
● Netflix is known for being data driven● Big data is available everywhere● Our culture enables analysis everywhere
● Tableau complements our culture● We have organic growth throughout Netflix● Growing part of our reporting platform
DATA @ NFLX
Blake IrvineManager, Device AnalyticsData Science & [email protected]
Albert WongManager, Reporting PlatformsCloud & Platform [email protected]
What can we answer?