maturing the startup
TRANSCRIPT
‹#›Copyright © 2015 FlightStats, Inc.
Copyright © 2015 FlightStats, Inc.
Maturing the Startup
Using New Relic Insights to make data driven decisions that maintain the startup mojo while decreasing startup debt at FlightStats
Chad Berkley @FlightStatsTech
Copyright © 2015 FlightStats, Inc.
Who is FlightStats?
FlightStats is the leading provider of global real time flight status data.
Copyright © 2015 FlightStats, Inc.
Scale
Every week, we process...
~25M Web & Mobile
Requests
~5M Flight Alerts
~70M
Aircraft Positions
~50M
API Requests
~7M Flight
Events
{ } ! </>
Copyright © 2015 FlightStats, Inc.
Who Are We?
FlightStats is a data company.
And it’s an awesome place to work. Great people, fun work environment,
interesting data and problem set.
After 14 years running in startup mode, we’d accumulated a significant
amount of technical debt.
Copyright © 2015 FlightStats, Inc.
Growing Pains
14+ years of startup culture lead to two major barriers to the continued growth of the company:
Social TechnicalOverlapping and
misaligned teams with lots of
interdependencies sharing one large code
base.
Monolithic codebase running in an enterprise container powered by
an overly complex relational database with patchy monitoring and
alerting.
Copyright © 2015 FlightStats, Inc.
Problem
How can we keep the fast-paced, agile, startup-like environment while maturing and scaling the company?
Copyright © 2015 FlightStats, Inc.
Startup Mode Technical Debt
Copyright © 2015 FlightStats, Inc.
Late Nights
Copyright © 2015 FlightStats, Inc.
Microservice Migration
Copyright © 2015 FlightStats, Inc.
Requirements
● Easy to deploy with minimal code changes
● Little or no bootstrap configuration
● Full stack
● I want a dashboard!
4 Simple Requirements
Copyright © 2015 FlightStats, Inc.
APM
Copyright © 2015 FlightStats, Inc.
Social Changes
● Align teams around products, not verticals
● Minimize inter-team dependencies
● Many smaller Git repositories
● Teams set their own priorities and business and technical goals
● Small teams pivot quickly
Product teams need good data to make good decisions!
Copyright © 2015 FlightStats, Inc.
Mantra
Measure Everything.
Make all data accessible to everyone.
Copyright © 2015 FlightStats, Inc.
Insights
Summer 2014 we’re introduced to:
Copyright © 2015 FlightStats, Inc.
Dashboardification
Copyright © 2015 FlightStats, Inc.
Data Aplenty
So, we have a ton of data. Now what?
Copyright © 2015 FlightStats, Inc.
Insights Applications
Let’s start making data driven decisions.
Copyright © 2015 FlightStats, Inc.
Scraper Detection
Copyright © 2015 FlightStats, Inc.
Assumption Busting
Copyright © 2015 FlightStats, Inc.
Data Acquisition
Copyright © 2015 FlightStats, Inc.
Alerting on Insights Data
Copyright © 2015 FlightStats, Inc.
Measuring Team Costs - Compute
Copyright © 2015 FlightStats, Inc.
Measuring Team Costs - Storage
Copyright © 2015 FlightStats, Inc.
Questions and Answers
How can we keep the fast-paced, agile, startup-like environment while maturing and scaling the company?
Good Data == Good Decisions
Copyright © 2015 FlightStats, Inc.
D
Chad Berkley
@FlightStatsTech
Data! Data! Data! I can’t make bricks without clay!
- Sherlock Holmes