maturing the startup

26
‹#› Copyright © 2015 FlightStats, Inc.

Upload: new-relic

Post on 16-Apr-2017

482 views

Category:

Data & Analytics


0 download

TRANSCRIPT

Page 1: Maturing the Startup

‹#›Copyright © 2015 FlightStats, Inc.

Page 2: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Maturing the Startup

Using New Relic Insights to make data driven decisions that maintain the startup mojo while decreasing startup debt at FlightStats

Chad Berkley @FlightStatsTech

Page 3: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Who is FlightStats?

FlightStats is the leading provider of global real time flight status data.

Page 4: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Scale

Every week, we process...

~25M Web & Mobile

Requests

~5M Flight Alerts

~70M

Aircraft Positions

~50M

API Requests

~7M Flight

Events

{ } ! </>

Page 5: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Who Are We?

FlightStats is a data company.

And it’s an awesome place to work. Great people, fun work environment,

interesting data and problem set.

After 14 years running in startup mode, we’d accumulated a significant

amount of technical debt.

Page 6: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Growing Pains

14+ years of startup culture lead to two major barriers to the continued growth of the company:

Social TechnicalOverlapping and

misaligned teams with lots of

interdependencies sharing one large code

base.

Monolithic codebase running in an enterprise container powered by

an overly complex relational database with patchy monitoring and

alerting.

Page 7: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Problem

How can we keep the fast-paced, agile, startup-like environment while maturing and scaling the company?

Page 8: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Startup Mode Technical Debt

Page 9: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Late Nights

Page 10: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Microservice Migration

Page 11: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Requirements

● Easy to deploy with minimal code changes

● Little or no bootstrap configuration

● Full stack

● I want a dashboard!

4 Simple Requirements

Page 12: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

APM

Page 13: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Social Changes

● Align teams around products, not verticals

● Minimize inter-team dependencies

● Many smaller Git repositories

● Teams set their own priorities and business and technical goals

● Small teams pivot quickly

Product teams need good data to make good decisions!

Page 14: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Mantra

Measure Everything.

Make all data accessible to everyone.

Page 15: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Insights

Summer 2014 we’re introduced to:

Page 16: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Dashboardification

Page 17: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Data Aplenty

So, we have a ton of data. Now what?

Page 18: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Insights Applications

Let’s start making data driven decisions.

Page 19: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Scraper Detection

Page 20: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Assumption Busting

Page 21: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Data Acquisition

Page 22: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Alerting on Insights Data

Page 23: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Measuring Team Costs - Compute

Page 24: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Measuring Team Costs - Storage

Page 25: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

Questions and Answers

How can we keep the fast-paced, agile, startup-like environment while maturing and scaling the company?

Good Data == Good Decisions

Page 26: Maturing the Startup

Copyright © 2015 FlightStats, Inc.

D

Chad Berkley

[email protected]

@FlightStatsTech

Data! Data! Data! I can’t make bricks without clay!

- Sherlock Holmes