api best practices webinar: metrics - what to measure

API  Metrics  –  What  to  Measure?  

6.2.11  @  11:05  PST  VOIP  or  Dial-­‐in  (see  chat)  

Brian  Mulloy  @landlessness  

Brian  Pagano  @brianpagano  

@landlessness @brianpagano

Mapping  out  your  API  Strategy    

PragmaIc  REST:  API  Design  Fu  

10  PaMerns  in  Successful  API  Programs  

Today:  API  Metrics  –  What  to  Measure?  

API  Tech  &    Roadmap  ConsideraIons  

Driving  API  AdopIon  

“Rapid API” Workshop Webinar Series

Part  4:    API  Metrics  –  What  to  Measure?  

Successful  API  teams  understand  the  value  chain  of  people  and  technology.  

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

Two  sets  of  people  make  APIs  successful  

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

Jason  Michael

What  does  the  ApplicaIon  Developer  need  to  see?  

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

hufse

Is  the  API  error  prone?  

Which  API  errors  is  my  applicaIon  seeing?  

How  does  the  API  usually  perform?  

Is  the  API  slow  now?  

Which  API  methods  are  slow?  

Does  the  API  have  a  quota?  

Is  my  app  violaIng  the  API  quota?  

How  o[en  does  the  API  go  down?  

Is  the  API  down  now?  

When  will  the  API  be  back  up?  

Why  was  the  API  down?  

Dan  DeChiaro

What’s  in  your  dashboard?  

There  are  a  few  key  indicators  in  a  few  formats  

Key  indicators:  •  Errors  •  Performance  •  Availability  •  Quota  (if  enforced)  

Data  Formats:  •  Everyone’s  aggregate  data  •  Developer-­‐specific  data  •  Trend  charts  •  Categorical  tables  

Broadcast  Formats:  •  Status  page  •  TwiMer  •  Blog  

What  does  the  API  Team  need  to  see?  

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

Almost  everything  

Thai  Jasmine  (Keep  Smiling.g..g.g  :-­‐))

Which  are  our  top  applicaIons?  

Who  are  our  top  applicaIon  users?  

Who  are  our  best  applicaIon  developers?  

Which  API  methods  are  most  popular?  

How  much  API  capacity  will  we  need  next  year?  

Raymond  Larose

Why  is  the  API  down?  

Why  is  the  API  slow?  

Why  is  the  API  throwing  errors?  

Why  is  the  API  traffic  spiking?  

Why  did  the  API  traffic  disappear?  

Dan  DeChiaro

Key  indicators:  •  ApplicaIon  users  •  ApplicaIons  •  Developers  •  API  Quality  •  Internal  systems  

Data  Formats:  •  Alerts  •  Aggregate  data  •  Drill-­‐down  data  •  Trend  charts  •  Categorical  tables  

What  about  the  stuff  behind  the  API?  

App User

API Team API App World of

APIs App

Store Internal Systems

App Developer

TIP:  Put  Internal  System  Data  in  Response  Header    •  Database  Query  Times  •  Message  Bus  Response  Times  •  External  Callout  Response  Times  

(Apigee  will  log  it  &  strip  it)  

trochim

Operations

Developer Connect

API Gateway

App D

ev Analytics

Operations Team Monitoring

AP

I Tea

m A

naly

tics

Developer Tools   Availability   Errors   Performance   Quota

  Developers   Applications   App Users   API Quality

  Availability   Performance   Capability

Application Developer API Team

Mapping  out  your  API  Strategy  PragmaIc  REST:  API  Design  Fu  10  PaMerns  in  Successful  API  Programs  API  Metrics  –  What  to  Measure?  API  Tech  &    Roadmap  ConsideraAons  Driving  API  AdopIon  

Next  Time  

THANK  YOU    Ques%ons  and  ideas  to:  @landlessness  @brianpagano  @apigee