effective monitoring with statsd - alexis lê-quôc
TRANSCRIPT
![Page 1: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/1.jpg)
EffectiveMonitoring
with
![Page 2: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/2.jpg)
@alqCTO at
Datadog
![Page 3: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/3.jpg)
An applicationthrough the naked eye
![Page 4: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/4.jpg)
An applicationthrough a monitoring
tool
![Page 5: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/5.jpg)
OODA Loop (simplified)
Observe Orient
DecideAct
![Page 6: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/6.jpg)
OODA Loop (simplified)
Observe Orient
DecideAct
![Page 7: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/7.jpg)
OODA Loop (simplified)
Observe Orient
DecideAct
Monito
ring
Tool
![Page 8: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/8.jpg)
OODA Loop (simplified)
Observe Orient
DecideAct
Monito
ring
Tool Yo
u
![Page 9: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/9.jpg)
OODA Loop (simplified)
Observe Orient
DecideAct
Monito
ring
Tool Yo
u
You
![Page 10: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/10.jpg)
OODA Loop (simplified)
Observe Orient
DecideAct
Monito
ring
Tool Yo
u
You
You
![Page 11: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/11.jpg)
Observations need to be...
1.Timely2.Correct3.Comprehensive
![Page 12: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/12.jpg)
Observations need to be...
1.Timely2.Correct3.Comprehensive
![Page 13: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/13.jpg)
Observations need to be...
1.Timely2.Correct3.Comprehensive
Else
![Page 14: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/14.jpg)
Observations need to be...
1.Timely2.Correct3.Comprehensive
Garbage In, Garbage Out
Else
![Page 15: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/15.jpg)
Timely
Initial set of metrics
Initialassumptions
Revised set of metrics
Contact with reality
Revisedassumptions
![Page 16: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/16.jpg)
Timely
Initial set of metrics
Initialassumptions
Revised set of metrics
Contact with reality
Revisedassumptions
Minutes
Not w
eeks
![Page 17: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/17.jpg)
Comprehensive
WorkResources ValueResourcesResourcesResourcesResources
![Page 18: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/18.jpg)
Comprehensive
WorkResources ValueResourcesResourcesResourcesResources
Easy to collectgeneric
but not actionable
![Page 19: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/19.jpg)
Comprehensive
WorkResources ValueResourcesResourcesResourcesResources
Easy to collectgeneric
but not actionable
Harder to collect,custom
but most actionable
![Page 20: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/20.jpg)
statsD
Easy
![Page 21: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/21.jpg)
statsD
Easy
Timely
![Page 22: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/22.jpg)
statsD
Easy
Timely Comprehensive
![Page 23: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/23.jpg)
How statsD works
Client libraries talk to asimple UDP server...
pageviews:100|[email protected]:320|msbacklog:333|guniques:765|s
...using a simple text protocol
![Page 24: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/24.jpg)
statsD typesType Definition Example
Gauges Absolute values Queue size
Counters Per-second rates Page views
Histograms Gauge summary Page Latency
Timers Gauge distribution Page Latency
Sets Counters of unique things Unique visitors
![Page 25: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/25.jpg)
statsD problemsType Definition Problem
Gauges Absolute valuesLatest value wins.Gauge deltas???
Counters Per-second ratesRates, not counts (!
= rrdtool)
Histograms Gauge summaryAssumes normal
distribution
Timers Gauge distributionCan measure much
more than time
Sets Counters of unique things :-)
![Page 26: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/26.jpg)
#1 pitfall: “Counters”
http://dtdg.co/tokyo-counters
![Page 27: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/27.jpg)
How we use statsD
http://dtdg.co/tokyo-dog
![Page 28: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/28.jpg)
Essential: Tagging
http://dtdg.co/tokyo-tags
![Page 29: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/29.jpg)
How to get started
• statsD https://github.com/etsy/statsd• client libraries https://github.com/etsy/statsd/wiki
(my company) 1-stop shop http://www.datadoghq.com
![Page 30: Effective monitoring with statsd - Alexis lê-quôc](https://reader033.vdocuments.site/reader033/viewer/2022060107/554bcca1b4c905706a8b4842/html5/thumbnails/30.jpg)
ありがとうございました。質問?@alq
Thank you very much!Questions? @alq