monitoring 101 postgresql 101... · @gitbisect technical writer/evangelist “docs & talks”...
TRANSCRIPT
![Page 1: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/1.jpg)
MONITORING 101: POSTGRESQLJASON YEE, DATADOG @gitbisect
![Page 2: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/2.jpg)
@gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter
@datadoghq SaaS-based monitoring Trillions of data points per day http://jobs.datadoghq.com
![Page 3: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/3.jpg)
TW: @gitbisect @datadoghq
![Page 4: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/4.jpg)
COLLECTING DATA IS CHEAP; NOT HAVING IT WHEN YOU NEED IT CAN BE EXPENSIVE
SO INSTRUMENT ALL THE THINGS!
TW: @gitbisect @datadoghq
![Page 5: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/5.jpg)
ANALOG FTW!
OUCH.
WAT?!
![Page 6: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/6.jpg)
4 QUALITIES OF GOOD METRICSNOT ALL METRICS ARE EQUAL
TW: @gitbisect @datadoghq
![Page 7: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/7.jpg)
TW: @gitbisect @datadoghq
1. MUST BE WELL UNDERSTOOD
![Page 8: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/8.jpg)
TW: @gitbisect @datadoghq
2. SUFFICIENT GRANULARITY
![Page 9: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/9.jpg)
1 second Peak 46%
1 minute Peak 36%
5 minutes Peak 12%
![Page 10: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/10.jpg)
TW: @gitbisect @datadoghq
3. TAGGED & FILTERABLE
![Page 11: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/11.jpg)
![Page 12: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/12.jpg)
TW: @gitbisect @datadoghq
4. LONG-LIVED
![Page 13: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/13.jpg)
![Page 14: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/14.jpg)
TW: @gitbisect @datadoghq
![Page 15: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/15.jpg)
TW: @gitbisect @datadoghq
![Page 16: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/16.jpg)
TW: @gitbisect @datadoghq
![Page 17: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/17.jpg)
TW: @gitbisect @datadoghq
P.S. - June 1! Mark your calendar!
![Page 18: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/18.jpg)
TW: @gitbisect @datadoghq
![Page 19: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/19.jpg)
TW: @gitbisect @datadoghq
WHAT TO PAGE ON?
![Page 20: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/20.jpg)
RECURSE UNTIL YOU FIND THE TECHNICAL CAUSES
TW: @gitbisect @datadoghq
![Page 21: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/21.jpg)
SCALING & MONITORING POSTGRESQL AT DATADOG
TW: @gitbisect @datadoghq
![Page 22: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/22.jpg)
MOAR RESOURCES!
TW: @gitbisect @datadoghq
![Page 23: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/23.jpg)
MOAR INSTANCES!
TW: @gitbisect @datadoghq
![Page 24: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/24.jpg)
Writes Repl
TW: @gitbisect @datadoghq
Reads
![Page 25: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/25.jpg)
HOW WE DO IT
REQUIREMENTS▸Write master is writeable, read replicas are
readable!
TW: @gitbisect @datadoghq
![Page 26: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/26.jpg)
HOW WE DO IT
REQUIREMENTS▸Write master is writeable, read replicas are
readable!
▸ Read replicas are up to date and don’t lag
TW: @gitbisect @datadoghq
![Page 27: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/27.jpg)
HOW WE DO IT
REQUIREMENTS▸Write master is writeable, read replicas are
readable!
▸ Read replicas are up to date and don’t lag
▸ Additional read replicas can be provisioned quickly
TW: @gitbisect @datadoghq
![Page 28: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/28.jpg)
TW: @gitbisect @datadoghq
![Page 29: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/29.jpg)
HOW WE DO IT
SOLUTIONS▸ PostgreSQL!
▸ http://bit.ly/pg-repl-docs
▸WAL-E
▸ https://github.com/wal-e/wal-e
TW: @gitbisect @datadoghq
![Page 30: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/30.jpg)
Writes Repl
TW: @gitbisect @datadoghq
Standbys
App2 Reads
App1 Reads
![Page 31: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/31.jpg)
WHAT DO WE MONITOR AT DATADOG?
TW: @gitbisect @datadoghq
![Page 32: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/32.jpg)
METRICS
WHAT METRICS DO WE GATHER?connections commits rollbacks disk_read buffer_hit rows_returned rows_fetched rows_inserted rows_updated rows_deleted database_size deadlocks temp_bytes
temp_files bgwriter.checkpoints_timed bgwriter.checkpoints_requested bgwriter.buffers_checkpoint bgwriter.buffers_clean bgwriter.maxwritten_clean bgwriter.buffers_backend bgwriter.buffers_alloc bgwriter.buffers_backend_fsync bgwriter.write_time bgwriter.sync_time locks seq_scans
seq_rows_read index_scans index_rows_fetched rows_hot_updated live_rows dead_rows index_rows_read table_size index_size total_size table.count max_connections percent_usage_connections
replication_delay replication_delay_bytes heap_blocks_read heap_blocks_hit index_blocks_read index_blocks_hit toast_blocks_read toast_blocks_hit toast_index_blocks_read toast_index_blocks_hit
TW: @gitbisect @datadoghq
![Page 33: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/33.jpg)
ALERT ON WORK METRICS, BUT RESOURCE METRICS BECOME WORK METRICS? ALERT ON EVERYTHING?
TW: @gitbisect @datadoghq
![Page 34: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/34.jpg)
WHO TO ALERT?
TW: @gitbisect @datadoghq
Leadership
![Page 35: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/35.jpg)
WHO TO ALERT?
TW: @gitbisect @datadoghq
Developers
![Page 36: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/36.jpg)
WHO TO ALERT?
TW: @gitbisect @datadoghq
PostgreSQL Team (Ops/SRE)
![Page 37: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/37.jpg)
WHO TO ALERT?
TW: @gitbisect @datadoghq
Ops/SRE
![Page 38: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/38.jpg)
POSTGRESQL WORK METRICS (AVAILABILITY)
TW: @gitbisect @datadoghq
![Page 39: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/39.jpg)
ALERT ON WORK METRICS
WHAT ARE WE ALERTING ON?▸ Base backup is too old
▸ Standby is missing
▸ Replication lag is too high
TW: @gitbisect @datadoghq
![Page 40: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/40.jpg)
POSTGRESQL RESOURCE METRICS = OPS WORK METRICS (CAPACITY)
TW: @gitbisect @datadoghq
![Page 41: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/41.jpg)
ALERT ON WORK METRICS
WHAT ARE WE ALERTING ON?▸ Connection limit
▸Disk
▸Memory
▸ CPU
TW: @gitbisect @datadoghq
![Page 42: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/42.jpg)
TW: @gitbisect @datadoghq
![Page 43: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/43.jpg)
MONITORING TO IMPROVE PERFORMANCE
TW: @gitbisect @datadoghq
![Page 44: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/44.jpg)
POSTGRESQL PERFORMANCE
WHERE TO GET THE MOST PERFORMANCE GAINS?
http://bit.ly/pg-perf-15m
1. Cut Activity 2. Slow Queries 3. Scale Stack 4. Fix Hardware 5. Postgresql.conf
TW: @gitbisect @datadoghq
![Page 45: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/45.jpg)
TW: @gitbisect @datadoghq
CUT ACTIVITY
![Page 46: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/46.jpg)
TW: @gitbisect @datadoghq
SLOW QUERIES
![Page 47: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/47.jpg)
PERFORMANCE: LATENCY VS POTENTIAL
![Page 48: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/48.jpg)
LATENCY VS POTENTIAL
HOW DO YOU DEFINE PERFORMANCE?SELECT * FROM table_x WHERE nonindexed_col=1
SELECT * FROM table_x JOIN table_y ON table_x.foo=table_y.bar WHERE table_y.indexed_col=1
TW: @gitbisect @datadoghq
![Page 49: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/49.jpg)
PERFORMANCE: RAM VS DISK
![Page 50: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/50.jpg)
“Aside from shared_buffers, the most important memory-allocation parameter is work_mem… Raising this value can dramatically improve the performance of certain queries…”
ROBERT HAAS
TW: @gitbisect @datadoghq
![Page 51: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/51.jpg)
“Aside from shared_buffers, the most important memory-allocation parameter is work_mem… Raising this value can dramatically improve the performance of certain queries, but it's important not to overdo it.”
ROBERT HAAS
TW: @gitbisect @datadoghq
![Page 52: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/52.jpg)
TW: @gitbisect @datadoghq
FINDING **INEFFICIENT** QUERIES
![Page 53: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/53.jpg)
LATENCY VS POTENTIAL
EXPLAIN ANALYZE
TW: @gitbisect @datadoghq
http://bit.ly/pg-explain
‣ Explain displays the execution plan
![Page 54: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/54.jpg)
LATENCY VS POTENTIAL
EXPLAIN ANALYZE
TW: @gitbisect @datadoghq
http://bit.ly/pg-explain
‣ Explain displays the execution plan
‣ Analyze runs it and gathers stats
![Page 55: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/55.jpg)
LATENCY VS POTENTIAL
EXPLAIN ANALYZEMerge Right Join (cost=25870.55..31017.51 rows=229367 width=92) (actual time=2884.501..5147.047 rows=354834 loops=1)
Merge Cond: (a.uid = b.uid) -> Index Scan using foo on bar a (cost=0.00..537.29 rows=9246 width=27) (actual time=0.049..41.782 rows=9246 loops=1)
-> Materialize (cost=25870.49..27204.80 rows=106745 width=81) (actual time=2884.413..3804.537 rows=354834 loops=1) -> Sort (cost=25870.49..26137.35 rows=106745 width=81) (actual time=2884.406..3099.732 rows=111878 loops=1)
Sort Key: b.uid Sort Method: external merge Disk: 8928kB… Total runtime: 5588.105 ms(14 rows)
http://bit.ly/pg-auto-explain
TW: @gitbisect @datadoghq
![Page 56: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/56.jpg)
POSTGRESQL PERFORMANCE
SUMMARY1. Remember the 4 qualities of good metrics
1. Well understood 2. Sufficiently granular 3. Tagged & filterable 4. Long-lived
TW: @gitbisect @datadoghq
![Page 57: Monitoring 101 PostgreSQL 101... · @gitbisect Technical Writer/Evangelist “Docs & Talks” Travel Hacker & Whiskey Hunter @datadoghq SaaS-based monitoring Trillions of data points](https://reader033.vdocuments.site/reader033/viewer/2022041523/5e2fca5439368f1eac018baf/html5/thumbnails/57.jpg)
POSTGRESQL PERFORMANCE
SUMMARY2. Understand the difference between work
metrics, resource metrics & events 3. Alert on the appropriate work metrics
TW: @gitbisect @datadoghq