behind the scenes at coolblue - feb 2017
TRANSCRIPT
![Page 1: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/1.jpg)
Behind the Scenes - Feb 2017Pat Hermens [email protected]
![Page 2: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/2.jpg)
![Page 3: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/3.jpg)
![Page 4: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/4.jpg)
All the things.
![Page 5: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/5.jpg)
kibana
elasticsearch
beats logstash
Elastic Stack.
![Page 6: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/6.jpg)
Elastic Stack.
Kibana● “A visualisation tool that ties into Elastic Search”
● Why do we use it?○ It “just works” with the rest of the stack○ Visualisations and dashboards are “good enough” and getting better
![Page 7: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/7.jpg)
Elastic Stack.
Elastic Search● “A performant search engine & data store”
● Why do we use it?○ Great at storing large amounts of data, and ○ Fantastic at searching through it!
![Page 8: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/8.jpg)
Elastic Stack.
Beats● “It ships logs so you don’t have to”
● Why do we use it?○ Lots of machines○ Lots of environments○ Lots of moving parts○ Lots of legacy that we need to support (Thanks FileBeats!)
![Page 9: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/9.jpg)
Elastic Stack.
Logstash● “The entry-point into the Elastic Stack”
● Why do we use it?○ It splits up each log into a separate index ○ It enriches logs...
■ e.g.: Given an IP address, it can add city and country■ e.g.: Given a server name, it can add environment name■ HINT: Given a structured string, it can break it apart
![Page 10: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/10.jpg)
● What is it/what was the predecessor?
● When was it first released?
● Why do we use it?
Log4Net.
![Page 11: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/11.jpg)
Other handy tools.
“structured log visualiser” “in-memory data store”
![Page 12: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/12.jpg)
![Page 13: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/13.jpg)
More tooling.
![Page 14: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/14.jpg)
“Seq is the fastest way for development teams to carry the benefits of structured logging from development through to production.”
More tooling.
![Page 15: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/15.jpg)
+
More tooling.
![Page 16: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/16.jpg)
![Page 17: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/17.jpg)
![Page 18: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/18.jpg)
![Page 19: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/19.jpg)
Nightmares.
![Page 20: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/20.jpg)
SMTPAppender.
![Page 21: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/21.jpg)
![Page 22: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/22.jpg)
PatsCustomAppender.
![Page 23: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/23.jpg)
![Page 24: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/24.jpg)
+
More tooling.
![Page 25: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/25.jpg)
![Page 26: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/26.jpg)
+
More tooling.
+
![Page 27: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/27.jpg)
So much tooling.
![Page 28: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/28.jpg)
So much tooling.
![Page 29: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/29.jpg)
In Production.
![Page 30: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/30.jpg)
For our demo.
![Page 31: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/31.jpg)
![Page 32: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/32.jpg)
Nightmares.
![Page 33: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/33.jpg)
Nightmares.
![Page 34: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/34.jpg)
![Page 35: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/35.jpg)
Monitoring.
![Page 36: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/36.jpg)
Yes, monitoring.
![Page 37: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/37.jpg)
Disclaimer.
![Page 38: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/38.jpg)
![Page 39: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/39.jpg)
The shiniest.
![Page 40: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/40.jpg)
All the new things.
![Page 41: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/41.jpg)
Conclusions.
![Page 42: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/42.jpg)
Conclusions.
![Page 43: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/43.jpg)
Conclusions.
![Page 44: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/44.jpg)
Conclusions.
![Page 45: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/45.jpg)
Conclusions.
![Page 46: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/46.jpg)
● Documentation & code from tonight:○ https://github.com/phermens-coolblue/bts-2017-february/
● Seq running on a Windows Server Core image:○ https://github.com/phermens-coolblue/bts-2017-february/tree/master/docker/seq
○ ...or https://hub.docker.com/r/pheonix25/servercore-seq/
● ELK & Redis running on Docker:○ https://github.com/phermens-coolblue/bts-2017-february/tree/master/docker/elk
● Coolblue DevBlog: ○ http://devblog.coolblue.nl/
● Slides (and possibly video) will be available soon:
○ @phermens, or https://hermens.com.au
Links.
![Page 47: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/47.jpg)
![Page 48: Behind the Scenes at Coolblue - Feb 2017](https://reader034.vdocuments.site/reader034/viewer/2022052514/58b894bc1a28ab3e3a8b6651/html5/thumbnails/48.jpg)
Behind the Scenes - Feb 2017Pat Hermens [email protected]