![Page 1: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/1.jpg)
Monitoring the unknown, 1000*100 series a day
Quentin ADAM - @waxzce
![Page 2: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/2.jpg)
Who am I ?Quentin ADAM from the Clever Cloud
@waxzce on twitter – github- soundcloud – instagram ….
![Page 3: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/3.jpg)
My day to day work : , the IT automation company
![Page 4: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/4.jpg)
Keep your apps online. made with node.js,scala, java, ruby, php, python, go…
Cloud & on premise
![Page 5: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/5.jpg)
And learn a lot of things about your code, apps, and good/bad design…
![Page 6: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/6.jpg)
Give back to the community
NEVER GONNA LET YOU DOWN
clever-cloud.com
![Page 7: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/7.jpg)
Automate infrastructure
![Page 8: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/8.jpg)
What are we talking about?
![Page 9: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/9.jpg)
Immutable infrastructureFR : https://www.youtube.com/watch?v=WrZCbgQsPVU
EN : https://www.infoq.com/presentations/server-cloud
![Page 10: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/10.jpg)
Ephemeral instances
![Page 11: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/11.jpg)
Pet!=Cattle
![Page 12: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/12.jpg)
Monitoring service!=Monitoring host
![Page 13: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/13.jpg)
Monitoring the unknowPart 1
![Page 15: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/15.jpg)
Business metrics
Application metrics
middleware app
system metrics
• logins
• leads
• sales
• clicks
• ...
• SQL sessions
• User session opened
• Connections pool
• …
• GC
• JVM management
• request per seconds
• Threads
• Jobs scheduling
• …
• cpu
• load
• storage
• RAM
• ...
![Page 16: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/16.jpg)
Monitoring the unknowPart 2
![Page 17: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/17.jpg)
There is no ready solution…
![Page 18: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/18.jpg)
Let’s build something
![Page 19: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/19.jpg)
Data needs
![Page 20: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/20.jpg)
Store measure in time
![Page 21: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/21.jpg)
Analyze itMost of the time using a micro batching approach
![Page 22: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/22.jpg)
Traditional needs not required
• No ACID
• No Transaction
• Just a few full text
• Eventual consistency if enough
![Page 23: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/23.jpg)
SCALE
![Page 24: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/24.jpg)
Time Series DB
![Page 25: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/25.jpg)
Series and Labels
• Instance.xxxxxx.ram.free = 2078
• {• Application: myAppId
• Platform: Java
• Os: Linux
• …
• }
![Page 26: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/26.jpg)
Watch out cardinality
![Page 27: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/27.jpg)
Time series DB is an hot noSQL topic
![Page 28: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/28.jpg)
Influx DB
![Page 29: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/29.jpg)
Prometeus
![Page 30: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/30.jpg)
Timescale DB
Based on
![Page 31: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/31.jpg)
Open TSDB
![Page 32: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/32.jpg)
Cassandra + Akka persistence/stream
![Page 33: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/33.jpg)
Warp10
![Page 34: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/34.jpg)
Standalone Java fat jar
![Page 35: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/35.jpg)
Distributed
• Consensus using Zookeepers
• Store and analysis on Hadoop
• Event bus with Kafka
• Several roles in a single JAR, all stateless
![Page 36: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/36.jpg)
Warp10 roles
• Ingress
• Directory
• Store
• Egress
• Webcall
• Plasma
• Runner
• Fetcher
![Page 37: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/37.jpg)
Ingress🔑
Kafka
Hadoop Hbasecluster
Store
Dictionary
![Page 38: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/38.jpg)
So, We can now store data
![Page 39: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/39.jpg)
How to send some
![Page 40: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/40.jpg)
Agent: Telegraf
![Page 41: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/41.jpg)
Agent goals
![Page 42: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/42.jpg)
Collect data
• System
• Many connector to specific softs
• Open protocols…
• Push or Pull?
![Page 43: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/43.jpg)
JMX
![Page 44: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/44.jpg)
Statsd Simple UDP protocol
![Page 45: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/45.jpg)
Prometeus
![Page 46: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/46.jpg)
Buffer to send batched data
~100 metric point / minutes
![Page 47: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/47.jpg)
Token based security
![Page 48: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/48.jpg)
More tokens: JWT and Macaroon
EN : https://www.youtube.com/watch?v=SO5G0Gsm5-w
FR : https://www.youtube.com/watch?v=mvKeCsxGZhE
![Page 49: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/49.jpg)
✅ Send data from all VMs
✅ Send data from others infrastructures parts
✅ Store data
❔ Analyze data
❔ Trigger data
❔ Display data
![Page 50: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/50.jpg)
WarpScript, distributed on hadoop
![Page 51: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/51.jpg)
µBatching WarpScriptµBatchingWarpScriptµBatchingWarpScript
![Page 52: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/52.jpg)
Build a new series
![Page 53: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/53.jpg)
Listen on Kafka or Plasma for triggers
![Page 54: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/54.jpg)
Immutable DataBase
![Page 55: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/55.jpg)
✅ Send data from all VMs
✅ Send data from others infrastructures parts
✅ Store data
✅ Analyze data
✅ Trigger data
❔ Display data
![Page 56: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/56.jpg)
Quantum
Tool
+
PolymerJS lib
![Page 57: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/57.jpg)
Quantum
Tool
+
PolymerJS lib
![Page 58: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/58.jpg)
Which data expose?
![Page 59: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/59.jpg)
Templating the data
![Page 60: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/60.jpg)
Templating the data
![Page 61: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/61.jpg)
Templating the data
![Page 62: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/62.jpg)
![Page 63: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/63.jpg)
![Page 64: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/64.jpg)
Give access to the API
![Page 65: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/65.jpg)
Enhance developer work, happiness and productivity
![Page 66: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/66.jpg)
Give access to metrics and logs
![Page 67: Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017](https://reader034.vdocuments.site/reader034/viewer/2022052606/5a64b6857f8b9a900f8b472f/html5/thumbnails/67.jpg)
Thank you
find me on twitter
@waxzce
Gift coupon for clever-cloud.com:
bigDataConf2017