Using Elastic to monitor anything

Christoph WurmSolutions Architect

Unstructured Data Structured Data

Search Logging Security MetricsAnalytics

Social SensorLogsDocuments UserActivity Location

Elastic Cloud

Security

X-Pack

KibanaUser Interface

ElasticsearchStore, Index,& Analyze

IngestLogstash Beats

+

Elastic Stack

Alerting

Monitoring

Reporting

Graph

”Long” pipeline

Ingest node

FilebeatTail files

PacketbeatCapture network packets

MetricbeatSystem (ex Topbeat)ApacheMySQLNginxPostgreSQLRedisZookeeper

WinlogbeatWindows event logs

apachebeathttpd server-status

burrowbeatkafka consumer lag

cassandrabeatnodetool cfstats

cloudtrailbeataws events

dockerbeatcontainer stats

elasticbeatelasticsearch status

execbeatshell cmd output

flowbeatsflow

factbeatpuppet facter

httpbeatpoll http(s) endpoints

jmxproxybeattomcat jmx metrics

lmsensorsbeattemp, voltage, fans

mysqlbeatany query -> elasticsearch

packagebeatdpkg, rpm

pingbeaticmp ping w/ rtt

redisbeatredis info

twitterbeattweets by screen namewmibeat

windows monitoring

https://www.elastic.co/guide/en/beats/libbeat/master/community-beats.html

DemoBeats & Kibana 5

Script at https://github.com/cwurm/elastic-monitoring-meetup

Q&A

@ChristophWurm