indexing and searching logs with elasticsearch/solr by radu gheorghe from sematext

26

Upload: hakka-labs

Post on 10-May-2015

1.313 views

Category:

Technology


3 download

DESCRIPTION

This presentation shows how Logstash, Apache Flume or rsyslog can help you parse, buffer and ship your logs to Elasticsearch or Solr. We’ll show the pros and cons of each tool, so you can decide what’s best for your use case. The presentation also puts Elasticsearch and Solr side by side ands shows how to make them handle write-heavy applications like those presented in the first part. It goes over how to tweak various buffers, merge policies, how to structure indices/collections, and more. And when one machine isn’t enough, we’ll look at how Elasticsearch and Solr (through SolrCloud) can be scaled horizontally to handle more and more data.

TRANSCRIPT

Page 5: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 6: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 7: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 8: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 11: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 12: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext

Source

Channel

HDFS

Solr

Channel

Page 14: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 15: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 19: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 20: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 22: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 23: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext
Page 24: Indexing and Searching Logs with Elasticsearch/Solr by Radu Gheorghe from Sematext