elasticsearch 1.x cluster installation (virtualbox)

29
ه توزیع شدهه پردازش داد کارگادبهشتی شهی- پردیس کامپیوتر و مهندسیانشکده علوم د درس:ه توزیع شدهه داد پایگاستاد: ای طباطبای دکتر هادی ارائه:قیفضل صدی ابوال آذر۱۳۹۳

Upload: amir-sedighi

Post on 15-Jul-2015

1.560 views

Category:

Data & Analytics


1 download

TRANSCRIPT

Page 1: Elasticsearch 1.x Cluster Installation (VirtualBox)

کارگاه پردازش داده توزیع شده

پردیس- شهیدبهشتی

دانشکده علوم و مهندسی کامپیوتر

پایگاه داده توزیع شدهدرس:

دکتر هادی طباطباییاستاد:

ابوالفضل صدیقی ارائه: ۱۳۹۳آذر

Page 2: Elasticsearch 1.x Cluster Installation (VirtualBox)

2

Elasticsearch Cluster Installation

Amir Sedighi@amirsedighi

http://hexican.com

Dec 2014

Page 3: Elasticsearch 1.x Cluster Installation (VirtualBox)

3

References

● http://www.elasticsearch.org

● http://www.elasticsearch.org/guide/en/elasticsearch/guide/current/index.html

Page 4: Elasticsearch 1.x Cluster Installation (VirtualBox)

4

Topics

● Assumptions● First Node

– Java Installation

– Downloading and Extracting Elasticsearch

– Configuration

● Cloning● Starting ES Cluster

● ES REST API● ES General Concepts

– Index, Shard, Segment– Plugins

● River● CSV● JDBC

● Feeder● ES Commands● ES GUIs

– Cluster Monitoring– Analytical Search and BI

Page 5: Elasticsearch 1.x Cluster Installation (VirtualBox)

5

Assumptions

● You already know about Linux.

– http://www.slideshare.net/AmirSedighi/distrinuted-data-processing-workshop-sbu

Page 6: Elasticsearch 1.x Cluster Installation (VirtualBox)

6

Installing Java

● $ sudo apt-get install default-jdk

Page 7: Elasticsearch 1.x Cluster Installation (VirtualBox)

7

Downloading and Extracting

● http://hadoop.apache.org/releases.html

● $ tar -zxvf elasticsearch1.3.2.gz

Page 8: Elasticsearch 1.x Cluster Installation (VirtualBox)

8

Elasticsearch Configuration

● You would need to modify elasticsearch.yml and append the following as a minimum configuration

cluster.name: hexican

name.name: "node1"

node.master: true

node.data: false

Page 9: Elasticsearch 1.x Cluster Installation (VirtualBox)

9

Elasticsearch configuration

● Minimum ● Rich

Page 10: Elasticsearch 1.x Cluster Installation (VirtualBox)

10

Reboot

● $ sudo reboot

Page 11: Elasticsearch 1.x Cluster Installation (VirtualBox)

11

Cloning

● Clone the first machine and extend your cluster.

– Find the instruction here:● http://www.slideshare.net/AmirSedighi/distrinuted-data-

processing-workshop-sbu

Page 12: Elasticsearch 1.x Cluster Installation (VirtualBox)

12

Plugins

Page 13: Elasticsearch 1.x Cluster Installation (VirtualBox)

13

Plugins

Page 14: Elasticsearch 1.x Cluster Installation (VirtualBox)

14

Plugins

● River

● Feeder

Page 15: Elasticsearch 1.x Cluster Installation (VirtualBox)

15

Starting Elasticsearch Cluster

● You can run nodes one by one

– $ elasticsearch-1.3.4/bin/elasticsearch

● You can run all nodes at once using DSH

– $ dsh -M -a – 'elasticsearch-1.3.4/bin/elasticsearch'

Page 16: Elasticsearch 1.x Cluster Installation (VirtualBox)

16

River

Page 17: Elasticsearch 1.x Cluster Installation (VirtualBox)

17

River

Page 18: Elasticsearch 1.x Cluster Installation (VirtualBox)

18

River

Page 19: Elasticsearch 1.x Cluster Installation (VirtualBox)

19

Shutdown Cluster

$ curl -XPOST 'http://localhost:9200/_cluster/nodes/_all/_shutdown'

Page 20: Elasticsearch 1.x Cluster Installation (VirtualBox)

20

Cluster Health

Page 21: Elasticsearch 1.x Cluster Installation (VirtualBox)

21

Page 22: Elasticsearch 1.x Cluster Installation (VirtualBox)

22

Cluster Health

Page 23: Elasticsearch 1.x Cluster Installation (VirtualBox)

23

Page 24: Elasticsearch 1.x Cluster Installation (VirtualBox)

24

Page 25: Elasticsearch 1.x Cluster Installation (VirtualBox)

25

Page 26: Elasticsearch 1.x Cluster Installation (VirtualBox)

26

Page 27: Elasticsearch 1.x Cluster Installation (VirtualBox)

27

Page 28: Elasticsearch 1.x Cluster Installation (VirtualBox)

28

Metrics

Page 29: Elasticsearch 1.x Cluster Installation (VirtualBox)

29

Questions?