coud storage optimization using tiering storage metode

Optimasi Cloud Storage dengan metode Tiering Storage

Oleh :

Muhammad Aditya Haferush

M. Zen Samsono H, ST. M.Sc

Idris Winarno, S.ST. M.Kom

LATAR BELAKANG

• Mahalnya media penyimpanan dengan performa tinggi (SSD)

• Teknologi hierarchical storage management masih digunakan di kalangan enterprise

• Membuat cloud storage yang murah

2

BATASAN MASALAH

• Sistem ini dibangun di atas VMware ESXi 5.1

• Digunakan 2 tipe harddisk sebagai media penyimpanan, yakni SATA dan solid-state drive (SSD) dan 2 network attached storage (FreeNAS dan Openfiler)

• Aplikasi pada sisi user menggunakan ownCloud

3

ARSITEKTUR SISTEM

4

MEKANISME TIERING

5

6

SKENARIO PENGUJIAN

7

SKENARIO PENGUJIAN

8

PENGUJIAN SSD

9

No. 32 KB 100% read 32 KB 50% read 32 KB 50% write 32 KB 100% write

1 108.73 MB/sec 18.28 MB/sec 18.45 MB/sec 59.90 MB/sec

2 199.9 MB/sec 18.37 MB/sec 18.42 MB/sec 59.8 MB/sec

3 199.90 MB/sec 18.52 MB/sec 18.64 MB/sec 59.86 MB/sec

4 199.59 MB/sec 18.54 MB/sec 18.51 MB/sec 59.92 MB/sec

5 199.59 MB/sec 18.63 MB/sec 18.67 MB/sec 59.83 MB/sec

6 199.97 MB/sec 18.55 MB/sec 18.64 MB/sec 59.93 MB/sec

7 199.91 MB/sec 18.63 MB/sec 18.55 MB/sec 59.79 MB/sec

8 199.98 MB/sec 18.57 MB/sec 18.47 MB/sec 59.95 MB/sec

9 200.03 MB/sec 18.53 MB/sec 18.59 MB/sec 59.87 MB/sec

10 199.82 MB/sec 18.69 MB/sec 18.59 MB/sec 59.71 MB/sec

Avg 190 MB/sec 18.53 MB/sec 18.55 MB/sec 59.86 MB/sec

PENGUJIAN SSD

10

18

18.1

18.2

18.3

18.4

18.5

18.6

18.7

18.8

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian SSD (50% read VS 50% write)

read

write

0

50

100

150

200

250

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian SSD (100% read VS 100% write)

read

write

PENGUJIAN SATA

11

No. 32 KB 100% read 32 KB 50% read 32 KB 50% write 32 KB 100% write

1 173.04 MB/sec 16.14 MB/sec 16.05 MB/sec 50.9 MB/sec

2 159.87 MB/sec 11.88 MB/sec 11.83 MB/sec 59.78 MB/sec

3 121.95 MB/sec 10.55 MB/sec 10.54 MB/sec 57.98 MB/sec

4 118.82 MB/sec 12.11 MB/sec 12.9 MB/sec 61.55 MB/sec

5 115.21 MB/sec 12.19 MB/sec 12.21 MB/sec 64.06 MB/sec

6 102.54 MB/sec 12.18 MB/sec 12.85 MB/sec 65.62 MB/sec

7 93.35 MB/sec 12.27 MB/sec 12.25 MB/sec 66.61 MB/sec

8 82.37 MB/sec 12.25 MB/sec 12.2 MB/sec 66.95 MB/sec

9 75.62 MB/sec 11.83 MB/sec 11.91 MB/sec 66.74 MB/sec

10 85.83 MB/sec 11.96 MB/sec 11.91 MB/sec 65.9 MB/sec

Avg 112.86 MB/sec 12.33 MB/sec 12.46 MB/sec 62.60 MB/sec

PENGUJIAN SATA

12

0

20

40

60

80

100

120

140

160

180

200

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian SATA (100% read VS 100% write)

READ 100&

WRITE 100%

0

2

4

6

8

10

12

14

16

18

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian SATA (50% read VS 50% write)

READ 50 %

WRITE 50%

PENGUJIAN NAS

13

No. 32 KB 100% read 32 KB 50% read 32 KB 50% write 32 KB 100% write

1 186.79 MB/sec 4.12 MB/sec 4.11 MB/sec 9.89 MB/sec

2 104.28 MB/sec 6.76 MB/sec 3.37 MB/sec 10.01 MB/sec

3 83.34 MB/sec 3.36 MB/sec 3.34 MB/sec 9.81 MB/sec

4 94.25 MB/sec 3.32 MB/sec 3.32 MB/sec 10.09 MB/sec

5 81.98 MB/sec 3.26 MB/sec 3.30 MB/sec 10.61 MB/sec

6 59.98 MB/sec 3.39 MB/sec 3.37 MB/sec 10.41 MB/sec

7 64.24 MB/sec 3.35 MB/sec 3.38 MB/sec 9.92 MB/sec

8 57.90 MB/sec 3.33 MB/sec 3.33 MB/sec 10.09 MB/sec

9 58.41 MB/sec 3.29 MB/sec 3.31 MB/sec 9.77 MB/sec

10 56.54 MB/sec 3.43 MB/sec 3.42 MB/sec 10.58 MB/sec

Avg 84.77 MB/sec 3.76 MB/sec 3.42 MB/sec 10.11 MB/sec

PENGUJIAN NAS

14

0

1

2

3

4

5

6

7

8

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian NAS (50% read vs 50% write)

Read

Write

0

20

40

60

80

100

120

140

160

180

200

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian NAS (100% read VS 100% write)

NAS

NAS

PENGUJIAN TIER

15

No. 32 KB 100% read 32 KB 50% read 32 KB 50% write 32 KB 100% write

1 69.22 MB/sec 15.49 MB/sec 15.46 MB/sec 18.62 MB/sec

2 170.12 MB/sec 18.01 MB/sec 17.92 MB/sec 7.92 MB/sec

3 200.58 MB/sec 18.25 MB/sec 18.24 MB/sec 18.8 MB/sec

4 209.27 MB/sec 18.24 MB/sec 18.14 MB/sec 10.69 MB/sec

5 101.98 MB/sec 18.16 MB/sec 18.07 MB/sec 10.02 MB/sec

6 153.92 MB/sec 18.10 MB/sec 18.12 MB/sec 8.33 MB/sec

7 60.47 MB/sec 17.15 MB/sec 17.12 MB/sec 18.54 MB/sec

8 43.88 MB/sec 16.64 MB/sec 16.59 MB/sec 15.52 MB/sec

9 69.22 MB/sec 15.49 MB/sec 15.46 MB/sec 18.62 MB/sec

10 45.96 MB/sec 10.29 MB/sec 10.28 MB/sec 29.07 MB/sec

Avg 112.46 MB/sec 16.58 MB/sec 16.54 MB/sec 15.61 MB/sec

PENGUJIAN TIER

16

0

2

4

6

8

10

12

14

16

18

20

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian TIER (50% read vs 50% write)

Read

Write

0

50

100

150

200

250

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Pengujian TIER (100% read VS 100% write)

TIER

TIER

PERBANDINGAN SEMUA MEDIA

17

0

50

100

150

200

250

300

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Perbandingan Performa baca tiap device

SSD

SATA

NAS

TIER

PERBANDINGAN SEMUA MEDIA

18

0

10

20

30

40

50

60

70

80

1 2 3 4 5 6 7 8 9 10

MB

/se

c

Perbandingan Performa tulis tiap device

SSD

SATA

NAS

TIER

PENGUJIAN Utilisasi dan Latensi CPU

19

Besar Data (GB)

Utilisasi CPU (%)

Latensi CPU (%)

0.5 9.08 0.88

1 12.53 1.05

2 16.36 2.09

3 18.49 5.93

4 23.7 10.59

5 28.23 16.79 0

5

10

15

20

25

30

0.5 1 2 3 4 5

Pre

sen

tase

Perbandingan Utilisasi dan Latensi CPU

Utilisasi (%)

Latency (%)

KESIMPULAN

20

• Dari sisi kecepatan baca / tulis pada media penyimpanan SSD sudah mendekati ideal dengan spesifikasi teknis dari perangkat tersebut, kecepatan rata-rata untuk baca adalah 190 MB/sec dan kecepatan rata-rata untuk tulis mencapai 59.86 MB/sec.

• Begitupula untuk SATA sebesar 147 MB/sec unutk kecepatan rata-rata baca, dan tulis sebesar 86 MB/sec.

• NAS sebesar 84 MB/sec untuk kecepatan rata-rata baca serta 10 MB/sec untuk kecepatan rata-rata tulis.

• Pada media penyimpanan milik tier, kemampuannya rata-rata baca sebesar 112 MB/sec dan 16 MB/sec untuk kemampuan rata-rata tulis.

• Dari segi utilisasi dan latensi dari CPU saat terjadi migrasi data, dapat disimpulkan bahwa besar data yang dimigrasi akan bebanding lurus dengan utilisasi dan latensi dari CPU yang digunakan.

REFERENSI [1]. Tin Tin Yee and Thinn Thu Niang, “PC-Cluster Based Storage System Architecture for Cloud Storage”,

Universities of Computer Studies, Yangon, Myanmar. November 2011.

[2]. Gong Zhang, “Adaptive Data Migration in Multi-tiered Storage Based Cloud Environment”, Georgia Institute of Technology, Atlanta, Georgia. 2010.

[3]. Dr. G.R. Karpagam, “Setting up of an Open Source based Private Cloud”, Department of Computer Science and Engineering, PSG College of Technology, Coimbatore, India. May 2011.

[4]. Alex Budiyanto, “Pengantar Cloud Computing”, Cloud Indonesia. 2012.

[5]. Renny Shen, “Building a Cloud-enable File Storage Infrastructure”, F5 Networks Inc, United States of America. 2011.

[6]. Openstack Compute Starter Guide, “ESSEX”. May 2012.

[7]. GlusterFS Developers, “Gluster File System 3.3.0 Administration Guide Using Gluster File System Edition 1”, Red Hat Inc. 2012.

[8]. Ajay Gulati, Chethan Kumar and Irfan Ahmad, “Storage Workload Characterization and Conzolization in Virtual Environment”, VMware Inc, Palo Alto.

[9]. The Architecture of VMware ESXi, VMware Inc. 2008.

[10]. Hierarchical Storage Management, http://en.wikipedia.org/wiki/Hierarchical_storage_management. Terakhir diakses pada 26 Januari 2013.

[11]. Network Attached Storage, http://en.wikipedia.org/wiki/Network-attached_storage. Terakhir diakses pada 26 Januari 2013.

[12]. Information Life-cycle Management, Sun Microsystems. 2005.

[13]. An Introduction to Virtualization Technology, http://www.infoq.com/articles/virtualization-intro. Terkahir di akses pada 26 Januari 2013.

21

TERIMA KASIH

22