separating computation and storage with storage virtualization speaker : meng-shun su adviser :...

19
Separating computation and storage with storage virtualization Speaker : Speaker : Meng-Shun Meng-Shun Su Su Adviser : Chih-Hung Adviser : Chih-Hung Lin Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang, Yuezhi Zhou * 1

Upload: barnaby-tucker

Post on 13-Dec-2015

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

Separating computation and storage with storage virtualization

Speaker :Speaker : Meng-Shun Su Meng-Shun Su Adviser : Chih-Hung LinAdviser : Chih-Hung Lin Ten-Chuan HsiaoTen-Chuan Hsiao

Yaoxue Zhang, Yuezhi Zhou *

1

Page 2: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

OutlineOutline

1111 Introduction Introduction Introduction Introduction

2222 Related WorkRelated WorkRelated WorkRelated Work

5555 ConclusionsConclusionsConclusionsConclusions

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

4444 Implementation and deploymentImplementation and deploymentImplementation and deploymentImplementation and deployment

2

Page 3: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

3

1111 Introduction Introduction Introduction Introduction

(1) Each PC machine is installed with all needed software and data and executes them locally.

(2) Each client machine does not hold any desired software and data locally, which resides on the central server, while being streamed to and executed with the client’s local resources.

Page 4: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

4

1111 Introduction Introduction Introduction Introduction

Data center concern :  ‧ Software consistence  ‧ Heterogeneous OS and application support  ‧ Malware threat  ‧ Data protection

Page 5: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

5

1111 Introduction Introduction Introduction Introduction

This paper present “StoreVirt” system. Such as :  ‧ Heterogeneous OS support  ‧ User transparency  ‧ Software and data sharing  ‧ Separating computation from storage

Page 6: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

6

2222 Related WorkRelated WorkRelated WorkRelated Work

XP 、 2003 、 2008 、 Vista、 win7 、 Linux…etc

AFS NASNFS

AFS NASNFS

Although these systems can be used to share user files flexibly, they generally do not support sharing system files for the reasons described in Section 3.6

Page 7: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

7

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

We made the following four assumptions in the StoreVirt model.

1.我們假設使用者計算與記憶體都足夠。並且機器都是普通的個人電腦。

2.使用者的電腦沒有大型儲存裝置(如硬碟)3.使用者有 Ethernet-based乙太網路環境。4. Transparent computing的安裝與維護都有專業人員維護,伺服器也會被鎖在專門放置伺服器的機房內。使得安全性與信賴度能增加。

Page 8: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

8

StoreVirt mode

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

Page 9: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

9

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

Virtual disk and access method

1. first set of protocols is concerned about how to access the contents of Vdisk before a client OS starts, termed as MRBP (Multi-OS Remote Booting Protocol).

2. second set is about how to access the Vdisk when the client OS runs after starting, termed as NSAP (Network Service Access Protocol).

Page 10: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

10

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

操作步驟:1.客戶必須建立網路連線,連結虛擬硬碟。(模擬傳統硬碟)2.客戶必須選擇所使用的系統3.客戶需進行使用者驗證,連結專用的 vDisk image4.vDisk的操作如傳統硬碟相同。

To implement this set of protocols, it is needed to extend the traditional BIOS function.

Page 11: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

11

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

Flexible mapping from virtual to physical

Page 12: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

12

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

VBA 虛擬區塊位址PSD 物理儲存裝置PBA 物理區塊位址

全名:  ‧ VBA (Virtual block address)  ‧ PSD (Physical storage device)  ‧ PBA (Physical block address)

Page 13: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

13

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

When an end user logins, the StoreVirt client will ask for his name and password.

Page 14: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

14

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

Shows the process for the file redirector to handle an open file system call

Page 15: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

15

3333 ““StoreVirt” mechanism and methodStoreVirt” mechanism and method““StoreVirt” mechanism and methodStoreVirt” mechanism and method

  會去偵測本地端快取是否有資訊,若沒有才會到 Storage Pool取得,來加快運算與減少傳輸成本。

Page 16: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

16

4444 Implementation and deploymentImplementation and deploymentImplementation and deploymentImplementation and deployment

Page 17: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

17

4444 Implementation and deploymentImplementation and deploymentImplementation and deploymentImplementation and deployment

Page 18: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

18

5555 ConclusionConclusionConclusionConclusion

a. StoreVirt can achieve comparable or even better disk and filesystem performance than regular PCs with local hard disks, networked file system and VM-based approaches.

b. Our current prototype only support Ethernet-based LAN net- work. As the mobile network and even 3 G network emerge, it is more benefical to support them in transparent computing. Due to the network bandwidth is limited and vibrated, we need to explore its usage in transparent computing systems.

Page 19: Separating computation and storage with storage virtualization Speaker : Meng-Shun Su Adviser : Chih-Hung Lin Ten-Chuan Hsiao Ten-Chuan Hsiao Yaoxue Zhang,

19

Thank You