virtual cloud r98922135 陳昌毅 r98944033 顏昭恩 r98922150 黃伯淳 2010/06/03
TRANSCRIPT
![Page 1: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/1.jpg)
Virtual cloudR98922135 陳昌毅R98944033 顏昭恩R98922150 黃伯淳
2010/06/03
![Page 2: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/2.jpg)
Outline
• Goal• Introduction– Full virtualization– Para-virtualization
• VMware• XEN• System Diagram• Current Progress• Future Work• Q&A
![Page 3: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/3.jpg)
Goal
• Construct cloud platform that provides VM as a service
• Motivation– A Private cloud platform– Common cloud platform (Eucalyptus, ONE) doesn’t provide
migration
• Challenge– A convenient environment to migrate VM
• Access image through NFS is extremely slow
![Page 4: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/4.jpg)
• XEN– A hypervisor– Virtualization
• Eucalyptus– Controller system– NO migration mechanism
• OpenNEbula
Related work
![Page 5: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/5.jpg)
• We use a distributed share file system to host VM image. – VM can migrate without a central storage.
• Construct VMs as multiple prototypes according to their functionalities.
Innovations
![Page 6: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/6.jpg)
Why Virtualization
• To increase the utilization of costly hardware resources.
• Easy to management.• Portability.
![Page 7: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/7.jpg)
XEN
• Para-virtualization• Full virtualization (Hardware assisted)• Xend (domain-0)
![Page 8: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/8.jpg)
System Diagram
![Page 9: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/9.jpg)
Share File SystemPros Cons
NFS Easy to manage IO bottleneck
Glustre Distribute file system Need to modify kernel
Gluster User space distribute file system
P2P
Modified Glustre kernel is unstable to work with XEN
![Page 10: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/10.jpg)
Migration
• Why we need live migration? We want to move VM without interrupting VM
service.Products:– Xen : live migration– VMware:VMotion
Two important consideration: 1. Downtime 2. Total migration time
![Page 11: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/11.jpg)
Pre-copy migration
![Page 12: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/12.jpg)
Managed Migration(Xen)
1. 1st round: – Copy all memory pages to destination machine. – Replace shadow page table to original one, and mark all pages read-
only . – Create a dirty bit map for the VM.
2. 2nd-(n-1)th round: – During the pages transferring, if VM want to modify a page, it will
invoke Xen to set the appropriate bit in the dirty bit map. – Dirty pages will be resend again.– Reset dirty bit map for the next round.
3. nth round: – When the Dirty rate is bigger than up bound, begin to do stop-and-
copy.
![Page 13: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/13.jpg)
User Interface
![Page 14: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/14.jpg)
User Interface
![Page 15: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/15.jpg)
![Page 16: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/16.jpg)
Demo- Migration
•Source
![Page 17: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/17.jpg)
Demo- Migration
• Destination
![Page 18: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/18.jpg)
• 13 nodes plus a master to sort 8.6GB data.• Local– All images are on local disks.
• SFS_local– All images are on local disks and are accessed via
Gluster file system.• SFS_remote– All images are on remote disks and are accessed
over Gluster file system.
Hadoop Benchmark
![Page 19: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/19.jpg)
1 2 3 4 5 6 7 8 9 100
20406080
100120140160180
localSFS_localSFS_remote
Iteration
Performance Comparison
local SFS_local SFS_remote
87.50 103.90 160.70 Sec
Seconds
![Page 20: Virtual cloud R98922135 陳昌毅 R98944033 顏昭恩 R98922150 黃伯淳 2010/06/03](https://reader033.vdocuments.site/reader033/viewer/2022061419/5697c0251a28abf838cd4f7c/html5/thumbnails/20.jpg)
Q&A