virtualization: concepts, applications, and performance...
TRANSCRIPT
![Page 1: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/1.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
1
Virtualization: Concepts,Virtualization: Concepts,Applications, and PerformanceApplications, and Performance
ModelingModelingDaniel A. Menascé, Ph.D.
The Volgenau School of Information Technologyand Engineering
Department of Computer ScienceGeorge Mason University
www.cs.gmu.edu/faculty/menasce.html
![Page 2: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/2.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
2
Basic Concepts in VirtualizationBasic Concepts in Virtualization
Hardware
Operating System
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
Non-virtualized system
• The OS controls access to the hardware resources.• The instruction set is divided into privileged and non-privileged.• The machine can be in two modes of operation: user and supervisor.• Only non-privileged instructions can be executed in user mode.• Any instruction can be executed in supervisor mode.• Application environments execute in user mode and the OS in supervisor mode.
![Page 3: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/3.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
3
Basic Concepts in VirtualizationBasic Concepts in Virtualization
Hardware
Operating System
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
Non-virtualized system
Hardware
Operating System
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
Virtual MachineMonitor
Virtualized system
![Page 4: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/4.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
4
Basic Concepts in VirtualizationBasic Concepts in Virtualization
Hardware
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
Virtual MachineMonitor (VMM)
Virtualized system
OS 1 OS 2
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent • The VMM controls access to the
hardware resources.• OSs (called guest OSs) execute in user mode and the VMM in supervisor mode.• The VMM interprets in software privileged instructions that would be executed by an OS.• Any non-privileged instruction issued by an OS or Application Environment is executed directly by the machine.• This is called virtualization by direct execution or full virtualization.
![Page 5: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/5.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
5
Basic Concepts in Virtualization:Basic Concepts in Virtualization: the x86 architecture the x86 architecture
Hardware
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
Virtual MachineMonitor (VMM)
Virtualized system
OS 1 OS 2
App
licat
ion
Envi
ronm
ent
App
licat
ion
Envi
ronm
ent
• The x86 architecture provides four levels of privilege: rings 0 through 3.• In a non virtualized environment, the OS executes in ring 0 and the applications in ring 3.• In a virtualized environment that uses paravirtualization (e.g., Xen) the VMM runs at ring 0, the guest OS at ring 1 and the applications at ring 3.
![Page 6: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/6.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
6
Basic Concepts in VirtualizationBasic Concepts in Virtualization
![Page 7: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/7.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
7
Virtualization Slowdown,Virtualization Slowdown, SSvv
• In the direct execution approach, privilegedinstructions have to be emulated by theVMM instead of being executed by thehardware.
€
Sv = f p × Ne + (1− f p )
€
f p
€
Ne
: fraction of privileged instructions executed by a VM.
: average number of instructions required by the VMM to emulate a privileged instruction.
![Page 8: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/8.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
8
Execution Slowdown
0
1
2
3
4
5
6
0.00% 0.05% 0.10% 0.15% 0.20% 0.25% 0.30% 0.35% 0.40% 0.45%
Fraction of privileged instructions
Slo
wd
ow
n
Ne= 500 Ne= 1000
![Page 9: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/9.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
9
Mapping of Virtual to Physical DisksMapping of Virtual to Physical Disks
![Page 10: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/10.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
10
Some HistorySome History
• Over 30 years ago: IBM’s VM/370• 80’s: decrease in hardware cost caused migration
away from mainframes and virtualization fadedaway.
• More recent networked environments broughtproblems such as reliability, security, increasedadministration cost and complexity, thermaldissipation.– Virtualization is poised to address these problems.
![Page 11: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/11.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
11
Advantages of VirtualizationAdvantages of Virtualization• Security
– Compartmentalized environments allow for betterchoice of guest operating system for each environment(e.g., run Apache on top of Linux and MS SQL on topof Windows XP)
• Reliability and Availability– A software failure in one VM does not affect other
VMs• Cost
– Server consolidation can bring cost reductions fromhardware economies of scale, personnel costreductions, floor space, and software licenses.
• Typical savings: 29% to 64%.
![Page 12: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/12.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
12
Advantages of VirtualizationAdvantages of Virtualization(cont(cont’’d)d)
• Adaptability to Workload Variations:– Changes in workload intensity levels can be taken care
by dynamically shifting resources and priorityallocations among VMs using autonomic computingtechniques.
• Load Balancing– The state of a VM is completely encapsulated in the
VMM: easy to migrate VMs to other platforms toimprove performance.
• Legacy applications– Legacy applications can continue to run on old OSs that
run as a guest operating systems on VMs.
![Page 13: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/13.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
13
Performance Modeling ofPerformance Modeling ofVirtualized EnvironmentsVirtualized Environments
• Use Queuing Network (QN) models:– Customer classes– Parameters: service demands and workload
intensities– Service Demand Law: Di,r = Ui,r / X 0,r
![Page 14: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/14.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
14
Queuing Network ModelsQueuing Network Models
CPU
Disk 1
Disk n
Input parameters per class:• workload intensity (e.g., arrival rates, concurrency levels)• service demands per device (i.,e, total time spent by a transaction receiving service from that device)
Solution techniques:•“Performance by Design,” Menasce, Almeida, and Dowdy, Prentice Hall, 2004.
![Page 15: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/15.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
15
Service Demand (D)Service Demand (D)
Resource LINE
Service demand =Total service time receivedby a request overall visits to a resource
. . .
S1S2
Sk
Arriving requestsCompleting requests
Sk: Service time received by the request during visit kD: Service demand = S1 + S2 + …+ Sk
![Page 16: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/16.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
16
Computing Service DemandsComputing Service Demandsusing the Service Demand Lawusing the Service Demand Law
• The service demand Di is given by:
Di = Ui / Xo
where Ui is the utilization of resource i and Xo thesystem throughput.
![Page 17: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/17.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
17
Performance Modeling ofPerformance Modeling ofVirtualized EnvironmentsVirtualized Environments
• Use Queuing Network (QN) models:– Customer classes– Parameters: service demands and workload intensities– Service Demand Law: Di,r = Ui,r / X 0,r
• Issue: How to combine measurements obtainedfrom measurements tools at different softwarelayers of a virtualized environment?
![Page 18: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/18.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
18
Parameter ComputationParameter Computation
420 sec of CPU 220 sec of CPUUcpu=40%UD1=35%UD2=45%
Ucpu for vm1:
0.4* 420/(420+220)= 0.2625
![Page 19: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/19.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
19
Parameter ComputationParameter Computation
420 sec of CPU 220 sec of CPUUcpu=40%UD1=35%UD2=45%
Ucpu for vm2:
0.4* 220/(420+220)= 0.1375
![Page 20: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/20.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
20
Parameter ComputationParameter Computation
420 sec of CPU 220 sec of CPUUcpu=40%UD1=35%UD2=45%
290 sec CPU 100 sec CPU
Ucpu of TPM:0.2625 *290/(290+100)= 0.1952
Ucpu for vm1:0.4* 420/(420+220)= 0.2625
![Page 21: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/21.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
21
Parameter ComputationParameter Computation
420 sec of CPU 220 sec of CPUUcpu=40%UD1=35%UD2=45%
5400 Q1200 U
Q: 110 sec CPUU: 150 sec CPU
290 sec CPU 100 sec CPU
Ucpu of TPM:0.2625 *290/(290+100)= 0.1952
Ucpu of Query:0.1952 *110/(110+150)= 0.0826
![Page 22: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/22.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
22
Parameter ComputationParameter Computation
420 sec of CPU 220 sec of CPUUcpu=40%UD1=35%UD2=45%
5400 Q1200 U
Q: 110 sec CPUU: 150 sec CPU
290 sec CPU 100 sec CPU
Ucpu of Query:0.1952 *110/(110+150)= 0.0826
Query throughput:5400 / 1800 = 3tps
CPU demand for Q:0.0826/3=0.0275 sec
![Page 23: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/23.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
23
Server ConsolidationServer Consolidation
3-serverscenario
consolidated serverscenario
![Page 24: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/24.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
24
Server ConsolidationServer Consolidation
![Page 25: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/25.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
25
Server ConsolidationServer Consolidation
Physical disks
Logical disks
![Page 26: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/26.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
26
Server ConsolidationServer ConsolidationComputing Service DemandsComputing Service Demands
€
DCPU ,rcons = DCPUs ,r
× Sv /Css=1
S
∑Service demandat the CPU of theconsolidated serverfor class r applications.
Number oforiginal servers
Service demandat the CPU of originalserver s for class r applications.
Slowdown factor
Speedup of consolidatedserver relative toindividual server s
![Page 27: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/27.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
27
![Page 28: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/28.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
28
For a Cs = 1, the response time is 3.6 times higher.
![Page 29: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/29.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
29
For a Cs = 2.5, the response time is only4% higher.
![Page 30: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/30.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
30
Concluding RemarksConcluding Remarks• Many vendors are adopting virtualization
solutions:– Sun’s zones in Solaris 10– IBM’s Logical Partitioning (LPAR)– Intel’s Virtualization Technology: hardware support for
virtualization.• Additional instructions that can be used by the VMM to create
and support VMs.• The VMM runs one level below ring 0 and the VMs execute at
ring 0– Xen (Open Source)– EMC’s VMWare– Microsoft Virtual Server 2005 R2
![Page 31: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/31.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
31
Concluding Remarks (contConcluding Remarks (cont’’d)d)• Two main directions in virtualization:
– Full virtualization: the VMM provides an identical abstraction ofthe underlying hardware. However, not all architectures arevirtualizable (e.g., x86).
• No changes required to the guest OSs• Example: VMware
– Paravirtualization: the VMM provides an “almost” identicalabstraction of the underlying hardware. The abstractionimplements some new instructions to make the machinevirtualizable.
• Guest OSs need to be modified.• Better performance than full virtualization.• Examples: Xen and Denali
![Page 32: Virtualization: Concepts, Applications, and Performance Modelingmenasce/papers/menasce-cmg05-virt... · 2005-12-07 · Basic Concepts in Virtualization Hardware Operating System Application](https://reader030.vdocuments.site/reader030/viewer/2022040718/5e25bd9a252954755573e492/html5/thumbnails/32.jpg)
© 2005 D.A. Menascé. All Rights Reserved.
32
Questions?Questions?
www.cs.gmu.edu/faculty/menasce.html