virtualization future

8/8/2019 Virtualization Future

1/35

Virtualization TechnologyTrends

Intel Corporation21 July 2008


2/35

Agenda

Virtualization Technology evolution

VMMs

Hybrid virtualization Open Virtualization Format Specification

Virtual Machine Interface

Usages evolution


3/35

Intel Virtualization Technology Evolution

Software-only VMMs

Binary translation

Paravirtualization

Device emulations

Simpler and more

secure VMM through

use of hardware VT

support

Better IO/CPU perf

and functionality via

hardware-mediated

access to memory

Assists for IO sharing: PCI IOV compliant devs

VMDq: Multi-context IO End-point DMA translation

caching IO virtualization assists

Richer IO-device

functionality and IO

resource sharing

Core support for IOrobustness &performance viaDMA

remappingRicher/faster: IntelVT FlexPriority,FlexMigrationEPT, VPID, ECRR,APIC-V

Close basicprocessor

virtualizationholes in Intel 64& Itanium CPUs

Perf improvementsfor interruptintensive env, fasterVM boot

Interrupt filtering &remappingVT-d extensions totrack PCI-SIG IOV

VT-x/i VT-x2/i2

VT-d

VT-x3/i3

VT-d2

VT-c

VMM software evolution over time with hardware supportVMM software evolution over time with hardware support

VMM

SoftwareEvolution

Vector 3:IO Device Focus

Vector 1:Vector 1:Processor Focus

Vector 2:Chipset Focus

Past 2005 2010

All timeframes, dates, and products are subject to change without further notification


4/35

Intels Next Ecosystem of VirtualizationInnovation

*Other names and brands may be claimed as the property of others.

Designed for Multi-Core Processors

Solution

Deliver scalableperformance for Intelmulti-core servers

Challenge Industry Efforts

Flexibility and Dynamic LoadBalancing for Virtualization

Optimize I/Obottlenecks

Unified Networking for BusinessContinuity and Disaster Recovery inVirtual Infrastructure

Simplify networkconnectivity tothe SAN


5/35

Whats Coming

Gigabit Virtualization Evolution:Next Generation Usage Models Through Virtualization Innovation

Throughput(Rx)

0.0

2.0

4.0

6.0

10.0

w/o VMDq w/ MNDq w/ VMDq JF*

8.0

9.59.2

4.0

Source: Intel

Todays Networking

NIC

VMMLayer 2 Software Switch

MAC/PHY

LAN

Layer 2 Sorter

VM1

vNIC

VM2

vNIC

VMn

vNIC

w/ VMDq

Wire Speed Rx SidePerformance With VMDq on

Intel 82598 10 GigabitEthernet Controller


6/35

Virtualization PerformanceRobust Tick Tock Roadmap

55%55%

70%70%

100%100%

85%85%

45nm45nm

Intel CoreIntel Core

uArchitectureuArchitecture

(Penryn)(Penryn)

Virtualization SWOverhead

2007 / 2008

VMDq

Intel VT-d

2008 / 2009

55%55%

70%70%

100%100%

85%85%

45nm45nm

Next generationNext generation

IntelIntel

uArchitectureuArchitecture

(Nehalem)(Nehalem)


EPT,

VPID,

VMDq2

55%55%

70%70%

100%100%

85%85%

Quad-Core IntelQuad-Core Intel

XeonXeon

ProcessorsProcessors

Intel Xeon 5100,Intel Xeon 5100,5300, 73005300, 7300


2006 / 2007

Intel VT-

x,

FlexPriorit

y

Roadmap will continue to deliver higher raw performance (Moores Law), andRoadmap will continue to deliver higher raw performance (Moores Law), and

architectural enhancements to improve efficiency in virtualized environmentsarchitectural enhancements to improve efficiency in virtualized environments



7/35


Intel virtualization in embeddeddevices


8/35


PC vs. Devices

VM in KVM (along with Qemu) means PC

Legacy devices, interrupt controllers, timers, ACPI/BIOS, PCI devices,monitor, keyboard, mouse, etc.

There are various devices or computers that are not compatiblewith PC Network routers, , robots, , toasters, , PDAs/MIDs,

Some can afford very small amount of memory (e.g. 128MB)

And various operating systems and apps have been developedfor those

Porting such (legacy) OS, drivers, and apps to PC is notstraightforward


9/35


Benefits of Using Virtualization forEmbedded Systems

Portability & Maintainability

Provides simplified and uniformed VM to minimizing portingand maintenance efforts

Once virtualized, its independent of H/W

Scalability & Consolidation

Legacy operating systems often support UP only Multiple instances of VMs

Reliability & Protection

Tolerate and isolate fatal errors in legacy OS guest andsoftware to avoid system crash

Sandboxing


10/35


Whats Mini-VM and Why?

Bare minimum and simple VM

CPU(s), memory, abstracted (PV) devices

Timer, front-end devices (or virtio)

Start from protected (or 64-bit) mode with paging enabled; noreal mode; No BIOS

Protected execution environment by H/W

Run under H/W-assisted virtualization

Allow Ring-0 operations, eliminating burden of para-virtualizingCPU

Low virtualization overheads

Use hybrid virtualization (PV + H/W-assisted virtualization)

Real-time (e.g. direct paging mode)

Check at the Mini-VM project
http://kvm.qumranet.com/kvmwiki/KvmForum2008?action=AttachFile&do=get&target=kdf2008_20.pdfhttp://kvm.qumranet.com/kvmwiki/KvmForum2008?action=AttachFile&do=get&target=kdf2008_20.pdf


11/35

Hybrid virtualization

Use hardware-assisted virtualization

The cost of VM exit/entry will be even lower in the future

Cost of VMCALL is lower than other VM exits

Use para-virtualization on focused areas Starting from hardware-assisted full-virtualization

Easier to share the kernel binary with the native

Reduce paravirtual operations significantly

The kernel regains the native CPU features lost in software onlypara-virtualization Fast system calls

Global pages

Paging-based protection (U/S), etc.

Privileged instructions GDT, IDT, LDT, TSS, cli/sti, etc.

Standard exceptions/interrupts


12/35

Focus areas for hybrid virtualization

Timer

Scheduling Idle handling

Interrupt controllers

MMU

Memory overcommit

Or hardware-assisted (i.e. EPT or NPT)

Inter VMs communication


13/35

Usage trends Business continuity

High availability support through the synchronization of VMs

Reduction of unplanned downtime Seamless management of resources

Livemigration

Service Oriented Architectures leveraged by Virtualization

Beginning of growth curve-expansion for desktop and

application virtualization Increased focus on security

Licensing issues/changing

Virtual Machines mobility

Open Virtualization Format Specification

Virtual Machines Interface

Live migration

Graphics virtualization

From a paravirtualization to a direct access approach


14/35

The future of Virtualization


15/35

Cloud computing Cloud computing relates to the underlying architecture in

which the services are designed

Applications run somewhere on the cloud we dont carewhere

Big news is for application developers and IT operations.

develop, deploy and run applications that can easily growcapacity (scalability), work fast (performance), and never or atleast rarely fail (reliability)

Infrastructures should have these characteristics:

Self-healing: hot backup application

SLA-driven

Multi-tenancy: built in a way that allows shared infrastructure

Service-oriented

Virtualized

Linearly Scalable: The system shall be predictable and efficientin growing the application

Data management


16/35

Desktop/App virtualization MarketexpansionAccording to a recent tracker study on the Asia/Pacific excluding

Japan (APEJ) thin client market, total sales of thin clients in 1H2007 reached 282,667 units, representing an increase of 37.3%over the previous year. Revenue likewise increased 29.2% overthe same period

Across the various verticals, the predominant role of thin clientsacross the region has shifted away from government/education

segment to financial services as the leading vertical of thin clientadoption from 1H 2006 onwards


17/35

Open Virtualization FormatSpecificationOVF Specification from DMTF describes an open, secure,

portable, efficient and extensible format for the packagingand distribution of software in (collections of) virtualmachines

Optimized for distribution

Optimized for a simple, automated user experience Supports both single VM and multiple-VM configurations

Portable VM packaging

Vendor and platform independent

Extensible

Localizable

Open standard


18/35

OVF Packages

package.ovf-> metadata descriptor (required)

package.mf-> manifest (optional) containing the SHA-1 digests ofindividual files in the package

package.cert -> signature of the digest (optional) along with thebase64-encoded X.509 certificate

de-DE-resources.xml -> OVF Envelope describes VMS metadata

vmdisk1.vmdk -> no specific disk format to be used is required

vmdisk2.vmdk resource.iso -> (optional)

Distribution

OVF package can be made available as a set of files

OVF package can be stored as a single file using the TAR format. Theextension should be .ova (open virtual appliance or application)


19/35

Virtual Machine Interface

In 2005, VMware proposed a paravirtualization interface, the Virtual MachineInterface (VMI), as a communication mechanism between the guest operating

system and the hypervisorAn implementation of this standard was merged in the main Linux kernel version

2.6.21

Motivations

Portability: it should be easy to port a guest OS to use the API

High performance: the API must not obstruct a high performancehypervisor implementation

Maintainability: it should be easy to maintain and upgrade the guest OS

Extensibility: it should be possible for future expansion of the API

No considerable adoption of the proposed VMI architecture, although a pending

need to be satisfied (considering HVM additions as new x86 support)What about proposing an interface from the platform?


20/35

Wrap up

Virtualization Technology Introduction

Beginnings of Virtualization Technology in x86

Approaches to server and client virtualization

Virtualization Usages in Servers

IT business needs behind Virtualization Technology

VMMs / Hypervisors

Deep dive in the open source Xen hypervisor Overview of KVM, VMware, OpenVZ

Hardware assisted Virtualization

Software solution for x86 virtualization

Enhancements through hardware assisted virtualization

Intel VT features Virtualization Technology trends

VMMs standardization and VMs mobility

Virtualization in every platform


21/35

How to start

Do I need virtualization?

Consider the server side

Lab in the University

Data Center consolidation

Environments for server applications development

Consider the clients side

VMs for each student

VMs for users with low processing power needs

Which do I choose?

Open source for teaching/learning purposes

Choose the right one for your needs

Commercial solutions for highly dynamic data centers

Can I do some research in the area? Several open source projects in the software side with pending

topics

Standards to integrate virtualization through manageability


22/35

Gracias!

ThankYou!


23/35

Backup


24/35

Additional information sources:

For specifications and to learn more Intel VT Web Site: http://www.intel.com/technology/platform-technology/virtualization/

Intel Virtualization Software Community: http://www.intel.com/software/virtualization

Online collateral on Intel VT-x/VT-i http://www.intel.com/products/processor/manuals/index.htm?iid=technology_virtualizationengage+body
http://www.intel.com/technology/platform-technology/virtualization/http://www.intel.com/software/virtualizationhttp://www.intel.com/software/virtualizationhttp://www.intel.com/products/processor/manuals/index.htm?iid=technology_virtualizationengage+body_intel64manualhttp://www.intel.com/products/processor/manuals/index.htm?iid=technology_virtualizationengage+body_intel64manualhttp://www.intel.com/software/virtualizationhttp://www.intel.com/software/virtualizationhttp://www.intel.com/software/virtualizationhttp://www.intel.com/technology/platform-technology/virtualization/


25/35

References

http://www.dmtf.org/standards/published_documents/DSP0243_1.0.0.pd

http://www.vmware.com/pdf/vmi_specs.pdf

http://www.vmware.com/interfaces/

http://lists.xensource.com/archives/html/xen-merge/2005-08/msg00076.

http://download.microsoft.com/download/a/f/d/afdfd50d-6eb9-425e-84e1

http://wiki.xensource.com/xenwiki/Open_Topics_For_Discussion?action=

http://wiki.xensource.com/xenwiki/Open_Topics_For_Discussion?action=
http://www.dmtf.org/standards/published_documents/DSP0243_1.0.0.pdfhttp://www.vmware.com/pdf/vmi_specs.pdfhttp://www.vmware.com/interfaces/http://lists.xensource.com/archives/html/xen-merge/2005-08/msg00076.htmlhttp://download.microsoft.com/download/a/f/d/afdfd50d-6eb9-425e-84e1-b4085a80e34e/SYS-T312_WH07.pptxhttp://wiki.xensource.com/xenwiki/Open_Topics_For_Discussion?action=AttachFile&do=get&target=XenLoop_+A+Transparent+High+Performance+Inter-VM+pdfhttp://wiki.xensource.com/xenwiki/Open_Topics_For_Discussion?action=AttachFile&do=get&target=Memory+Overcommit.pdfhttp://wiki.xensource.com/xenwiki/Open_Topics_For_Discussion?action=AttachFile&do=get&target=Memory+Overcommit.pdfhttp://wiki.xensource.com/xenwiki/Open_Topics_For_Discussion?action=AttachFile&do=get&target=XenLoop_+A+Transparent+High+Performance+Inter-VM+pdfhttp://download.microsoft.com/download/a/f/d/afdfd50d-6eb9-425e-84e1-b4085a80e34e/SYS-T312_WH07.pptxhttp://lists.xensource.com/archives/html/xen-merge/2005-08/msg00076.htmlhttp://www.vmware.com/interfaces/http://www.vmware.com/pdf/vmi_specs.pdfhttp://www.dmtf.org/standards/published_documents/DSP0243_1.0.0.pdf


26/35

41% of new server x86purchased in 2007 will bevirtualized- IDC End User Study; Jun-06

Server Virtualization is now considered amainstream technology among ITbuyers.IT professional are bullish in future use:driving 45% server use in 12 months-IDC Directions 2007 Feb-07

>81% of business are using>81% of business are using

virtualizationvirtualization in production environmentsin production environments- 451 Group Special Report Dec-06- 451 Group Special Report Dec-06


27/35

Traditional benchmarking covers Performance, Power, ScalabilityTraditional benchmarking covers Performance, Power, Scalability Metrics: Throughput (MB/s), Response time, #users, etcMetrics: Throughput (MB/s), Response time, #users, etc

Micro-architecture focus: cache sizing, frequency, bandwidth, etc.Micro-architecture focus: cache sizing, frequency, bandwidth, etc.

New technology requires new areas of analysis and metricsNew technology requires new areas of analysis and metrics Areas of focus driven by use models.Areas of focus driven by use models.

E.g., VM migration time, VM utilizationE.g., VM migration time, VM utilization Need to measure how IntelNeed to measure how Intel Virtualization technology benefits end-users and ISVsVirtualization technology benefits end-users and ISVs


28/35

Virtualization presents unique challengesVirtualization presents unique challenges

Which configurations to focus onWhich configurations to focus on

Homogeneous or heterogeneous OSHomogeneous or heterogeneous OS

Number Virtual MachinesNumber Virtual Machines

Configuration of individual VMs (CPU, Memory, NIC, HBA, HDD)Configuration of individual VMs (CPU, Memory, NIC, HBA, HDD)

Measuring performanceMeasuring performance

Virtual clock accuracy induces platform dependent errorVirtual clock accuracy induces platform dependent error

Availability of performance monitoring capabilitiesAvailability of performance monitoring capabilities

Consolidation use case adds additional testing challengesConsolidation use case adds additional testing challenges Synchronicity: Use automation scriptsSynchronicity: Use automation scripts

Utilization: Avoid harmonic bottlenecksUtilization: Avoid harmonic bottlenecks

Steady State: Easy, repeatable measurementsSteady State: Easy, repeatable measurements

Only way to overcome the challenges is to develop the benchmarksOnly way to overcome the challenges is to develop the benchmarks

Tier consolidation using SAP SDTier consolidation using SAP SD

vConsolidate: a server application consolidation benchmarkvConsolidate: a server application consolidation benchmark


29/35

DescriptionDescription Benchmark that represents predominant use case -> serverBenchmark that represents predominant use case -> server

application consolidationapplication consolidation

Application types selected for consolidation guided by marketApplication types selected for consolidation guided by marketdatadata

vConsolidate providesvConsolidate provides A methodology for measuring performance in a consolidatedA methodology for measuring performance in a consolidated

environmentenvironment

A means for fellow travelers to publish virtualization performanceA means for fellow travelers to publish virtualization performance

proof pointsproof points The ability to analyze performance across VMMs and hardwareThe ability to analyze performance across VMMs and hardware

platformsplatforms

Knowledge obtainedKnowledge obtained SPEC virtualization workloadSPEC virtualization workload


30/35

5 Virtual Machines5 Virtual Machines

3 Clients: Controller, Mail, and Web3 Clients: Controller, Mail, and Web


31/35

*Other names and brands may be claimed as the property of others


32/35

Consolidation Stack Unit (CSU)Consolidation Stack Unit (CSU)

Smallest granule in vConSmallest granule in vCon

Consist of 5 Virtual MachinesConsist of 5 Virtual Machines DatabaseDatabase

Commercial MailCommercial Mail

Web ServerWeb Server

Java Application ServerJava Application Server

IdleIdle

Each CSU represents single scoreEach CSU represents single score Final score is aggregate of the individual CSU scoresFinal score is aggregate of the individual CSU scores


33/35


34/35

Running vConsolidateRunning vConsolidate

Controller applicationController application

Starts the tests via helper scripts; Runs for 30 minutesStarts the tests via helper scripts; Runs for 30 minutes

Stops the test and reports scoreStops the test and reports score

Time measured in Controller ClientTime measured in Controller Client external timerexternal timer

ScoringScoring

The Controller applicationThe Controller application

calculates final scorecalculates final score

SpecJBB, Sysbench andSpecJBB, Sysbench andLoadsim - transactions/Loadsim - transactions/secondsecond

WebBench throughputWebBench throughput

CSU Final Score = GEOMEANCSU Final Score = GEOMEAN(VM Relative Perf[i])(VM Relative Perf[i])


35/35

Seeding Industry with Benchmark WorkloadsSeeding Industry with Benchmark Workloads

vConsolidate Consolidated stack of business workloads consisting of Server Side Java, CommercialvConsolidate Consolidated stack of business workloads consisting of Server Side Java, CommercialDatabase, Commercial Mail, Commercial Web Server on 4 VMsDatabase, Commercial Mail, Commercial Web Server on 4 VMs

Collaborating with Virtualization leadersCollaborating with Virtualization leaders

Microsoft and OEMs - consolidation workloads, methodology & metricsMicrosoft and OEMs - consolidation workloads, methodology & metrics

VMware VMmark* consolidation stackVMware VMmark* consolidation stack

Establishing benchmarks with ISV/OSVsEstablishing benchmarks with ISV/OSVs

Contributing to standard benchmarks through SPEC (long term)Contributing to standard benchmarks through SPEC (long term)

*Oth d b d b l i d th t f th

virtualization future

Documents