intel virtualization intel virtualization virtualization andand server ...€¦ · virtualisation...

1* Other names and brands may be claimed as the property of others. Copyright © 2012, Intel Corporation.

Intel Intel Intel Intel Virtualization Virtualization Virtualization Virtualization andandandandServer Technology UpdateServer Technology UpdateServer Technology UpdateServer Technology Update

Petar TorreLead Architect

Service Provider Group

29 March 2012

Legal Disclaimer

• Intel may make changes to specifications and product descriptions at any time, without notice.

• Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. For more information on performance tests and on the performance of Intel products, visit Intel Performance Benchmark Limitations

• Intel does not control or audit the design or implementation of third party benchmarks or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where similar performance benchmarks are reported and confirm whether the referenced benchmarks are accurate and reflect performance of systems available for purchase.

• Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor family, not across different processor families. See www.intel.com/products/processor_number for details.


• Intel, processors, chipsets, and desktop boards may contain design defects or errors known as errata, which may cause the product to deviate from published specifications. Current characterized errata are available on request.

• Intel Virtualization Technology requires a computer system with a processor, chipset, BIOS, virtual machine monitor (VMM) and applications enabled for virtualization technology. Functionality, performance or other virtualization technology benefits will vary depending on hardware and software configurations. Virtualization technology-enabled BIOS and VMM applications are currently in development.

• 64-bit computing on Intel architecture requires a computer system with a processor, chipset, BIOS, operating system, device drivers and applications enabled for Intel® 64 architecture. Performance will vary depending on your hardware and software configurations. Consult with your system vendor for more information.

• Intel, Intel Xeon, Intel Core microarchitecture, and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

AgendaAgendaAgendaAgenda

• Virtualisation– Review

– “Invisible” technology

• Intel® Xeon® processors in Cisco UCS– E5-2600

– E7-2800


– E7-2800

– E7-4800

Virtualization: Evolving Towards the Enterprise Cloud

Enterprise Cloud: Virtualization 3.0

Automation and Resource Scalability

Flexible Resource Management:


Consolidation: Virtualization 1.0Operational Expense Efficiency

Flexible Resource Management: Virtualization 2.0Dynamic Resource Allocation

4

Virtualization Data Center FoundationVirtualization Data Center FoundationVirtualization Data Center FoundationVirtualization Data Center Foundation

Infrastructure Infrastructure ScaleScale

� Massive Scaling

� Balanced Platform

� RAS is critical

Lower TCOLower TCO

�Network

consolidation

MultiMulti--TenancyTenancy

�Resource Sharing

� Security

� Isolation

Dat

a C

ente

r R

equ

irem

ents


Unified NetworkUnified Network(10Gb Ethernet for Storage and Networking)

IntelIntel®® XeonXeon®® Processor Based Platform Processor Based Platform (CPU & I/O performance, New Technologies)

Dat

a C

ente

r R

equ

irem

ents

Dat

a ce

nte

r F

ou

nd

atio

n

A Framework for Optimizing VirtualizationA Framework for Optimizing VirtualizationA Framework for Optimizing VirtualizationA Framework for Optimizing Virtualization

VMM

OS OS OS…

… and scale out across VMs

Reduce overhead within each VM…

Ways to Reduce Overheads• VT-x Latency Reductions• Virtual Processor IDs• Extended Page Tables• APIC Virtualization (Flex Priority)• I/O Assignment via DMA Remapping (VT-d)


Host

• I/O Assignment via DMA Remapping (VT-d)• VMDq• 4GB pages

Technologies for Scaling• Scaling from EP to EX• Hyper Threading• PAUSE-loop Exiting• SR-IOV• RAS Capabilities

Intel working with VMware and other VMM vendors to reduce virtualisation overhead

VT-x = Intel® Virtualization Technology for IA-32, Intel® 64 and Intel® Architecture

Optimizing VT Optimizing VT Optimizing VT Optimizing VT Transition LatenciesTransition LatenciesTransition LatenciesTransition Latencies

• Virtual Machine Control Structure (VMCS)– VMCS holds all essential guest and host register state– “Backed” by host physical memory– Accessed via an architectural VMREAD / VMWRITE interface– Enables CPU implementations to cache VMCS state on-die

• Virtual Processor IDs (VPIDs)– VMM-specified values used to tag microarchitectural structures (TLBs)– Used to avoid TLB flushes on VT transitions


Memory

– Used to avoid TLB flushes on VT transitions

VMM

pCPU

VMREAD VMWRITE

BackingPageinMemory

VMCS

Significant VT latency reductions over time…

0

200

400

600

800

1000

1200

1400

1600

1800

2007 2008 2009 2010

Round-Trip VM exit/entry (Cycles)

Making Resource Sharing SaferMaking Resource Sharing SaferMaking Resource Sharing SaferMaking Resource Sharing Safer

VM VM VM VM

IsolateIntel® Virtualization and Intel® Trusted Execution Technology (Intel® TXT) work together to better isolate VMs

MeasureIntel® TXT measures VMM for launch protection

Encrypt

Virtual Machine Monitor


EncryptIntel® AES New instructions in Intel® Xeon® processor E5 and E7 families quickly encrypts data in flight and at rest

Intel® TXT and AES New instructions in Intel® Xeon® processorsMake Multi-Tenancy More Secure

Intel® Xeon® Processor Families in Cisco UCSIntel® Xeon® Processor Families in Cisco UCSIntel® Xeon® Processor Families in Cisco UCSIntel® Xeon® Processor Families in Cisco UCS

Top Performance / $, Energy Efficiency, &

Flexibility for Infrastructure AppsEEEE5555

FamilyFamilyFamilyFamily

Xeon EXeon E55--26002600


Scalable Performance, Flexibility, & Advanced

RAS for Demanding Apps / / / / Consolidation

E7E7E7E7FamilyFamilyFamilyFamily

Xeon Xeon 7500 7500 &&Xeon Xeon 65006500

7000700070007000SequenceSequenceSequenceSequence

Xeon EXeon E77--4800 4800 & & 28002800

EEEE7777FamilyFamilyFamilyFamily

Typical Workloads

Larg

er

Wo

rklo

ad

s E7 UCS Servers:B440 M2, B230 M2,C460, M2 C260 M2

Workload / Usage

Business Processing (DB, ERP, CRM, batch)*

Decision Support (data warehouse, Business Intelligence)

Large-scale Consolidation (including Virtualization & Multi-tier)

Application Development

High Performance Computing

10

Mid

/S

mall

er

Wo

rklo

ad

s

More/Larger Instances/Users

Fewer/SmallerInstances/Users

2S VolumeServers

B200 M3, C240 M3,C220 M3

Collaboration

Web Infrastructure

IT Infrastructure

Development/Quality Assurance

* For directional guidance only. This is not a server selection guide. Actual server sizing is a relatively complex effort involving workload characterization including such considerations as type of application, size of workload, number of users, type of transaction, SLA response times, targeted utilization, level and estimation accuracy of workload baseline/peak/growth, physical or managerial constraints, need to maintain a single state at all times to ensure all users see the same results at any given time, cost to migrate to a scale-out alternative, and system availability requirements.

* Other names and brands may be claimed as the property of others. Copyright © 2012, Intel Corporation.

Introducing the Intel® Xeon® Processor Introducing the Intel® Xeon® Processor EE5 5 FamilyFamily

Leadership Performance

Breakthrough I/O

Innovation

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.

The Heart of a Flexible, Efficient Data The Heart of a Flexible, Efficient Data Center Built to ScaleCenter Built to Scale

Innovation

Trusted Security

Exceptional Energy

Efficiency

Copyright © 2012, Intel Corporation.

Intel® Xeon® 2S Platform Comparison

E5-2600 Product Family based Platform (B200 M3)

SandyBridge

8Core

SandyBridge

8 Core

DDR3

DDR3

DDR3

DDR3

DDR3

DDR3

DDR3

DDR3

x8x4

QPI

QPI

Xeon® 5500 / 5600based Platform (B200 M2)

Xeon® 5500Xeon® 5600

Core

Xeon® 5500Xeon® 5600

Core

DDR3

DDR3

DDR3

DDR3

DDR3

DDR3

QPI

up toDDR3 1333

up to6.4 GT/s

QPI

QPI

up toDDR3 1600 up to

8.0 GT/s

� Up to 8 Cores

� Up to 24 DIMMs @1666 Mhz

� Up to 80 PCIe lanes

� Two QPI links @ 8.0GT/s between CPUs

� One-chip Platform Controller Hub (PCH)

� Integrated PCI-E Gen 3

x8x4

x4 Intel C600Series(PCH)

Serial Attached SCSI (SAS) 4 ports, 3Gb/s

Intel 5500Series(IOH)

IntelICH 10

QPI

QPI

up to36 lanesPCIe2

up to 40 lanesPCIe3 per socket

� Up to 18 DIMMs per 2S platform

� Up to 36 PCIe2 lanes

� Two-chip IOH / ICH


RomleyRomleyRomleyRomley Memory New FeaturesMemory New FeaturesMemory New FeaturesMemory New Features

• Higher speed memory: 1600 MHz DDR 3– Intel® Xeon® processor E5-2600/4600 product families (EP) 1600MHz

Support:� SR/DR RDIMM 3SPC/2DPC or 1DPC

� Max 16GB DIMMs� total RAM 256GB @ 1600 MHz

• LR-DIMMs


• LR-DIMMs– Load Reduced DIMMs

– 3 x 32GB DIMMs per channel supported

– total RAM 768GB @ 1066 MHz

DIMM TypesDIMM TypesDIMM TypesDIMM Types

• UDIMM– Address, Control & Data signals are “unbuffered”

• RDIMM– Address & Control signals are “buffered” in a

register

• LR-DIMM– Address, Control and Data signals are all “buffered”

UDIMM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

Data Bus

Address& Control

14* Other names and brands may be claimed as the property of others. Copyright © 2012, Intel Corporation.14

LR-DIMMD

RA

M

Reg

iste

r +

Ran

kM

ult. L

og

ic

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

Data Bus

Address& Control

Data Buffers

DR

AM

Reg

iste

r

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

DR

AM

Data Bus

Address& Control

RDIMM

What is an LRWhat is an LRWhat is an LRWhat is an LR----DIMM?DIMM?DIMM?DIMM?

• LR-DIMM = Load Reduced DIMM

• An LR-DIMM has additional components on the DIMM which:a) Buffer the data bus pins

– To reduce electrical loading on the data bus

b) Rank multiplication logic to make to logically reduce the number of ranks visible to the memory controller


visible to the memory controller– Even though there is likely four ranks physically on the DIMM

– Depending on the DIMM, rank multiplication can be disabled, set to 2:1 or set to 4:1 (4:1 makes a Quad ranked DIMM logically look like a single rank DIMM)

• More info about LR-DIMMs available here:– http://www.edn.com/article/519386-Basics_of_LRDIMM.php

15

Trusted SecurityTrusted Security

IntelIntel®® Trusted Execution TechnologyTrusted Execution Technology

Average organizational costs of a data breach over Average organizational costs of a data breach over $$77M per incidentM per incident22

IntelIntel®® Advanced Encryption Standard Advanced Encryption Standard New InstructionsNew Instructions

Use of AES encryptionUse of AES encryption11 has nearly tripled in has nearly tripled in the last 10 quartersthe last 10 quarters

1 AES Instructions refers to AES128-SHA1. Source: Akamai Second Quarter 2011 ‘State of the Internet' Report. See details and report at: http://www.akamai.com/html/about/press/releases/2011/press_102411.html2 Source: Ponemon Institute - 2010 Annual Study: Cost of a Data Breach . March 2011


Xeon® Processor Energy Efficiency Xeon® Processor Energy Efficiency ~50%

1

higher Performance At Same Power

~50%1

higher Performance At Same Power

Per

form

ance

and

Sys

tem

Pow

er

Peak power under loadPerformance

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.1 Performance comparison using SPEC_Power results published as of March 6th, 2012. See back up for configuration details. For more information go to intel.com/performance

Rel

ativ

e P

erfo

rman

ce a

nd S

yste

m

X5675 E5-2660

Best Data Center Performance per WattBest Data Center Performance per Watt11


7.59

10.88

6

8

10

12

Sco

re @

Nu

mb

er o

f Tiles)

VMmark* v2.1 Performance

Intel® Xeon® Processor E5-2600 Product FamilyVirtualized Consolidation 2.0 Performance on VMmark* 2

Higher is better

No P

ublication A

vailable

1.43X

• Flexible datacenter, multi-host benchmark models application throughput with minimum QoSrequirements and virtual infrastructure operations• Measures consolidated application throughput and operations completed

@10 Tiles

@7 Tiles

0

2

4

Opteron*

6282 SE(2.6GHz, 16C, 140W)

X5690

(3.46GHz, 6C, 130W)

E5-2690

(2.9GHz, 8C, 135W)

Perfo

rm

an

ce (S

co

re @

Nu

mb

er o

f Tiles)

Grow your consolidation capabilities with the Intel® Xeon® processor E5-2600 product family

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those

factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.

Source: Best available publications/submissions as of 6 March 2012

Configuration Details: Please reference slide speaker notes and back up slides

For more information go to http://www.intel.com/performance18

No P

ublication A

vailable

completed

Best

Published

* Other names and brands may be claimed as the property of others

Best

Published


Intel® Xeon® Processor EIntel® Xeon® Processor EIntel® Xeon® Processor EIntel® Xeon® Processor E5555----2600 2600 2600 2600 Product FamilyProduct FamilyProduct FamilyProduct Family


Source: Public white paper published at: http://www.principledtechnologies.com/clients/reports/Intel/Xeon_E5-2690_consolidation_0312.pdf

For more information go to http://www.intel.com/performance


The Intel® Xeon® Processor EThe Intel® Xeon® Processor E5 5 FamilyFamily

Leadership Performance: Leadership Performance: Leadership Performance: Leadership Performance: 15 New x86 World Records

Breakthrough I/O Innovation:Breakthrough I/O Innovation:Breakthrough I/O Innovation:Breakthrough I/O Innovation: Up to 3X I/O Performance

Trusted Security: Trusted Security: Trusted Security: Trusted Security: Trusted Hardware Security

Learn More at: www.intel.com/datacenter

Exceptional Energy EfficiencyExceptional Energy EfficiencyExceptional Energy EfficiencyExceptional Energy Efficiency: Best performance per watt

Cisco Servers: B200 M3, C220 M3 and C240 M3


The Heart of a Flexible, Efficient Data The Heart of a Flexible, Efficient Data Center Center that’s that’s Built to ScaleBuilt to Scale



INTELINTELINTELINTEL ®®®® XEONXEONXEONXEON ®®®® PROCESSOR EPROCESSOR EPROCESSOR EPROCESSOR E7 7 7 7 FAMILYFAMILYFAMILYFAMILYWestmere-EX

Intel® Xeon® Processor E7 platform (Westmere-EX)

More Efficient

• Supports 32GB DDR3 DIMMs (2TB per 4-socket system)1

More Expandable

More Security & RAS

• 10 cores / 20 threads

• 30MB of last level cache

More Performance

WSMWSMWSMWSM----EXEXEXEX WSMWSMWSMWSM----EXEXEXEX

SECURITY

• Intel® Advanced Encryption


Delivers more Performance, Expandability and RASwhile improving Energy Efficiency

• More performance within same max CPU TDP as Xeon 7500

• Lower partial active & idle power via Intel Intelligent Power Technology2

• Support for Low Voltage-DIMMs3

• Reduced power memory buffers4

WSMWSMWSMWSM----EXEXEXEX WSMWSMWSMWSM----EXEXEXEX

• Intel Advanced Encryption Standard-New Instructions

• Intel® Trusted Execution Technology (TXT)

RELIABILITY, AVAILABILITY, SERVICEABILITY

• Double Device Data Correction (DDDC)

• Partial Memory Mirroring

1. Up to 64 slots per standard 4 socket system x 32GB/DIMM = 2TB2. Uses similar core and package C6 power states enabled on Intel Xeon 5500/5600 series processors. Requires OS support.3. Savings dependent on workload and configuration. Example: At 100% SPECpower load it can save ~0.8W for 4GB DIMM DRx8 based on early Intel internal

estimates4. Memory buffer power savings of up to 1.3W active and 3W idle per buffer based on internal Intel estimates. Slightly more savings when used with LV DIMMs

2-Socket Platform ComparisonEfficient Performance Class Expandable Class

IO HUBIO HUBIO HUBIO HUBIO HUBIO HUBIO HUBIO HUB

E7E7E7E7----2800280028002800 E7E7E7E7----2800280028002800

Xeon® E7-2800Xeon®

E5-2600

Frequency Sensitive Thread SensitivePerformance

B200M3C220M3C240M3

B230M2C260M2

E5-2600

8Core

E5-2600

8 Core

DDR3DDR3

DDR3DDR3

DDR3

DDR3DDR3

DDR3DDR3

DDR3DDR3DDR3DDR3

DDR3DDR3QPI

QPI

23

Frequency Sensitive Thread SensitivePerformance

Power EfficiencyLow High

Low HighMemory Capacity

Good BestReliability

Virtualization driving need for compute, memory & reliability


Xeon® E7 Family: Meeting the Highest Virtualization Needs

Infrastructure Consolidation (of multi-tier Applications)

Large Scale, Mission Critical

Virtualization(>8GB)

Xeon® E7• 10C/20 threads per

socket• 2-256 socket scaling• 512GB memory per skt• 2X I/O capacity• Mission Critical RAS

Intel Platform Virtualization Technologies


Headroom for Peak

& Unpredictable

Demand

Live Migrationof Big

Workloads

Intel® VT Flex Migration

Processor Chipset Network

Intel® VT For Directed I/O

Intel® VT-x Intel® VT For Connectivity

Intel Platform Virtualization Technologies

Optimized for the most demanding virtualization workloads

Machine Check Architecture RecoveryMachine Check Architecture RecoveryMachine Check Architecture RecoveryMachine Check Architecture RecoveryPreviously seen only in RISC, mainframe, and ItaniumPreviously seen only in RISC, mainframe, and ItaniumPreviously seen only in RISC, mainframe, and ItaniumPreviously seen only in RISC, mainframe, and Itanium----based systemsbased systemsbased systemsbased systems

Normal StatusWith Error Prevention

System Recovery with OS

System works in conjunction with OS or

VMM to recover or restart processes and

continue normal operation

Error information

MCA Recovery


HW Un-correctable Errors

Error Corrected

Error Detected*

Error Contained

HW Correctable ErrorsUn-correctable Errors

Bad memory location flagged so data will not

be used by OS or applications

Error information passed to OS /

VMM

*Errors detected using Patrol Scrub or Explicit Write-back from cache

Allows Recovery From Otherwise Fatal System Errors

MCAMCAMCAMCA----R Fault Isolation with R Fault Isolation with R Fault Isolation with R Fault Isolation with vSpherevSpherevSpherevSphere 5555....0 0 0 0 Only Supported on Intel® Xeon® processor EOnly Supported on Intel® Xeon® processor EOnly Supported on Intel® Xeon® processor EOnly Supported on Intel® Xeon® processor E7 7 7 7 family & VMware family & VMware family & VMware family & VMware vSpherevSpherevSpherevSphere 5555....0000

ESXi 5.0

VM

ESXi 5.0

VM VM VM VM

VM VM VM VM VM

VM VM VM VM VM

VM VM VM VM VMVM

ESXi 5.0


STATUS: GOOD

MCA-Recovery Provides Isolation From Otherwise Fatal System Errors

ESXi 5.0

STATUS: GOOD

Non MCA SystemCisco C460 M2

C260 M2B230 M2B430 M2

CORRECTABLE MEMORY ERRORCORRECTABLE MEMORY ERROR ERROR LOGGED FOR PFAERROR LOGGED FOR PFA STATUS: GOODSTATUS: GOOD UNCORRECTABLE MEMORY ERRORUNCORRECTABLE MEMORY ERROR REPORT TO ESXiREPORT TO ESXi ISOLATE ERRORPURPLE SCREEN OF DEATH RESTART FAILED VM IN POOLREBOOT SERVER MARK MEMORY LOCATION BADVM GETS RESTARTED

ESXi 5.0

IntelIntelIntelIntel®®®® XeonXeonXeonXeon ®®®® Processor E7 Family and Vmware* Processor E7 Family and Vmware* Processor E7 Family and Vmware* Processor E7 Family and Vmware* vSphere* 5.0vSphere* 5.0vSphere* 5.0vSphere* 5.0• Vmware* vSphere* 5.0 scales to exploit the Intel® Xeon®

processor E7 platform capabilities:• 80-cores (160 threads) physical servers

• 2 TB physical RAM

• 32-vCPU VMs w/ 1TB virtual RAM

• 512 VMs, up to 2048 vCPUs per physical host

• VM consolidation on this scale requires hypervisor focus on:


• VM consolidation on this scale requires hypervisor focus on:• Scalability, Energy Efficiency, & Uptime (Reliability)

• Especially Memory ReliabilityEspecially Memory ReliabilityEspecially Memory ReliabilityEspecially Memory Reliability

• New New New New VmwareVmwareVmwareVmware* * * * vSpherevSpherevSpherevSphere* 5.0 memory reliability features * 5.0 memory reliability features * 5.0 memory reliability features * 5.0 memory reliability features require Intel® Xeon® processor E7 familyrequire Intel® Xeon® processor E7 familyrequire Intel® Xeon® processor E7 familyrequire Intel® Xeon® processor E7 family

The Intel® Xeon® Processor The Intel® Xeon® Processor E5 & E7 FamiliesE5 & E7 FamiliesFor Cisco UCS ServersFor Cisco UCS Servers

Leadership Performance:Leadership Performance:Leadership Performance:Leadership Performance:

Breakthrough I/O Innovation:Breakthrough I/O Innovation:Breakthrough I/O Innovation:Breakthrough I/O Innovation: with E5

Trusted Security: Trusted Security: Trusted Security: Trusted Security: Trusted Hardware Security E5 & E7

Learn More at: www.intel.com/datacenter

E5 Exceptional Energy EfficiencyE5 Exceptional Energy EfficiencyE5 Exceptional Energy EfficiencyE5 Exceptional Energy Efficiency: Best performance /watt

E7 Best RAS with MCA


The Heart of a Flexible, Efficient Data The Heart of a Flexible, Efficient Data Center Center that’s that’s Built to ScaleBuilt to Scale


2929* Other names and brands may be claimed as the property of others.* Other names and brands may be claimed as the property of others. Copyright © Copyright © 20122012, , Intel Corporation.Intel Corporation.

Thank Thank Thank Thank Thank Thank Thank Thank You for Your AttentionYou for Your AttentionYou for Your AttentionYou for Your AttentionYou for Your AttentionYou for Your AttentionYou for Your AttentionYou for Your Attention

intel virtualization intel virtualization virtualization andand server ...€¦ · virtualisation...

Documents