vmworld 2013: view planner 3.0 as a vdi benchmark
DESCRIPTION
VMworld 2013 Banit Agrawal, VMware Rishi Bidarkar, VMware Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshareTRANSCRIPT
![Page 1: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/1.jpg)
View Planner 3.0 as a VDI Benchmark
Banit Agrawal, VMware
Rishi Bidarkar, VMware
TEX5760
![Page 2: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/2.jpg)
2 Confidential
This is an NDA deck – do not share this information.
This presentation may contain product features that are currently
under development.
This overview of new technology represents no commitment from
VMware to deliver these features in any generally available
product.
Features are subject to change, and must not be included in
contracts, purchase orders, or sales agreements of any kind.
Technical feasibility and market demand will affect final delivery.
Pricing and packaging for any new technologies or features
discussed or presented have not been determined.
Disclaimer for NDA Roadmaps
![Page 3: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/3.jpg)
3
This presentation may contain product features that are currently
under development.
This overview of new technology represents no commitment from
VMware to deliver these features in any generally available
product.
Features are subject to change, and must not be included in
contracts, purchase orders, or sales agreements of any kind.
Technical feasibility and market demand will affect final delivery.
Pricing and packaging for any new technologies or features
discussed or presented have not been determined.
Disclaimer
![Page 4: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/4.jpg)
4 4
Agenda
Overview
View Planner details
View Planner Usage and Demo
Results and data(Case Studies)
Conclusions
![Page 5: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/5.jpg)
5 5
Benchmarking – Why we care ?
![Page 6: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/6.jpg)
6 6
Understanding VDI performance scope – its complex
Hypervisor Performance
Storage Infrastructure
Performance
vCenter Performance
Client Performance
VMware View
Performance
![Page 7: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/7.jpg)
7 7
VDI scope – Metric explosion
Which metric to focus on?
• IOPS
• Read/Write Latency
• Bandwidth
• CPU usage
• % Ready time
• Host CPU
• Memory usage
End User Experience is critical to measure
![Page 8: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/8.jpg)
8 8
Paradox of choice
What methodology?
What tools to use?
• IO meter
• Netperf
• Esxtop
Which user profile ?
• Task worker
• Knowledge worker
• Power worker
Capacity planning?
Drive consistency and predictability
around VMware VDI solutions
![Page 9: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/9.jpg)
9 9
VDI benchmark – Why Now?
More interest in benchmarking VDI solutions
Confusing published results
Often incorrect and
misinterpreted methodologies
Need a standard structure
and methodology
View Planner 3.0 as a benchmark provides a standard
methodology to evaluate and design effective VDI
architectures
V
D
I
![Page 10: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/10.jpg)
10 10
View Planner benchmark goals
View Planner is geared to
• Measure virtual desktop scalability
• Used by OEM hardware and virtualized software vendors
• Allow customers and VAR’s to compare platforms and validate VDI
environments
• Help with multiple use case studies
View Planner as a benchmark is not a
• Capacity planner
• Competitive tool for VMware Horizon View
![Page 11: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/11.jpg)
11 11
View Planner 3.0 ideas
Design goal View Planner
Scalable Built on top of tried, tested and scalable
View Planner workload
Representative
Support for common desktop user
applications
Client side timing and execution
Measure end user experience
Patented watermarking measurement
technique is agnostic of underlying
hardware, software and display protocol
Provide easy to understand
methodology
View Planner QoS methodology clearly
defines metrics for scalability while
keeping end user experience paramount
Repeatability Methodology has low run to run
variance
Ease of use and reporting Automated and central virtual appliance
for ease of configuration, provisioning,
managing and reporting
![Page 12: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/12.jpg)
12 12
Agenda
Overview
View Planner details
View Planner Usage and Demo
Results and data(Case Studies)
Conclusions and future work
![Page 13: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/13.jpg)
13 13
Methodology
User/VM Consolidation with QoS in mind
Each user drives an automated representative VDI workload on
the desktop
After each steady-state run evaluate combined QoS
Consolidate more users/VMs till QoS fails
#VDIMark score is based on how many users can be consolidated
on the system under test with passing QoS
![Page 14: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/14.jpg)
14 14
View Planner – Architecture
Storage
Manage
Physical Servers
vCenter /
View
Virtual Desktops Virtual Client VMs
Remote Display
Protocol
Storage
Physical Servers
Harness
Web Interface
View
Planner
Appliance
Central web management
provides better control and flexibility
![Page 15: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/15.jpg)
15 15
View Planner benchmark specifications
Applications and versions
• Office 2010
• Windows media player
• 720-p HD video
• Browsing applications
• IE 9 and Firefox
• Archiving with 7 zip
• Adobe Acrobat reader
1920 x 1200 desktop resolution
Workload iterations per user
Thinktime
Guest OS versions and virtual H/W
allocations
vSphere and View versions
Ramp up time
![Page 16: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/16.jpg)
16 16
Scoring steady state iterations
Ramp down Steady state Ramp up
![Page 17: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/17.jpg)
17 17
Scoring
VDIMark Qos Metric
• Easy-to-understand high precision operational latency metric
• Groups based on characteristics
• Group A- Interactive operations( Browse pages, modify, sort etc..)
• Group B- IO operations (Open file, save work etc..)
• Group C background load operations
• Evaluation based on reference set of thresholds for each group
• Score for the run is determined when both the following conditions are matched
• 95th % of all the Group A operations < 1 second threshold
• 95th % of all the Group B operations < 6 seconds threshold
![Page 18: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/18.jpg)
18 18
Reporting
The main goal is to be transparent and provide as much information
to the consumers of this data as possible
Scores and reports
Hardware setup details
Software details with versions
Configuration settings
• Guest
• Applications
• Virtualization or H/W layer
Any other non-standard settings or modifications
![Page 19: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/19.jpg)
19 19
View Planner Results
Sample Result
Submitter
Server
Storage
Description
Virtualization
Description
View
Planner
Score
Date Description Host,socket,core, Thread
Partner-x Server -XYZ S1, 4, 24 FC SAN VMW rocks!! 100
VDIMark
10/1/13
![Page 20: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/20.jpg)
20 20
Agenda
Overview
View Planner details
View Planner Usage and Demo
Results and data(Case Studies)
Conclusions
![Page 21: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/21.jpg)
21 21
View Planner Run Modes
Remote mode
• One client connects to one desktop. Compliant with benchmark mode
Local mode
• No clients required -> Less hardware. Not compliant with benchmark
mode
Passive mode
• Less clients required -> little less hardware. Not compliant with
benchmark mode
![Page 22: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/22.jpg)
22 22
22
View Planner 3.0 – Benchmark Flow chart
Desktop
Client
View setup
Scale runs
VDImark
score
![Page 23: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/23.jpg)
23 23
23
View Planner – Run Flow chart
![Page 24: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/24.jpg)
24 24
24
View Planner Demo
View Planner 3.0 Demo
![Page 25: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/25.jpg)
25 25
Agenda
Overview
View Planner details
View Planner Usage and Demo
Results and data (Case Studies)
Conclusions and future work
![Page 26: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/26.jpg)
26 26
View Planner Use Cases
Platform characterization
• CPU Architecture Comparison
• CPU Scaling
• Storage characterization
Features Evaluation
User Density for special custom applications
Comparative study for different hardware/software stack
configurations
![Page 27: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/27.jpg)
27 27
Experimental Setup: CPU architecture comparison
Desktop VMs
VMware vSphere
5.1
32-bit Win7 1-vCPU
1GB RAM
CPU Architecture 1: CPU Architecture 2 :
Intel Nehalem Intel Sandy Bridge
Xeon E5540 Xeon E5-2660
2.53 GHz 2.2 GHz (~10% lower)
8 physical cores with
HT enabled
16 physical cores with
HT enabled
Standard View Planner benchmark
configuration
![Page 28: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/28.jpg)
28 28
CPU Comparison
• As expected, Intel Sandy bridge performs better both in group-A and group-B
while frequency is 10% lower
![Page 29: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/29.jpg)
29 29
Experimental Setup: CPU Scaling (Increasing VMs/core)
Desktop VMs Client VMs or Users
Dell PowerEdge R720xd with
8-core Intel Xeon E5-2643 @
3.3 GHz with 256 GB RAM
with local SSD disks
VMware vSphere
5.1
32-bit Win7 1-vCPU
1GB RAM
32-bit WinXP SP3 1-vCPU
768 MB RAM
Dell PowerEdge R710 with 2-
socket 12 cores Intel Xeon
E5645 2.4 GHz with 256 GB
RAM with local SSD disks
VMware vSphere
5.1
PCoIP
![Page 30: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/30.jpg)
30 30
CPU Scaling (Increasing VMs/core)
• QoS failing around 56 VDImark (7 VMs/core) just marginally for group-A
operations
![Page 31: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/31.jpg)
31 31
Experimental Setup: Storage Scaling
![Page 32: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/32.jpg)
32 32
Scaling View Planner VDImark
• VDImark scales nicely with the all-flash storage array from Violin as we double
the number of desktops
![Page 33: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/33.jpg)
33 33
Group A Operations Response Times
• Group-A operations response times almost remains constant
![Page 34: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/34.jpg)
34 34
Group B Operations Response Times
• Group-B operations response times almost remains constant as we scale from
285 VDImark to 560 VDImark
![Page 35: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/35.jpg)
35 35
Total IOPS seen by the storage array
• The first iteration IOPS requirements is high, then it remains steady in the steady
state iterations
![Page 36: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/36.jpg)
36 36
Conclusions
View Planner 3.0 benchmark enables many use cases
• Platform Characterization
• CPU & Storage Scaling
• Architecture Comparison
• Configurations Comparison
View Planner provides a standard methodology to evaluate and
design effective VDI architectures
VMware maintains published View Planner results on its web site.
The benchmark is freely available and can be downloaded at:
http://www.vmware.com/products/desktop_virtualization/view-planner/overview.html
For support, see the community and email to mailing list:
![Page 37: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/37.jpg)
37 37
TAP Membership Renewal – Great Benefits
• TAP Access membership includes:
New TAP Access NFR Bundle
• Access to NDA Roadmap sessions at VMworld, PEX and Onsite/Online
• VMware Solution Exchange (VSX) and Partner Locator listings
• VMware Ready logo (ISVs)
• Partner University and other resources in Partner Central
• TAP Elite includes all of the above plus:
• 5X the number of licenses in the NFR Bundle
• Unlimited product technical support
• 5 instances of SDK Support
• Services Software Solutions Bundle
• Annual Fees
• TAP Access - $750
• TAP Elite - $7,500
• Send email to [email protected]
![Page 38: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/38.jpg)
38 38
TAP Resources
TAP
• TAP support: 1-866-524-4966
• Email: [email protected]
• Partner Central: http://www.vmware.com/partners/partners.html
TAP Team
• Kristen Edwards – Sr. Alliance Program Manager
• Sheela Toor – Marketing Communication Manager
• Michael Thompson – Alliance Web Application Manager
• Audra Bowcutt –
• Ted Dunn –
• Dalene Bishop – Partner Enablement Manager, TAP
VMware Solution Exchange
• Marketplace support –
• Partner Marketplace @ VMware
booth pod TAP1
![Page 39: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/39.jpg)
THANK YOU
![Page 40: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/40.jpg)
![Page 41: VMworld 2013: View Planner 3.0 as a VDI Benchmark](https://reader034.vdocuments.site/reader034/viewer/2022051514/549bff34b479599b318b4600/html5/thumbnails/41.jpg)
View Planner 3.0 as a VDI Benchmark
Banit Agrawal, VMware
Rishi Bidarkar, VMware
TEX5760