from the fire hose series: benchmarking and scalability in the...

43
From the Fire Hose Series: Benchmarking and Scalability in the Virtual Workspace Ruben Spruijt CTO @ Atlantis Computing @rspruijt | [email protected] Benny Tritsch Founder & Principal Consultant @ DrTritsch.com @drtritsch | [email protected]

Upload: others

Post on 17-Apr-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

From the Fire Hose Series:

Benchmarking and Scalability in

the Virtual Workspace

Ruben Spruijt

CTO @ Atlantis Computing

@rspruijt | [email protected]

Benny Tritsch

Founder & Principal Consultant @ DrTritsch.com

@drtritsch | [email protected]

Page 2: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Ruben Spruijt

CTO @ Atlantis Computing

@rspruijt

Hello!

Dr. Benny Tritsch

Founder & Consultant @ DrTritsch.com

@drtritsch

Page 3: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 4: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 5: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 6: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Session Objectives and Takeaways

Business benefits of the Virtual Workspace

Understand challenges of virtual desktop or workstation solutions

Managing costs, complexity and (remote) user experience

User experience is king: benchmarking and scalability

Page 7: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 8: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Virtual Workspace Benefits:

Access from anywhere - ‘work isn’t a place’

Data is centralized - no synchronization of large datasets

High performance – leverage GPU, Flash, 10GbE

Security and control - protect intellectual property

Flexible - support BYO and COPE scenarios

Disaster recovery – multi-site and multi-datacenter

Reduce costs – centralized management

Ergonomics – no heat and low noise under the desk

Page 9: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Construction / Engineering

High Performance Computing (HPC)Medical

Oil and Gas Film and Media

Automotive

Energy

Hi-Tech ElectronicsAerospace

Page 10: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

.

“The modern virtual workspace is the engine of

the digital workplace for today’s workforce!”

Ruben Spruijt – CTO - Atlantis Computing

Page 11: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 12: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Virtual Desktop Virtual Workstation

Power Users and Designers

2D/3D graphics, CAD/PLM/BIM

High-end compute resources

4-64+ GB RAM | Xeon MP

Multiple SSD, PCIe Flash 512GB+

NVIDIA Quadro K2000-M6000

1500-10K$+ Workstation range

Task and Knowledge Workers

Office, CRM, ERP, Unified Comm.

Basic compute resources

1-4GB RAM | 256GB-512GB SSD

Core i5/Core i7

Geforce GT(X)– Quadro 420/620/K1200

700$-1500$ Desktop range

Page 13: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 14: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Enterprise Computer User Categories

Designers

Power Users

Knowledge Workers

Task Workers

25M

200M

400M

Virtual

Workstation

Virtual

Desktop/Apps

Page 15: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 16: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

GPU-Accelerated Desktop Remoting

Page 17: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Virtual DesktopsBare Metal

Windows OS Hypervisor Hypervisor Hyper visor

VM VM VM VM VM VM VM VM VM

Hyper visor

VM VM VM

Direct MapSoftware

GraphicsShared GPU GPU Pass-thru

GPU

Virtualization

GPU graphics driver VDI vendor’s shared graphics framework GPU virtualization component

GPU GPU GPU GPUGPU

GPU GPUs

User Session

CPU

(Emulating GPU)

Page 18: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Enterprise Computer User Categories

Dedicated GPU

(GPU Pass-thru)

Shared GPU

API Intercept

Software

Rendered

Graphics

Designers

Power Users

Knowledge Workers

Task Workers

25M

200M

400M

Page 19: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

.

“Modern applications and browsers benefit from

a GPU which massively improves User

Experience. In the near future ‘GPU inside’ will

be the standard for every virtual desktop and

workstation solution.”

Dr. Benny Tritsch – Consultant, speaker, author, geek

Page 20: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Session Objectives and Takeaways

Business benefits of the Virtual Workspace

Understand challenges of virtual desktop or workstation solutions

Managing costs, complexity and (remote) user experience

User experience is king: benchmarking and scalability

Page 21: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

.

“The biggest competition isn't Citrix vs VMware,

or AMD vs NVIDIA … it's the physical PC.

The goal is to make the Virtual Workspace

better, cheaper and faster than a PC.”

Ruben Spruijt – CTO - Atlantis Computing

Page 22: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Virtual Workspace - Historic Challenges

Page 23: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Physical Hardware(Compute, BIOS, GPUs)

Virtualization Platform+ GPU Assignment

Network(DNS, AD)

Operating System (Master VMs)

Client Devices

Session Broker

Management UIsPortal Interface /

Secure Access

StorageVDI Infrastructure /Remoting Protocol

ApplicationsWorkspace Management

(Profiles, Policies, Monitoring)

User Management /Role Assignment

Page 24: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Session Objectives and Takeaways

Business benefits of the Virtual Workspace

Understand challenges of virtual desktop or workstation solutions

Managing costs, complexity and (remote) user experience

User experience is king: benchmarking and scalability

Page 25: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 26: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Redefining Virtual Workspace Infrastructure

NETWORK

STORAGE

COMPUTE

Page 27: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

COMPLEXITY

“Too complex to

design, build,

maintain”

COST

“It’s not cost

effective -

CAPEX and OPEX”

PERFORMANCE

“User Experience

and Admin

Experience is bad”

Virtual Workspace Challenges

Page 28: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

VDI 3.0√ User Experience - Graphics

√ Storage – Performance

√ Licensing - #FixVDA

√ Complexity – Hyper Converged

√ Cost - 128$/VM*

*) Atlantis RA: http://www2.atlantiscomputing.com/WC_RA_HyperScale-VDI-XenDesktop.html | VDI VM: 2vCPUs, 2GB RAM, 40GB

Page 29: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

2020 = VDI 4.0√ Graphics – APU, GPUs commonly available

√ Broker = on-premises | Cloud

√ Infrastructure = on-premises | Hybrid | Cloud

√ Licensing #FixSPLA

√ Cost - 100$/VM

Page 30: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

.

“User Experience is KING.

GPU capabilities and blazing fast solid state

storage is the standard for a

modern virtual workspace!”

Ruben Spruijt – CTO - Atlantis Computing

Page 31: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Session Objectives and Takeaways

Business benefits of the Virtual Workspace

Understand challenges of virtual desktop or workstation solutions

Managing costs, complexity and (remote) user experience

User experience is king: benchmarking and scalability

Page 33: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Relevant Network Factors

Bandwidth Latency Packet Loss

Speedof light

Data transfer rate of a

network connection

Delay; amount of time

to traverse a system

Discarding of data

packets (in percent)

Remoting Protocol (RDP/RemoteFX, ICA/HDX, PCoIP, Blast, …)

NOTE: GPUs cannot compensate bottlenecks caused by network bandwidth, latency and packet loss

Page 34: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Performance – used to evaluate an environment's individual areas in terms of speed

Load – subjects the environment to the kind of access and usage rate expected in routine operation

Stress – simulated, mostly benign attacks that generate excessive loads in an environment

Endurance – subjects an environment to a predefined load for some considerable time

Scalability – describes system behavior in relation to access times when the number of users is increased

VDI and Remoting Evaluation Criteria

Page 35: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

“We want to know what the actual User

Experience is, not for designers alone but also

for power users and knowledge workers.”

TeamRGE

Page 36: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

User Experience – Relevant Factors

Selected host telemetry data points

Remoting protocol features

Remote session performance counters

Client capabilities and media redirection

Network settings

Compression algorithms and media synchronization mechanisms

End-to-end frame rates

User interface response times

Page 37: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

.

“Benchmarking never represents the real world –

it only reflects selected aspects.

And frames per second are not the most

relevant quality criteria in remoting scenarios.”

Dr. Benny Tritsch – Consultant, speaker, author, geek

Page 38: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Client Host

Test Controller

RemoteUX Tracker

VDI Test Lab Overview

Network Guest

ControlObserve

Archive

WAN Emulator

GPU

Page 39: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

NVIDIA Hardware OverviewTesla

M60

Tesla

M6

GRID K1 GRID K2 Quadro M6000

GPU Maxwell Maxwell Kepler Kepler Maxwell

# GPU 2 1 4 2 1

GPU Type GM204 GM204 GK107 GK104 GM200

Clock speed 1126 MHz 1126 MHz 850 MHz 745 MHz 988 MHz

CUDA cores – shading units

4096

(2048/GPU)

1536 768

(192/GPU)

3072

(1536/GPU)

3072

GFLOPS 4612 4612 3090 3090 6070

Memory size 16GB GDDR5 8GB GDDR5 16GB DDR3 8GB GDDR5 12GB GDDR5

Memory bus 256 bits/GPU 256 bits/GPU 128 bits/GPU 256 bits/GPU 384 bits

H.264 1080p30 streams

36 18 8 12

Grid vGPU CCU 2/4/8/16/32 1/2/4/8/16 16 32 N/A

Form Factor PCIe 3.0 Dual

Slot (rack servers)

MXM (blade

servers)

PCIe 3.0 Dual

Slot (rack servers)

PCIe 3.0 Dual

Slot (rack servers)

PCIe 3.0 Dual

Slot (rack servers)

Max. Power 300W 100W 130W 225W

Cooling Active/ passive Bare board Active/ passive Active/ passive Active

Page 40: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

User Experience is King – Test Results

TeamRGE reference hardware with VMware vSphere 6, NVIDIA K2 and M60, Citrix XenDesktop and Windows 8.1

Showcase: Performance impact of GRID v1 versus GRID v2

Showcase: Different WAN scenarios and impact on User Experience

Special thanks goes to Jason Southern from NVIDIA for all the troubleshooting when setting up the test environment

Page 41: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking
Page 42: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

.

“Given the improvements that a GPU provides to

a Virtual Desktop and Workstation it’s not a

question of whether or not you’ll use GPUs but

when you’ll use them.”

Shawn Bass – CTO EUC - VMware

Page 43: From the Fire Hose Series: Benchmarking and Scalability in the …on-demand.gputechconf.com/gtc/2016/presentation/s6218... · 2016-04-13 · From the Fire Hose Series: Benchmarking

Thanks!Ruben Spruijt

CTO @ Atlantis Computing

@rspruijt

Dr. Benny Tritsch

Founder & Consultant @ DrTritsch.com

@drtritsch