cisco at v mworld 2015 gpu-solution-c240_m4-082715-vmworld

VMWorld :31st Aug - 3rd Sep, 2015

Desktop Virtualization Performance Solutions Team Computing Systems Product Group, Data Center Solutions, Cisco System Inc., San Jose.

Cisco UCS GPU Solution NVidia Grid Cards and VMware Horizon with View

2 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential

Agenda

•  GPU enabled VDI with UCS

•  GPU Deployment Methods

•  GPU Hardware Installa<on on Cisco UCS

•  UCSM Integrated GPU Scenario

•  GPU Installa<on on VMware ESXi Hypervisor

•  VMware vDGA & vSGA

•  MicrosoD Remote FX with GPU


GPU Requirement for VDI User Profile

DESIGNERR Graphics & Media

Professionals, Design Engineers

CATIA, CS6 Inventor

POWER USER PLM, Solidworks

Adobe Dreamweaver Medical Imaging

Showcase

Financial Analysts, Traders, Design Reviewers

KNOWLEDGE WORKER Office workers, productivity & line-of-business workers

MS Office Photoshop


NVIDIA GRID K2

GPU 4 Kepler GK 107 2 High End Kepler GK 104 CUDA cores 768 (192 / GPU) 3072 (1536 / GPU)

Memory Size 16GB DDR3 (4GB / GPU) 8GB GDDR5 Max Power 130 W 225 W Aux power

requirement 6-pin connector 8-pin connector

PCIe x16 x16 OpenGL 4.x 4.x

Microsoft DirectX 11 11 vGPU support Yes Yes

# users 4 - 1001 2 – 641

1 Number of users depends on software solution, workload, and screen resolution

NVIDIA GRID K1


Graphics Methods for Virtual Desktop Users

•  Horizon vDGA – GPU Pass-‐through “Virtualized Dedicated Graphics Accelera=on”

1:1 dedicated GPU to user

•  Horizon vSGA -‐ Shared GPU “Virtualized So@ware Graphics Accelera=on”

So$ware virtualiza<on of the GPU.

•  Horizon vGPU -‐ Virtual GPU “Virtualized Graphics Processing Unit”

Hardware virtualiza<on of the GPU


Guest OS

UCS Server

CPU

vDGA- GPU Pass-Through H

ardw

are

Memory Storage Network

Soft

war

e

Virtual Driver

Virtual Driver

Virtual Driver

Virtual Driver

Virt

ualiz

atio

n

HYPERVISOR

VIRTUAL MACHINE

vCPU vMemory vStorage vNetwork

App App App App VDA

Client

NVIDIA Driver

GPU

GPU

VMware View 6.1

VMware ESX 6 vDGA

GRID K1/K2


App App App VDA

HYPERVISOR

Guest OS

Virtual Graphics Driver

OS

Virtual Graphics Driver

Guest OS

UCS Server

CPU

Shared GPU- vSGA

Har

dwar

e


Soft

war

e

Virtual Driver

Virtual Driver

Virtual Driver

Virtual Driver

Virt

ualiz

atio

n VIRTUAL MACHINE

vCPU vMemory vStorage vNetwork vGraphics

Client

GPU

NVIDIA Driver

Virtual Graphics Driver Graphics APIs

Rendered Desktop

App App App VDA

App App App App VDA

VMware vSGA – DX9, OGL 2.1

GRID K1/K2


Guest OS

VIRTUAL MACHINE

HYPERVISOR

NVIDIA Driver

NVIDIA Driver

Guest OS

UCS Server

CPU

Virtual GPU- vGPU H

ardw

are


Soft

war

e

Virtual Driver

Virtual Driver

Virtual Driver

Virtual Driver

Virt

ualiz

atio

n VIRTUAL MACHINE

vCPU vMemory vStorage vNetwork

Client

GPU

NVIDIA Driver

vGPU

GRID Software

Graphic Commands

App App App App VDA App App App App VDA

App App App VDA

Client

Client

Standard NVidia Driver

VMware ESXi 6

NVidia GRID VGX software


User No-GPU GPU Sharing GPU Pass-through

✗ ✗ ✔

✗ ✗ / ✔ ✔

✔ ✔ ✔

Recommended Mode

Designer

Power User

Knowledge Worker


Chassis: 2 RU Rack Unit

CPU: 1 or 2 Intel Xeon E5 -2600 family processors

Memory: 24 slots registered ECC DIMMS or load reduced DIMMS

Expansion Slots: Up to 6 PCIe slots (CPU1- controls PCIE slots1,2,3 and CPU2 controls slots 4,5,6)

Internal storage devices: Up to 24 2.5” (63.5 mm) SAS/SATA/HDD/SSD drives with 24 drive backplane

C240 M4 Hardware Overview

C240 M4 Server configuration for GPU Testing

2 Intel Xeon E5-2680v3 @ 2.50 GHz Processors

12 Cores per Processor, 48 Logical Processors per server

384Gb DDR4 2133MHz memory DPC


UCS Managed C240 M4

Nexus 2232

UCS 6200 UCS 6200

•  Single Wire Management •  UCSM version 2.2.(4b)

VIC 1227 GPU 2 GPU 1

!

IntelInsideXEON

UCSC240 M4

Console

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

1 6 12 18 24

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

OS or Hypervisor


VMware vDGA setup •  GPU Pass-‐through mode

•  Virtual Dedicated Graphic Accelerator (vDGA)

•  Supports all versions of DX, OpenGL and CUDA

•  No driver/soDware installa<on needed on ESXi host

•  PCI Pass thru must be enabled on the ESXi server

•  NVIDIA Win7 driver needed on the VMs

•  Also need to make Primary Display accelerated NVidia GPU adapter

•  VMware ESXi 5.1 or later & Horizon view 5.2 or later


Enabling Pass thru on ESXi for vDGA •  Go to vCenter client and Click on host where GPU card is installed

•  Click on Configura<onà Advanced Se\ngs

•  Click on Configure Pass-‐through

•  Select the GPU card in the pass-‐through


Enabling Pass thru on ESXi for vDGA •  For one K2, there will be two PCI VGA Controller

•  For one K1 or 2x K2, there will be four PCI VGA Controller

•  Select all and click OK

•  ESXi host reboot is required

•  TO validate pass-‐through working, ssh to ESXi console & issue cmd: vmkvsitools lspci | grep “nVidia”


Verify VMWare vDGA •  Check the device manager, there will be NVidia GRID

adapter under Display Adapter.

•  Login to Virtual machine via VNC or RDP and check the device manager for NVIDIA GRID card present or not.

•  Select that adapter as primary & disable the VMware SVGA 3D.

•  Log Off the VNC or RDP & log back in with VMware view client.

•  Go to vSphere web client and edit the virtual machine properties . You can see the NVidia GRID pass through device attached to the virtual machine


Verify VMware vDGA •  Fully accelerated Open GL and DX apps can be

run.

•  NVidia Control Panel is also available for graphics adapter settings.

•  CUDA capable programs can be run with full GPU acceleration

•  nvidia-sim command . SSH into ESXI host and check the NVidia-sim command for a graphics card usage and health.


VMWare vSGA setup

•  GPU sharing Mode with API intercept

•  Virtual Shared Graphics Accelerator (vSGA)

•  Nvidia Driver (.vib) needs to be installed on the ESXi hypervisor

•  No Nvidia driver in the VM

•  Supports OGL 2.1 and DX 9.0 only

•  VMware ESXi 5.1 or later with Horizon View 5.2 or later

•  Has multi user shared access to Nvidia GPU

•  Number of users varies with the application, GPU card & rendering requirement


vSGA ESXi Host Installation and Verification

Verify the ESXi vSGA mode drivers are installed successfully. gpuvm

Download the latest .vib file from Nvidia website http://www.nvidia.com/download/driverResults.aspx/85391/en-us

Copy .vib file to ESXi host via SCP or FTP to /tmp directory Go to /tmp directory and run the command below ~#esxcli software vib install --no-sig-check -v <driver file>.vib

Install Example

Verify Card Install esxcli software vib list | grep NVIDIA lspci | grep –I display


VIRTUAL DESKTOPS

VIRTUAL MACHINE Windows 7

NVIDIA Driver

Apps

NVIDIA GRID Enabled Virtual Desktop Agent

NVIDIA GRID GPU

NVIDIA GRID ENABLED Hypervisor

vGPU Enabled VDI

!

IntelInsideXEON

UCSC240 M4

Console

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

1 6 12 18 24

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!

UC

S-H

DD3

00G

I2F1

0515

K S

AS

300

GB

!


•  Go to vSphere Web client -‐-‐> Virtual Machine à Proper<es

•  Click on New Device. Add PCI device from drop down menu

•  Select GPU profile to be added.

•  Click ok & Restart virtual machine

•  Install latest NVidia driver for Windows 7 (64 or 32 bit)

Attaching vGPU Profile to Win7 VM


NVIDIA GRID CARD

Virtual GPU Profile

Application Certification

Graphics Memory in MB

Max Display per User

Max Resoltion per Display

Max Users per Board

Use Case

GRID K2 K280Q YES 4096 4 2560x1600 2 Designer

K260Q YES 2048 4 2560x1600

4 Designer/ Power User

K240Q YES 1024 2 2560x1600

8 Designer/

Power User

K220Q YES 512 2 2560x1600

16 Power User

GRID K1 K180Q YES 4096 4 2560x1600

4 Power User

K160Q YES 2048 4 2560x1600

8 Power User

K140Q YES 1024 2 2560x1600

16 Knowledge Worker

K120Q YES 512 2 2560x1600

32 Knowledge Worker

NVIDIA GRID vGPU Profile Selection Chart


Cisco UCS, VMware Horizon and NVIDIA Reference Documents

http://www.cisco.com/go/vdi-cvd http://www.cisco.com/c/en/us/products/servers-unified-computing/ucs-c240-m4-rack-server/index.html https://www.vmware.com/support/horizon-view/doc/horizon-61-view-release-notes.html https://www.vmware.com/support/horizon-view/doc/horizon-view-602-release-http://blogs.vmware.com/performance/2014/12/vmware-horizon-6-hardware-accelerated-3d-graphics.html http://www.vmware.com/files/pdf/VMware-View-OptimizationGuideWindows7-EN.pdf http://www.nvidia.com/content/grid/pdf/GRID_K2_BD-06580-001_v02.pdf http://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-c-series-rack-servers/nvidia_grid_vgx.pdf

Thank you

cisco at v mworld 2015 gpu-solution-c240_m4-082715-vmworld

Engineering