nvidia grid and vgpu

SIRIUS COMPUTER SOLUTIONS

www.siriuscom.com 05/03/2023 1

INSIDE NVIDIA GRID AND THE vGPU

Kyle Quinby

www.siriuscom.com 05/03/2023 2

Intro – Pretty Pictures

www.siriuscom.com 05/03/2023 3

• Who is using vGPU or virtual 3D today? No longer domain of the elite

• Virtual 3D no longer limited to 3D graphics professionals

• Brings 3D processing power to the masses• User density growing rapidly

Intro – Users who can benefit

www.siriuscom.com 05/03/2023 4

• Changing for the better but still not equal• Common VDI host today = 50 – 200 users easily• vGPU host = 1 – 64 users

Intro – User Density

www.siriuscom.com 05/03/2023 5

Soft 3D• Regular VDDM graphics driver that can render DirectX and OpenGL

on the CPU. Think of this as the baseline graphics option for VDI.

Brief History of 3D in virtual sessions

www.siriuscom.com 05/03/2023 6

Virtual Shared Graphics Acceleration (vSGA)• With vSGA, the physical GPUs in the server are virtualized and

shared across multiple guest VMs. • The biggest limitation here is that these drivers only work with

DirectX up to version 9.0c, and OpenGL up to version 2.1.• The vSGA use case could be thought of as regular office who

use PowerPoint and Visio and stuff, browsing the web, etc.

Brief History of 3D in virtual sessions

www.siriuscom.com 05/03/2023 7

Virtual Direct Graphics Acceleration (vDGA)• No special drivers in the hypervisor, and you run the "real"

Nvidia driver in the guest VM.• GPU passed directly to Guest VM• Expensive, 1 to 1 GPU to user• High-end users with intensive graphical applications

Brief History of 3D in virtual sessions

www.siriuscom.com 05/03/2023 8

Virtual Graphics Processing Unit (vGPU)• vGPU is essentially vDGA but with multiple users per GPU

instead of one-to-one. • Not one size fits all, tailored sizing

Brief History of 3D in virtual sessions

www.siriuscom.com 05/03/2023 9

vGPU – How it works

www.siriuscom.com 05/03/2023 10

• No VMotion• No JIT clones for Horizon 7• Only HA support is in vSphere 6.5

Limitations

www.siriuscom.com 05/03/2023 11

• Homogenous vGPUs

Limitations

www.siriuscom.com 05/03/2023 12

•Tesla M6/M60/M10 (1/2/4 GPUs)• Maxwell architecture (think consumer 750-980GT)• Newest architecture (Pascal) is not in server space yet• 8 GB Framebuffer per GPU• vGPU size cannot exceed a single GPU max memory• User density primarily driven by framebuffer allocated to

vGPUs

Tesla – The Hardware

www.siriuscom.com 05/03/2023 13

Tesla – The Hardware

www.siriuscom.com 05/03/2023 14

Tesla – The Hardware

•M4 and M40 are “Deep Learning” models•Scientific Research

www.siriuscom.com 05/03/2023 15

Tesla – The Hardware•M4 and M40 are “Deep Learning” models

www.siriuscom.com 05/03/2023 16

GRID vGPU Profiles – M60

www.siriuscom.com 05/03/2023 17

Q vs B vs A profiles• Q for Quality/Quadro - Virtual Workstation

• Certified graphic solutions for professional applications such as Autodesk Inventor 2014 and PTC Creo, undergoing the same rigorous application certification testing as NVIDIA’s Quadro workstation products.

• Uses NVIDIA’s Application Configuration Engine (ACE), ACE offers dedicated profiles for most professional workstation applications.

• B for Business - Virtual PC• Intended usage for office desktops rather than heavyweight CAD applications.

They offer multi-monitor support on smaller framebuffer profiles. The GPU resource is available to drive the multi-monitors at high resolution.

• A for Applications - Virtual Application• XenApp/RDSH type workloads

GRID vGPU Profiles

www.siriuscom.com 05/03/2023 18

•GRID Licensing is an add-on, in addition to whatever licensing your Virtual desktop infrastructure requires.•GRID does not "come with" XenDesktop or Horizon or anything else

GRID Licensing

www.siriuscom.com 05/03/2023 19

•M60 Licensing by profile level

GRID Licensing

www.siriuscom.com 05/03/2023 20

• Cards can utilize one of two modes• Compute - These optimization for High Performance Computing

can cause compatibility problems with OS’s and hypervisors when the GPU is used primarily as a graphics device

Compute vs Graphics Modes

www.siriuscom.com 05/03/2023 21

• Cards can utilize one of two modes• Graphics – What most of us want to be in

Compute vs Graphics Modes

www.siriuscom.com 05/03/2023 22

•Validate M60 mode with the following command• lspci –n | grep 10de• Class 0300 = Graphics mode. 0302 = Compute mode• gpumodeswitch tool

Compute vs Graphics Modes

www.siriuscom.com 05/03/2023 23

• Standard VIB install. GRID Manager is SO flashy!

Setting up the Hypervisor

www.siriuscom.com 05/03/2023 24

• Shared PCI device• Reserve all guest

memory (All locked)

Setting up the VM

www.siriuscom.com 05/03/2023 25

• Same Nvidia driver install as consumer devices• Unified driver, but version matches the GRID Manager• Prepare for post install reboot because . . . . . .

Setting up the OS

www.siriuscom.com 05/03/2023 26

Setting up the VM

What the . . . .

www.siriuscom.com 05/03/2023 27

• This is expected behavior for vsphere console• Until Citrix VDA is installed workarounds are

• RDP• F8 – Advanced Boot options – Low res display• VNC

Setting up the VM

www.siriuscom.com 05/03/2023 28

License server settings

Setting up the VM

www.siriuscom.com 05/03/2023 29

Setting up the VM

www.siriuscom.com 05/03/2023 30

• Installing the XenDesktop VDA• HDX 3D Pro option• Configures the VDA to be aware that it will have access to

physical GPU framebuffer• PVS and MCS supported

Setting up the VM

www.siriuscom.com 05/03/2023 31

• NVidia System Management Interface (nvidia-smi)• Hypervisor and Guest OS tool

Monitoring

www.siriuscom.com 05/03/2023 32

Hypervisor - SummaryMonitoring

www.siriuscom.com 05/03/2023 33

Hypervisor – vGPU Summary

Monitoring

www.siriuscom.com 05/03/2023 34

Hypervisor – vGPU Detail

Monitoring

www.siriuscom.com 05/03/2023 35

Guest OS – Perfmon, WMI, command line

Monitoring

www.siriuscom.com 05/03/2023 36

•DirectX 12, Direct2D, and DirectX Video Acceleration (DXVA)•OpenGL 4.5•NVIDIA GRID SDK (remote graphics acceleration)•CUDA and OpenCL are supported on these virtual GPUs: ‣

• GRID M60-8Q ‣• GRID M10-8Q ‣• GRID M6-8Q ‣• GRID M60-8A ‣• GRID M10-8A ‣• GRID M6-8A

Use Cases

www.siriuscom.com 05/03/2023 37

•NVENC• Hardware based H.264/HEVC video encoder (needs at

least 1GB framebuffer)• High Quality 2D – But beware pitfall

Use Cases

www.siriuscom.com 05/03/2023 38

Referenceshttp://images.nvidia.com/content/grid/pdf/GRID-vGPU-User-Guide.pdfhttp://images.nvidia.com/content/pdf/grid/guides/GRID-Licensing-Guide.pdfhttp://us.download.nvidia.com/Windows/Quadro_Certified/GRID/369.71/ESXi-6.0/367.64-369.71-nvidia-grid-vgpu-release-notes-vmware-vsphere.pdfhttps://virtuallyvisual.wordpress.com/2016/04/19/nvidia-m60-m6-problems-check-your-card-in-graphics-mode/https://vgpu.wordpress.com/2016/04/12/nvidia-grid-2-0-deep-dive-configuration/http://www.brianmadden.com/opinion/Clearing-up-the-confusion-around-VMware-Nvidias-vGPU-vDGA-DaaS-announcement

FunkyDesk.com for full slide deckKyle.Quinby@siriuscom.com

www.siriuscom.com

THANK YOU