nvidia grid and vgpu
TRANSCRIPT
SIRIUS COMPUTER SOLUTIONS
www.siriuscom.com 05/03/2023 1
INSIDE NVIDIA GRID AND THE vGPU
Kyle Quinby
www.siriuscom.com 05/03/2023 2
Intro – Pretty Pictures
www.siriuscom.com 05/03/2023 3
• Who is using vGPU or virtual 3D today? No longer domain of the elite
• Virtual 3D no longer limited to 3D graphics professionals
• Brings 3D processing power to the masses• User density growing rapidly
Intro – Users who can benefit
www.siriuscom.com 05/03/2023 4
• Changing for the better but still not equal• Common VDI host today = 50 – 200 users easily• vGPU host = 1 – 64 users
Intro – User Density
www.siriuscom.com 05/03/2023 5
Soft 3D• Regular VDDM graphics driver that can render DirectX and OpenGL
on the CPU. Think of this as the baseline graphics option for VDI.
Brief History of 3D in virtual sessions
www.siriuscom.com 05/03/2023 6
Virtual Shared Graphics Acceleration (vSGA)• With vSGA, the physical GPUs in the server are virtualized and
shared across multiple guest VMs. • The biggest limitation here is that these drivers only work with
DirectX up to version 9.0c, and OpenGL up to version 2.1.• The vSGA use case could be thought of as regular office who
use PowerPoint and Visio and stuff, browsing the web, etc.
Brief History of 3D in virtual sessions
www.siriuscom.com 05/03/2023 7
Virtual Direct Graphics Acceleration (vDGA)• No special drivers in the hypervisor, and you run the "real"
Nvidia driver in the guest VM.• GPU passed directly to Guest VM• Expensive, 1 to 1 GPU to user• High-end users with intensive graphical applications
Brief History of 3D in virtual sessions
www.siriuscom.com 05/03/2023 8
Virtual Graphics Processing Unit (vGPU)• vGPU is essentially vDGA but with multiple users per GPU
instead of one-to-one. • Not one size fits all, tailored sizing
Brief History of 3D in virtual sessions
www.siriuscom.com 05/03/2023 9
vGPU – How it works
www.siriuscom.com 05/03/2023 10
• No VMotion• No JIT clones for Horizon 7• Only HA support is in vSphere 6.5
Limitations
www.siriuscom.com 05/03/2023 11
• Homogenous vGPUs
Limitations
www.siriuscom.com 05/03/2023 12
•Tesla M6/M60/M10 (1/2/4 GPUs)• Maxwell architecture (think consumer 750-980GT)• Newest architecture (Pascal) is not in server space yet• 8 GB Framebuffer per GPU• vGPU size cannot exceed a single GPU max memory• User density primarily driven by framebuffer allocated to
vGPUs
Tesla – The Hardware
www.siriuscom.com 05/03/2023 13
Tesla – The Hardware
www.siriuscom.com 05/03/2023 14
Tesla – The Hardware
•M4 and M40 are “Deep Learning” models•Scientific Research
www.siriuscom.com 05/03/2023 15
Tesla – The Hardware•M4 and M40 are “Deep Learning” models
www.siriuscom.com 05/03/2023 16
GRID vGPU Profiles – M60
www.siriuscom.com 05/03/2023 17
Q vs B vs A profiles• Q for Quality/Quadro - Virtual Workstation
• Certified graphic solutions for professional applications such as Autodesk Inventor 2014 and PTC Creo, undergoing the same rigorous application certification testing as NVIDIA’s Quadro workstation products.
• Uses NVIDIA’s Application Configuration Engine (ACE), ACE offers dedicated profiles for most professional workstation applications.
• B for Business - Virtual PC• Intended usage for office desktops rather than heavyweight CAD applications.
They offer multi-monitor support on smaller framebuffer profiles. The GPU resource is available to drive the multi-monitors at high resolution.
• A for Applications - Virtual Application• XenApp/RDSH type workloads
GRID vGPU Profiles
www.siriuscom.com 05/03/2023 18
•GRID Licensing is an add-on, in addition to whatever licensing your Virtual desktop infrastructure requires.•GRID does not "come with" XenDesktop or Horizon or anything else
GRID Licensing
www.siriuscom.com 05/03/2023 19
•M60 Licensing by profile level
GRID Licensing
www.siriuscom.com 05/03/2023 20
• Cards can utilize one of two modes• Compute - These optimization for High Performance Computing
can cause compatibility problems with OS’s and hypervisors when the GPU is used primarily as a graphics device
Compute vs Graphics Modes
www.siriuscom.com 05/03/2023 21
• Cards can utilize one of two modes• Graphics – What most of us want to be in
Compute vs Graphics Modes
www.siriuscom.com 05/03/2023 22
•Validate M60 mode with the following command• lspci –n | grep 10de• Class 0300 = Graphics mode. 0302 = Compute mode• gpumodeswitch tool
Compute vs Graphics Modes
www.siriuscom.com 05/03/2023 23
• Standard VIB install. GRID Manager is SO flashy!
Setting up the Hypervisor
www.siriuscom.com 05/03/2023 24
• Shared PCI device• Reserve all guest
memory (All locked)
Setting up the VM
www.siriuscom.com 05/03/2023 25
• Same Nvidia driver install as consumer devices• Unified driver, but version matches the GRID Manager• Prepare for post install reboot because . . . . . .
Setting up the OS
www.siriuscom.com 05/03/2023 26
Setting up the VM
What the . . . .
www.siriuscom.com 05/03/2023 27
• This is expected behavior for vsphere console• Until Citrix VDA is installed workarounds are
• RDP• F8 – Advanced Boot options – Low res display• VNC
Setting up the VM
www.siriuscom.com 05/03/2023 28
License server settings
Setting up the VM
www.siriuscom.com 05/03/2023 29
Setting up the VM
www.siriuscom.com 05/03/2023 30
• Installing the XenDesktop VDA• HDX 3D Pro option• Configures the VDA to be aware that it will have access to
physical GPU framebuffer• PVS and MCS supported
Setting up the VM
www.siriuscom.com 05/03/2023 31
• NVidia System Management Interface (nvidia-smi)• Hypervisor and Guest OS tool
Monitoring
www.siriuscom.com 05/03/2023 32
Hypervisor - SummaryMonitoring
www.siriuscom.com 05/03/2023 33
Hypervisor – vGPU Summary
Monitoring
www.siriuscom.com 05/03/2023 34
Hypervisor – vGPU Detail
Monitoring
www.siriuscom.com 05/03/2023 35
Guest OS – Perfmon, WMI, command line
Monitoring
www.siriuscom.com 05/03/2023 36
•DirectX 12, Direct2D, and DirectX Video Acceleration (DXVA)•OpenGL 4.5•NVIDIA GRID SDK (remote graphics acceleration)•CUDA and OpenCL are supported on these virtual GPUs: ‣
• GRID M60-8Q ‣• GRID M10-8Q ‣• GRID M6-8Q ‣• GRID M60-8A ‣• GRID M10-8A ‣• GRID M6-8A
Use Cases
www.siriuscom.com 05/03/2023 37
•NVENC• Hardware based H.264/HEVC video encoder (needs at
least 1GB framebuffer)• High Quality 2D – But beware pitfall
Use Cases
www.siriuscom.com 05/03/2023 38
Referenceshttp://images.nvidia.com/content/grid/pdf/GRID-vGPU-User-Guide.pdfhttp://images.nvidia.com/content/pdf/grid/guides/GRID-Licensing-Guide.pdfhttp://us.download.nvidia.com/Windows/Quadro_Certified/GRID/369.71/ESXi-6.0/367.64-369.71-nvidia-grid-vgpu-release-notes-vmware-vsphere.pdfhttps://virtuallyvisual.wordpress.com/2016/04/19/nvidia-m60-m6-problems-check-your-card-in-graphics-mode/https://vgpu.wordpress.com/2016/04/12/nvidia-grid-2-0-deep-dive-configuration/http://www.brianmadden.com/opinion/Clearing-up-the-confusion-around-VMware-Nvidias-vGPU-vDGA-DaaS-announcement
FunkyDesk.com for full slide [email protected]
www.siriuscom.com
THANK YOU