NVIDIA Certified Associate – AI Infrastructure and Operations — Question 19

What is a key benefit of using NVIDIA GPUDirect RDMA in an AI environment?

Answer options

• A. It increases the power efficiency and thermal management of GPUs.
• B. It reduces the latency and bandwidth overhead of remote memory access between GPUs.
• C. It enables faster data transfers between GPUs and CPUs without involving the operating system.
• D. It allows multiple GPUs to share the same memory space without any synchronization.

Correct answer: B

Explanation

The correct answer B highlights that NVIDIA GPUDirect RDMA is designed to lower latency and reduce bandwidth overhead when accessing memory remotely between GPUs, which is critical in AI tasks. Options A, C, and D, while they mention relevant aspects of GPU performance and functionality, do not accurately reflect the core benefit of GPUDirect RDMA in reducing latency and bandwidth usage.