NVIDIA CUDA 13.4 如何在 Kubernetes 中实现内存强制的 GPU 共享
Memory-Enforced GPU Sharing in Kubernetes with NVIDIA CUDA 13.4
NVIDIA CUDA 13.4 支持在 Kubernetes 中实现内存强制的 GPU 共享。许多 AI 工作负载只需一小部分 GPU，独占整块设备会闲置容量，共享后可让平台团队用现有基础设施服务更多工作负载。NVIDIA GPU 已支持多种共享方式，其中 MIG 将 GPU 拆分为对应用透明的硬件隔离实例。
Many AI workloads need only a fraction of a GPU. Giving each one an entire device can leave capacity idle; sharing GPUs lets platform teams serve more workloads...
Many AI workloads need only a fraction of a GPU. Giving each one an entire device can leave capacity idle; sharing GPUs lets platform teams serve more workloads with the infrastructure they already have. NVIDIA GPUs already support several approaches to sharing. Multi-instance GPU (MIG) splits a GPU into hardware-isolated instances that are transparent to the application…
来源：NVIDIA Developer Blog · developer.nvidia.com