NVIDIA Dynamo 推出影子引擎恢复，LLM 推理故障可秒级恢复
Restore LLM Inference Capacity in Seconds with Shadow Engine Recovery in NVIDIA Dynamo
NVIDIA Dynamo 推出预览功能影子引擎恢复，让 LLM 推理引擎进程故障后无需冷重启即可在数秒内恢复容量。传统冷重启需从存储加载权重到 HBM、编译 kernel 并捕获 NVIDIA CUDA graphs，大模型初始化耗时数分钟。
When an LLM engine process fails, the standard recovery path involves a cold restart. This requires loading weights into HBM from storage, compiling kernels,...
When an LLM engine process fails, the standard recovery path involves a cold restart. This requires loading weights into HBM from storage, compiling kernels, and capturing NVIDIA CUDA graphs. For large models, initialization can take several minutes, during which surviving workers must absorb the displaced traffic. Shadow engine recovery, available as a preview feature in NVIDIA Dynamo…
来源：NVIDIA Developer Blog · developer.nvidia.com