NVIDIA TensorRT Model Connect：两条命令将开源模型从 Checkpoint 部署到推理
Deploy an Open Model from Checkpoint to Inference in Two Commands with NVIDIA TensorRT Model Connect
NVIDIA TensorRT Model Connect 提供开源参考实现集合，可在两条命令内把开源模型从 Checkpoint 直接部署到推理，免去模型专属的转换、预处理、后处理与运行时代码。该方案支持在原生 C++ 中通过 NVIDIA TensorRT 运行受支持的模型。
Open AI models are evolving faster than ever, but bringing them into native applications can still require model-specific conversion, preprocessing,...
Open AI models are evolving faster than ever, but bringing them into native applications can still require model-specific conversion, preprocessing, post-processing, and runtime code. NVIDIA TensorRT Model Connect open collection of reference implementations helps to address this challenge. TensorRT Model Connect shows you how to run supported models with NVIDIA TensorRT in native C++…
来源：NVIDIA Developer Blog · developer.nvidia.com