NVIDIA NeMo Switchyard：在多模型间路由 AI 智能体工作负载
Route AI Agent Workloads Across Models with NVIDIA NeMo Switchyard
NVIDIA 推出 NeMo Switchyard，用于在多个模型之间路由 AI 智能体工作负载。由于每个模型在能力、弱点和成本上各有差异，且这些差异会随工作负载甚至同一工作负载内的不同步骤而变化，智能体任务可能需要分类、推理，以及用小模型处理常规后续任务。该方案针对把所有请求都发给最大模型的做法。
Building an AI agent does not end with choosing a single model. Each model has its own strengths, weaknesses, and cost profile, which can shift from one...
Building an AI agent does not end with choosing a single model. Each model has its own strengths, weaknesses, and cost profile, which can shift from one workload to another—or even within the same workload. For example, an agentic task may need classification for one step, reasoning for the next, and a smaller model for routine follow-up tasks. Sending every request to the largest model can…
来源：NVIDIA Developer Blog · developer.nvidia.com