Agent Substrate：为大规模代理提升 Kubernetes 能力
Agent Substrate: Advancing Kubernetes for Agents at Scale
Agent Substrate 解决了 Kubernetes 在运行 AI 代理时的低效问题，通过共享 Pod 资源减少闲置浪费并保持代理状态，相比传统方式将冷启动时间缩短 3.5 倍。该框架已捐赠给 Linux Foundation，支持大规模代理部署。
AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per...
AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per session holds memory for sessions that aren’t doing anything, and deleting Pods between turns pays a multi-second cold start every time and loses the agent’s state. RL post-training hits the same wall. Agent Substrate, now donated to the…
来源: NVIDIA Technical Blog · developer.nvidia.com