跳到正文
实时
NVIDIA Technical Blog· Zhihan Jiang·· 10 小时前65

NVIDIA Vera Rubin NVL72 在 MLPerf Endpoints v1.0 中引领智能体推理性能

NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0

要点速览

NVIDIA Vera Rubin NVL72 在 MLPerf Endpoints v1.0 测试中表现最佳,支持 8k 上下文长度的智能体推理,速度提升 3.5 倍,每百万 token 价格为 3.5 美元。

正文

Two rows of black data center racks with gold-colored server components against a black background.Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool...Two rows of black data center racks with gold-colored server components against a black background.

Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool calls, and responses. Inference systems must support users at scale while remaining responsive. MLPerf Endpoints v1.0 evaluates this balance between serving capacity and responsiveness using coding and enterprise workflows through API…

Source

来源: NVIDIA Technical Blog · developer.nvidia.com