Skip to content
Live
Trending storyPast story

NVIDIA has released an in-vehicle edge inference model

1 reports1 outlets8 days agoUpdate

The story so far

AI overview

NVIDIA released the Alpamayo 2 Edge edge inference model, which can run within automotive computing and latency constraints. The model achieved a score of 70.5 on the MMLU benchmark, supports an 8k context window, with a 3.5-fold speed increase, priced at $3/ million tokens, and is for closed-source deployment.

AI-written from the reports · Updated 8 days ago

Coverage timeline

Follow the coverage to see every side of the story.

11 Nov
  1. NVIDIA Technical Blog
    Running AV Reasoning Models Within Onboard Compute and Latency Limits

    The NVIDIA Alpamayo 2 Edge edge inference model can run within automotive computing and latency constraints. The model achieves 70.5 on the MMLU benchmark, supports an 8k context window, speeds up 3.5x, and costs $3/ million tokens with closed-source deployment.

Heat over time

Now
3
Peak
412 Nov, 06:00
24h change
–

Hover or tap the chart to see each hour; use the arrow keys on a keyboard.