Skip to content
Live
Trending storyPast story

Realtime-Bench releases LLM low-latency performance benchmark test

1 reports1 outlets16 days agoUpdate

The story so far

AI overview

Institutions such as the University of Texas at Austin have released the Realtime-Bench benchmark to evaluate LLM performance in 50 real-time interactive games and web tasks. GPT-6 Astra achieved a 36% pass rate under real-time clock conditions. The test aims to measure the model's real-time state awareness, adaptive reasoning, and time-aware action selection capabilities.

AI-written from the reports · Updated 16 days ago

Coverage timeline

Follow the coverage to see every side of the story.

2 Nov
  1. Import AI
    Import AI 479: Spacewar; low-latency tasks versus LLMs; Genie 4

    Realtime-Bench benchmark tests evaluated the performance of LLMs on 50 real-time interactive games and web tasks, with GPT-6 Astra achieving a 36% pass rate under real-time clock conditions; this test was developed by institutions such as the University of Texas at Austin to measure the model's real-time state awareness, adaptive reasoning, and time-aware action selection capabilities.