Realtime-Bench releases LLM low-latency performance benchmark test
The story so far
Institutions such as the University of Texas at Austin have released the Realtime-Bench benchmark to evaluate LLM performance in 50 real-time interactive games and web tasks. GPT-6 Astra achieved a 36% pass rate under real-time clock conditions. The test aims to measure the model's real-time state awareness, adaptive reasoning, and time-aware action selection capabilities.
AI-written from the reports · Updated 16 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Import AIImport AI 479: Spacewar; low-latency tasks versus LLMs; Genie 4
Realtime-Bench benchmark tests evaluated the performance of LLMs on 50 real-time interactive games and web tasks, with GPT-6 Astra achieving a 36% pass rate under real-time clock conditions; this test was developed by institutions such as the University of Texas at Austin to measure the model's real-time state awareness, adaptive reasoning, and time-aware action selection capabilities.