ChronoReplay training framework enhances the spatiotemporal reasoning ability of streaming visual language models
The story so far
ChronoReplay training framework organizes heterogeneous spatiotemporal supervision into time-ordered interaction segments, preserves specific task answer formats, and balances learning from different supervision signals, enabling a single model to learn complementary spatiotemporal capabilities while maintaining temporal consistency. It achieves improvements on OVO-S-Bench, OST-Bench, and UCS-Bench benchmarks, with a 13.41-point increase on OST-Bench, while optimizing streaming inference performance through adaptive frame selection.
AI-written from the reports · Updated 22 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face Daily PapersChronoReplay: One Answer Interface Is Not Enough for Streaming Spatial Intelligence
ChronoReplay training framework organizes heterogeneous spatiotemporal supervision into time-ordered interaction segments, preserves specific task answer formats, and balances learning from different supervision signals, enabling a single model to learn complementary spatiotemporal capabilities while maintaining temporal consistency. It achieves improvements on OVO-S-Bench, OST-Bench, and UCS-Bench benchmarks, with a 13.41-point increase on OST-Bench, while optimizing streaming inference performance through adaptive frame selection.