跳到正文
实时
Hugging Face Daily Papers·· 1 天前

ALIVE:支持流媒体视频交互的模型

ALIVE: Making Streaming Video Models Interactive

要点速览

ALIVE 实现了流媒体视频模型的交互,通过对比监督微调(ALIVE-SFT-288K)和带行为对齐信用分配(BACA)的强化学习(ALIVE-RL-3K)进行两阶段训练,在四个公共基准和 FSI-Bench 上取得最高分,展示出强大的流媒体理解和交互能力。

正文

Published on Nov 16

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Streaming video LLMs can continuously observe the world, yet often handle user requests in isolation. We introduce ALIVE, an interactive streaming video model supporting proactive monitoring, streaming task coordination, and feedback-seeking interaction. We construct ALIVE-SFT-288K and ALIVE-RL-3K for two-stage training. Contrastive supervised fine-tuning teaches when and how to respond, while reinforcement learning with Behavior-Aligned Credit Assignment (BACA) combines trajectory-level and local advantages to refine decisions, responses, and silence across multi-turn interactions. We also introduce FSI-Bench to evaluate feedback seeking and subsequent task completion. ALIVE achieves the highest overall scores among the compared models on four public benchmarks and FSI-Bench, demonstrating strong streaming understanding and interactive capabilities.

View arXiv page View PDF Project page GitHub 10 Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.21366 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.21366 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.21366 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

来源: Hugging Face Daily Papers · huggingface.co