跳到正文
实时
Hugging Face Daily Papers·· 1 天前65

HINT-WAM:基于后见之明训练世界行动模型

HINT-WAM: Hindsight-Informed Training for World Action Models

要点速览

HINT-WAM首次提出一种基于后见之明训练世界行动模型(WAM)的框架,通过利用未来视频作为特权信息监督动作专家,在无需环境奖励或模拟器交互的情况下实现任务执行。该框架使用自身采样轨迹作为密集训练目标,并通过能量分数进行知识蒸馏,匹配教师模型从学生模型自身样本中产生的动作分布。项目已在arXiv发布,代码托管于GitHub。

正文

Published on Nov 18

Authors:

,

Abstract

World action models (WAMs) have shown promising generalization and data efficiency in robot manipulation by coupling action generation with predictions of future visual dynamics. Translating these capabilities into reliable task execution, however, remains a challenge for existing post-training methods. Offline supervised fine-tuning provides dense supervision on expert trajectories, but its flow-matching action expert is trained only on noised demonstration actions and never on the intermediate states produced by its own sampler; task-specific adaptation can also compromise pretrained capabilities. On-policy reinforcement learning trains on the policy's own behavior, yet sparse task rewards make exploration and credit assignment difficult, while dense reward shaping still provides scalar evaluations rather than direct action targets. We introduce HINT-WAM, the first on-policy self-distillation framework that supervises the action expert on its own sampling trajectories using hindsight, the future video of the demonstration, as privileged information available to the WAM itself. For each demonstration observation, the student generates its action through its own denoising trajectory, and at the states along this trajectory the same model acts as a teacher conditioned additionally on this hindsight, providing a conditional action distribution as a dense training target, while the student sees only deployment-time inputs and needs no environmental rewards or simulator interaction. To transfer this supervision to a flow-matching action expert, HINT-WAM distills the teacher into the student with an energy score, a distribution-level objective that matches the teacher's action distribution from the student's own samples rather than regressing its velocity field. The project web is available in https://tuandattt.github.io/hintwam/.

View arXiv page View PDF Project page GitHub 1 Add to collection

Get this paper in your agent:

hf papers read 2611.24789

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

tuandattttt/HINT-WAM

Robotics •

Updated 30 minutes ago

•

10

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.24789 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.24789 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

来源: Hugging Face Daily Papers · huggingface.co