Open-HumanScale:开源方案助力具身基础模型扩展人机体验
Open-HumanScale: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models
Open-HumanScale 是首个支持具身基础模型 egocentric pretraining 扩展至 50,000 小时的开源方案,其核心数据集 Open-HumanScale-50K 包含 50,000 小时密集标注的人手动作和自然语言 egocentric 视频数据。
Published on Nov 4
·
Submitted by
on Nov 6
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
Egocentric human video offers a scalable source of manipulation priors for robot learning, yet translating raw data scale into generalizable robot policies demands rigorous data curation and training recipes. We introduce Open-HumanScale, the first fully open recipe for scaling egocentric pretraining to 50,000 hours, anchored by Open-HumanScale-50K---a curated egocentric video corpus densely annotated with hand motion and natural language. Leveraging this corpus, we systematically investigate pure human pretraining via closed-loop simulation evaluations and uncover an empirical log-linear scaling law linking pretraining data hours to downstream robot success rates. Grounded in these findings, we develop HumanWAM-Vanilla, a world--action model pretrained exclusively on 50k hours of egocentric human video. Upon robot post-training, HumanWAM-Vanilla reaches 92.08% success on RoboTwin 2.0 Clean2Clean and 68.88% on Clean2Random, alongside a 14.17% mean success rate and a 19.00 mean progress score on RoboDojo. To push the capability frontier further, we explore joint human--robot pretraining with HumanWAM-Goal, a visual-goal-conditioned world--action model. Hybrid data scaling unlocks broad zero-shot generalization across both simulation and physical benchmarks, propelling post-trained RoboTwin 2.0 performance to new state-of-the-art levels: 92.70% on Clean2Clean and a substantial leap to 84.60% on Clean2Random. On physical robots, HumanWAM-Goal further exhibits emergent embodied in-context learning, dynamically adapting its manipulation behavior to unseen visual goals without parameter updates. To support reproducible scaling research in embodied AI, we open-source the Open-HumanScale-50K corpus, data curation and pretraining pipelines, alongside the pretrained and post-trained HumanWAM checkpoints, inference code, and simulation evaluation suites.
View arXiv page View PDF Project page Add to collection
Get this paper in your agent:
hf papers read 2611.06817
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 4
Robotics • Updated 2 days ago • 2DAGroup-PKU/HumanWAM-Vanilla-Exploration
Robotics • Updated about 24 hours agoDAGroup-PKU/HumanWAM-Vanilla-Base
Robotics • Updated about 24 hours ago • 32DAGroup-PKU/HumanWAM-Vanilla-RoboTwin
Robotics • Updated about 24 hours agoDAGroup-PKU/HumanWAM-Vanilla-RoboDojo
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2611.06817 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.06817 in a Space README.md to link it from this page.
Collections including this paper 1
来源: Hugging Face Daily Papers · huggingface.co