跳到正文
实时
Hugging Face Daily Papers·· 9 天前52

Open-HumanScale:开源方案助力具身基础模型扩展人机体验

Open-HumanScale: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models

要点速览

Open-HumanScale 是首个支持具身基础模型 egocentric pretraining 扩展至 50,000 小时的开源方案,其核心数据集 Open-HumanScale-50K 包含 50,000 小时密集标注的人手动作和自然语言 egocentric 视频数据。

正文

Published on Nov 4

·

Submitted by

mjc

on Nov 6

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Egocentric human video offers a scalable source of manipulation priors for robot learning, yet translating raw data scale into generalizable robot policies demands rigorous data curation and training recipes. We introduce Open-HumanScale, the first fully open recipe for scaling egocentric pretraining to 50,000 hours, anchored by Open-HumanScale-50K---a curated egocentric video corpus densely annotated with hand motion and natural language. Leveraging this corpus, we systematically investigate pure human pretraining via closed-loop simulation evaluations and uncover an empirical log-linear scaling law linking pretraining data hours to downstream robot success rates. Grounded in these findings, we develop HumanWAM-Vanilla, a world--action model pretrained exclusively on 50k hours of egocentric human video. Upon robot post-training, HumanWAM-Vanilla reaches 92.08% success on RoboTwin 2.0 Clean2Clean and 68.88% on Clean2Random, alongside a 14.17% mean success rate and a 19.00 mean progress score on RoboDojo. To push the capability frontier further, we explore joint human--robot pretraining with HumanWAM-Goal, a visual-goal-conditioned world--action model. Hybrid data scaling unlocks broad zero-shot generalization across both simulation and physical benchmarks, propelling post-trained RoboTwin 2.0 performance to new state-of-the-art levels: 92.70% on Clean2Clean and a substantial leap to 84.60% on Clean2Random. On physical robots, HumanWAM-Goal further exhibits emergent embodied in-context learning, dynamically adapting its manipulation behavior to unseen visual goals without parameter updates. To support reproducible scaling research in embodied AI, we open-source the Open-HumanScale-50K corpus, data curation and pretraining pipelines, alongside the pretrained and post-trained HumanWAM checkpoints, inference code, and simulation evaluation suites.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2611.06817

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 4

DAGroup-PKU/HumanWAM-Vanilla-Exploration

Robotics •

Updated 2 days ago

•

2

DAGroup-PKU/HumanWAM-Vanilla-Base

Robotics •

Updated about 24 hours ago

DAGroup-PKU/HumanWAM-Vanilla-RoboTwin

Robotics •

Updated about 24 hours ago

•

32

DAGroup-PKU/HumanWAM-Vanilla-RoboDojo

Robotics •

Updated about 24 hours ago

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.06817 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.06817 in a Space README.md to link it from this page.

Collections including this paper 1

来源: Hugging Face Daily Papers · huggingface.co