AgenticRoboRL 框架通过后训练提升机器人规划器性能
AgenticRoboRL: Bringing Coding-Agent Post-Training to Agentic Robotics
AgenticRoboRL 框架通过监督微调和多轮强化学习提升机器人规划器,在 LIBERO-PRO 上将 9B 参数规划器成功率从 18.1% 提升至 71.0% 不依赖外部记忆,接近 Codex (GPT-5.5) 使用外部记忆达成的 72.1%。该框架适配不同执行机制,将记录的规划器交互与任务结果连接,通过适配器实现通用强化学习训练流程。
Published on Oct 20
Authors:
,
,
,
,
Abstract
AgenticRoboRL improves robot planners via supervised fine-tuning and multi-turn reinforcement learning across diverse harnesses, significantly boosting success rates without external memory.
Agentic robotics systems combine planners with robot harnesses to perform complex manipulation tasks. Recent work improves these systems through better harnesses and external memory, but relies on powerful closed-source models as planners and does not improve the planners' own capabilities. In contrast, coding agents have improved substantially by post-training the model itself. We therefore investigate whether post-training can also improve robot planners. However, applying it across robot harnesses requires accommodating different execution mechanisms, including VLA skill invocation and control-code generation. To this end, we introduce AgenticRoboRL, a framework for post-training robot planners across different harnesses. The training recipe combines supervised fine-tuning with multi-turn reinforcement learning. To accommodate different execution mechanisms, harness-specific adapters connect recorded planner interactions with task outcomes, enabling a common RL training pipeline while keeping execution components fixed. On LIBERO-PRO, AgenticRoboRL raises the success rate of a 9B-parameter planner from 18.1% to 71.0% without external memory, approaching the 72.1% achieved by Codex (GPT-5.5) with external memory. These results demonstrate post-training as an effective approach for improving robot planners. We will release the framework and trained planner checkpoints.
View arXiv page View PDF Project page GitHub 11 Add to collection
Get this paper in your agent:
hf papers read 2610.28589
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 1
Updated 1 day ago • 3ciciciciliu/AgenticRoboRL-Qwen3.5-9B
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.28589 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.28589 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
来源: Hugging Face Daily Papers · huggingface.co