Frontier3DBench: Benchmarking Coding Agents for 3D Creation across Objects, Scenes, and Interactive Open Worlds
Frontier3DBench: Benchmarking Coding Agents for 3D Creation across Objects, Scenes, and Interactive Open Worlds
Frontier3DBench uniformly evaluated the ability of code agents in object, scene, and interactive 3D world creation across 145 tasks, GPT-6.1-sol performed best at the object and scene levels, with a total score of 66.02/100, but all configurations had reference reconstruction scores lower than text-driven generation in object and scene tasks. The generated world averaged 83.08/100 in local mechanisms, but only 20.82 and 30.26 respectively in motion removal and stateful workflow, showing that coordinated activity completion remains a core bottleneck
Published on Nov 6
Authors:
,
,
,
,
,
,
,
,
,
,
,
Abstract
A unified 145-task benchmark evaluates coding agents across object, scene, and interactive 3D creation, revealing reference fidelity and coordinated activity completion as central bottlenecks.
Coding agents combine visual understanding with program execution, offering a new route to automated 3D creation. By translating images and instructions into editable programs, they bring reconstruction, generation, and editing into a shared workflow. Yet existing benchmarks fragment evaluation across task scopes and protocols, leaving their capabilities across construction levels unclear. We propose Frontier3DBench, a unified benchmark of 145 tasks across 9 categories spanning object, scene, and interactive open-world creation, with joint evaluation of appearance, structure, and behavior. Experiments with 11 model-harness configurations reveal strengths that vary by level: GPT-6.1-sol leads the object and scene levels and achieves the highest overall score of 66.02/100, whereas GPT-6-astra leads interactive world construction. However, all configurations score lower on reference reconstruction than on text-driven generation in object and scene tasks. Producing plausible content thus remains easier than reproducing specified geometry, layouts, and visual details. Moreover, generated worlds average 83.08/100 on local mechanisms but only 20.82 on motion clearance and 30.26 on stateful workflows: individual mechanisms often function, whereas complete activities that require coordinated actions and persistent state remain difficult. These results identify reference fidelity and coordinated activity completion as central bottlenecks for coding agents in 3D creation.
View arXiv page View PDF Project page Add to collection
Get this paper in your agent:
hf papers read 2611.09017
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2611.09017 in a model README.md to link it from this page.
Datasets citing this paper 1
Einsia/Frontier3DBench
Viewer • Updated about 2 hours ago • 145
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.09017 in a Space README.md to link it from this page.
Collections including this paper 2
Source: Hugging Face Daily Papers · huggingface.co