跳到正文
实时
Hugging Face Daily Papers·· 1 天前65

VibePrevisBench: 评估 Blender 中 4D 场景生成的智能体编码

VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender

要点速览

VibePrevisBench 是一个用于 4D 场景重建的基准,让智能体将简报转化为可执行的 4D 场景并渲染代理视频,包含 242 个任务,通过基于规则的场景检查和基于视觉语言模型的屏幕检查进行评分,分析显示多模态理解能力区分智能体,所有智能体掌握基本操作但处理复杂请求失败,且未能修正渲染错误。

正文

Published on Nov 11

#3 Paper of the day

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Controllable real-world video generation models can condition on a rendered graybox proxy video, which fixes layout, motion and camera. Coding agents can build such videos by reconstructing a 4D scene in Blender, yet no benchmark checks both these videos and the long, multi-shot scenes behind them. We introduce VibePrevisBench, a benchmark for 4D scene reconstruction: an agent turns a brief into an executable 4D scene and renders its proxy video. Its 242 tasks span four input kinds, including scripts, photos, continuations, and reference videos. Each delivery is scored along two evaluation dimensions. Rule-based Scene Check re-runs the code and compares the exported 4D scene with hidden ground truth facts in nine dimensions. VLM-based Screen Check asks a VLM judge whether the facts that pass can be recognized in the proxy video. We analyze the evaluation results and trajectories of 11 frontier coding agents and identify three key observations. First, multimodal understanding separates the agents, especially in understanding space and camera motion. Second, all agents seem to already master basic camera work and staging, and fail at challenging requests. Third, agents inspect their own renders but fail to correct their errors. Agents thus need better visual understanding of space and camera, explicit checks for challenging requests, and item-by-item verification of renders against the brief.

View arXiv page View PDF Project page GitHub Add to collection

Get this paper in your agent:

hf papers read 2611.15789

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.15789 in a model README.md to link it from this page.

Datasets citing this paper 1

Kling-Keye/vibeprevisbench

Viewer •

Updated about 4 hours ago

•

242

•

2.04k

•

3

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.15789 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

来源: Hugging Face Daily Papers · huggingface.co