Wizard：通过智能体控制实时操控任意世界

Wizard: Manipulate Any World in Real Time via Agentic Control

要点速览

Wizard解耦角色动画、场景操控和游戏逻辑与视觉生成，通过结构化视觉代理让智能体控制关节骨骼和场景几何，实现24 FPS的实时交互，零样本泛化到未见场景、角色和动作。团队构建了50.3小时对齐的代理-视频对，包含750场景和178个角色，支持角色自适应遮罩、因果适应和少步蒸馏技术。

正文

🪄 Wizard: Manipulate Any World in Real Time via Agentic Control!

Existing game world models produce realistic visuals but remain constrained by familiar environments and predefined motions. Control largely focuses on locomotion, with limited support for articulated actions. Can a world model follow an unseen character swinging a sword, spreading its wings, or transforming mid-battle?

Wizard decouples character animation, scene manipulation, and gameplay logic from visual generation. Agents control articulated skeletons and scene geometry through structured visual proxies, while explicit world states support adaptive boss behavior and mechanics-consistent combat.

We construct 50.3 hours of aligned proxy–video pairs spanning 750 scenes and 178 characters. Character-aware adaptive masking preserves reference appearance, while causal adaptation and few-step distillation enable interaction at 24 FPS, with zero-shot generalization to unseen scenes, characters, and motions.

From world exploration and character summoning to transformation and scene manipulation, Wizard gives players greater freedom to create and control their own game worlds.

Code coming soon!