跳到正文
实时
Hugging Face Daily Papers·· 18 天前

EvidenceConnect 框架与 Zooming without Zooming v2 模型发布

Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception

要点速览

EvidenceConnect 框架通过合成图像区域缩略视图生成比较、聚合或链式视觉证据问题,提升 VLM 的证据连接能力,ZwZ2 模型基于此框架训练,未针对任何下游基准但提升细粒度与空间感知,并在具身空间推理、多模态长上下文理解、多模态智能体任务及通用视觉推理上取得进展

正文

Published on Oct 27

Authors:

,

,

,

,

,

,

,

,

,

,

Abstract

EvidenceConnect synthesizes training data to strengthen visual evidence connection, improving spatial perception and multimodal reasoning across diverse tasks.

Multimodal perception forms the foundation of multimodal intelligence. In particular, spatial perception and multimodal long-context understanding are two pivotal tasks that underpin embodied AI and multimodal agents. However, synthesizing targeted, high-quality training data for these tasks remains difficult and costly. Our key insight is that these tasks share an underlying capability, which we call connecting evidence: identifying relevant visual facts, binding them to the correct entities, recovering their relations, and composing them into an answer. Crucially, targeted training data are far easier to synthesize for this capability than for these tasks themselves. To strengthen this capability, we propose EvidenceConnect, an easy-to-implement data synthesis framework that uses zoomed views of related regions within a single image to generate questions requiring comparison, aggregation, or chaining of visual evidence. To ensure quality, a reference answer is retained only when independent VLMs agree on it, and region-ablation tests discard questions whose answer survives the removal of selected regions. We then train base VLMs on the resulting data with RLVR, obtaining Zooming without Zooming v2 (ZwZ2). Although the synthesized data are not tailored to any downstream benchmark, ZwZ2 improves fine-grained and spatial perception, with further gains on embodied spatial reasoning, multimodal long-context understanding, multimodal agent tasks, and general visual reasoning. These results establish EvidenceConnect as an effective framework for supervising evidence connection and suggest that strengthening this shared capability leads to more generalizable multimodal perception.

View arXiv page View PDF Project page GitHub 2 Add to collection

Models citing this paper 3

inclusionAI/ZwZ2-27B

Image-Text-to-Text •

27B •

Updated about 8 hours ago

•

121

•

10

inclusionAI/ZwZ2-4B

Image-Text-to-Text •

5B •

Updated about 8 hours ago

•

58

•

9

inclusionAI/ZwZ2-9B

Image-Text-to-Text •

9B •

Updated about 8 hours ago

•

181

•

9

Datasets citing this paper 1

inclusionAI/ZwZ2-RL-VQA

Viewer •

Updated about 10 hours ago

•

20.7k

•

51

•

2

Spaces citing this paper 2

Collections including this paper 1

来源: Hugging Face Daily Papers · huggingface.co