WeVisOne-VL: Unified Visual Perception from Objects to Pixels
WeVisOne-VL: Unified Visual Perception from Objects to Pixels
WeVisOne-VL predicts structured tokens to achieve unified object-level and pixel-level visual perception, supporting tasks such as detection, localization, counting, OCR, segmentation, and matting. It employs a lightweight pixel decoder and multi-stage training, leading in over 30 benchmark tests while maintaining robust rejection of non-existent objects.
Same story1 other outlet also reported this
How the accounts differ:Hugging Face Daily Papers states it uses a lightweight pixel decoder; MarkTechPost mentions a 9.6M parameter decoder.
- Hugging Face Daily Papers··First·Reading now
WeVisOne-VL: A unified visual perception model from object to pixel
- MarkTechPost··+12 d
Tencent's WeVisOne-VL unifies detection, OCR, segmentation, and Matting.
Adds:4B version achieves 71.3 F1 mean on Dense200 dense detection.
In order of publication · later reports are added as they appear · Compared by AI from each outlet’s title and summary
Published on Oct 22
Authors:
,
,
,
,
,
,
Abstract
WeVisOne-VL unifies object-level and pixel-level visual perception via structured token prediction, supporting detection, localization, counting, OCR, segmentation, and matting with a lightweight pixel decoder and multi-stage training.
Existing vision-language models (VLMs) remain unreliable for fine-grained visual perception. In this report, we present WeVisOne-VL (WeChat Vision All-in-One), a powerful VLM that unifies object-level and pixel-level perception through structured next-token prediction. It supports multiple visual tasks including object detection, referring localization, counting, OCR, segmentation, and matting, enabling localization at any user-specific granularity, from points and boxes to masks and alpha mattes. Architecturally, we integrate a lightweight pixel decoder into the VLM via a special <OBJ> token to generate instance-level pixel outputs. We train the model with a three-stage curriculum SFT followed by mixed-task RL. Across over 30 benchmarks, WeVisOne-VL demonstrates leading performance on both object-level and pixel-level tasks, while maintaining robust rejection for object-absent queries. By releasing WeVisOne-VL to the open-source community, we hope to advance VLMs from broad visual understanding toward truly reliable perception systems for real-world deployment.
View arXiv page View PDF Project page GitHub 44 Add to collection
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.31329 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.31329 in a dataset README.md to link it from this page.
Spaces citing this paper 1
Collections including this paper 1
Source: Hugging Face Daily Papers · huggingface.co