Jeveration:冻结式视觉语言模型实现单次前向生成高质量图像
Jeveration: System One Models Now Generate
Jeveration通过冻结式视觉语言模型实现单次前向生成512x512高质量图像,比现有统一模型快122倍,同时支持文本到图像、图像到图像和密集预测任务。
Abstract
Jeveration repurposes a frozen vision-language model to generate coherent images and perform image-to-image and dense prediction tasks in a single forward pass with fast 512x512 generation.
System One models such as Jev return decisions through fast, parallel prediction. In this paper, we introduce Jeveration, showing that the same decision paradigm can also generate high-quality images in a single forward pass. Jeveration builds on a frozen vision-language model, repurposing its visual-semantic knowledge for holistic image generation. The key challenge is to maintain global consistency. A single prompt admits many valid images, yet parallel predictions must converge on a coherent whole. We therefore condition all positions on a shared random state to coordinate parallel predictions, so that each draw yields a different but coherent image. Since the model tends to ignore this state under direct image supervision, we first learn a distribution over discrete image codes to guide single-pass generation. Beyond text-to-image generation, we further unify image-to-image generation and dense prediction within the same architecture, so that one checkpoint supports all three tasks, each in one forward pass. Experiments show that Jeveration generates a 512x512 image in 78 ms, up to 122x faster than existing unified models, while maintaining competitive image quality and dense prediction performance.
View arXiv page View PDF Project page GitHub 15 Add to collection
Get this paper in your agent:
hf papers read 2611.24738
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 1
Text-to-Image • Updated about 4 hours ago • 6linlinlinlinsdada/Jeveration
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2611.24738 in a dataset README.md to link it from this page.
Spaces citing this paper 2
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
来源: Hugging Face Daily Papers · huggingface.co