EmbeddingGemma 2: Unified and Efficient Multimodal Representations

Brief overview

EmbeddingGemma 2 is an open-source multimodal embedding model that unifies text, image, audio, and video representations in an efficient and resource-flexible design, and performs excellently in benchmark tests. It has established a new Pareto frontier in embedding benchmark tests for all modalities, outperforming professional models and other models that are two to twelve times larger in scale. The model supports selective modality encoder loading, adjustable visual token budgets, truncatable embedding dimensions, and quantized weights to adapt to resource-constrained environments.

Article

Published on Oct 27

Authors:

Abstract

EmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.

We present EmbeddingGemma 2, an open multimodal embedding model which natively represents text, images, audio, video, and combinations thereof in a unified space. Our approach introduces improvements such as simplified per-layer embeddings and a multi-stage curriculum with modality and objective progression which ensure strong quality across unimodal, cross-modal, and mixed-modal evaluations. Notably, in comprehensive embedding benchmarks across all modalities, EmbeddingGemma 2 establishes a new Pareto frontier, outperforming both specialist models and models two to twelve times larger. Furthermore, our design offers flexibility for resource-constrained environments, supporting selective modality encoder loading, adjustable vision token budgets, truncatable embedding dimensions, and quantized weights. We present ablations analyzing key decisions and release EmbeddingGemma 2 to promote further research.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.37364

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash