Skip to content
Live
Trending storyPast story

New research on MLLM retrieval heads

1 reports1 outlets20 days agoUpdate

The story so far

AI overview

In 18 languages, visual languages, and full-modal models, the retrieval head remains sparse in the newly added modalities (such as audiovisual) and has a high degree of cross-modal sharing, with full-modal models mainly retaining the retrieval heads of their backbone models; removing these retrieval heads eliminates almost all audiovisual retrieval capabilities.

AI-written from the reports · Updated 20 days ago

Coverage timeline

Follow the coverage to see every side of the story.

30 Oct
  1. Hugging Face Daily Papers
    A Broader Look into MLLM's Retrieval Heads

    In 18 languages, visual languages, and full-modal models, the retrieval head remains sparse in the newly added modalities (such as audio-visual) and has a high degree of cross-modal sharing. Full-modal models mainly retain the backbone model's retrieval heads; removing these retrieval heads eliminates almost all audio-visual retrieval capabilities.