Broader research on MLLM retrieval head
In 18 languages, visual languages, and full-modal models, the retrieval head remains sparse in the newly added modalities (such as audio-visual) and has a high degree of cross-modal sharing. Full-modal models mainly retain the backbone model's retrieval heads; removing these retrieval heads eliminates almost all audio-visual retrieval capabilities.





















