Skip to content
Live
Trending storyPast story

Falcon audio-visual target speaker extraction model released

1 reports1 outlets21 days agoUpdate

The story so far

AI overview

Falcon has released the audio-visual target speaker extraction model. This model extracts the voice of the target speaker from noisy overlapping speech using the target speaker's mouth video, combined with a single multi-scale time-frequency separator and an encoder spatial speaker contrast loss, reducing interference speaker leakage without increasing inference costs.

AI-written from the reports · Updated 21 days ago

Coverage timeline

Follow the coverage to see every side of the story.

29 Oct
  1. Hugging Face Daily Papers
    Efficient Streaming Audio-Visual Target Speaker Extraction for Real-World Acoustic Scenes

    Falcon is a causal audio-visual target speaker extraction model that extracts the voice of the target speaker from the mouth video of the target speaker in noisy overlapping speech, combined with a single multi-scale time-frequency separator and an encoder spatial speaker contrast loss, reducing interference speaker leakage without increasing inference cost.