Efficient Streaming Audio-Visual Target Speaker Extraction for Real-World Acoustic Scenes

Researchers introduced RealSSA, a benchmark for realistic audio-visual target speaker extraction, and Falcon, a causal method using multi-scale time-frequency separation trained with an encoder-space speaker contrastive loss.