Ian Sturdy

Using audio-visual information to understand speaker activity: Tracking active speakers on and off screen

We present a system that associates faces with voices in a video by fusing information from the audio and visual signals. The thesis underlying our work is that an extreme simple approach to generating (weak) speech clusters can be combined with strong visual signals to effectively associate faces a…