Tyler Etchart

Asd-Transformer: Efficient Active Speaker Detection Using Self And Multimodal Transformers

Multimodal active speaker detection (ASD) methods assign a speaking/not-speaking label per individual in a video clip. ASD is critical for applications such as natural human-computer interaction, speaker diarization, and video reframing. Recent work has shown the success of transformers in multimoda…