Radhika Mamidi

Aligning Text/Speech Representations from Multimodal Models with MEG Brain Activity During Listening

Although speech language models are expected to align well with brain language processing during speech comprehension, recent studies have found that they fail to capture brain-relevant semantics beyond low-level features. Surprisingly, text-based language models exhibit stronger alignment with brai