← Search

Bapi Raju Surampudi

3 accepted papers

2025

Aligning Text/Speech Representations from Multimodal Models with MEG Brain Activity During Listening

EMNLP 2025

Although speech language models are expected to align well with brain language processing during speech comprehension, recent studies have found that they fail to capture brain-relevant semantics beyond low-level features. Surprisingly, text-based language models exhibit stronger alignment with brai

2025

Correlating instruction-tuning (in multimodal models) with vision-language processing (in the brain)

ICLR 2025poster

Transformer-based language models, though not explicitly trained to mimic brain recordings, have demonstrated surprising alignment with brain activity. Progress in these models—through increased size, instruction-tuning, and multimodality—has led to better representational alignment with neural data…

2025

Multi-modal brain encoding models for multi-modal stimuli

ICLR 2025poster

Despite participants engaging in unimodal stimuli, such as watching images or silent videos, recent work has demonstrated that multi-modal Transformer models can predict visual brain activity impressively well, even with incongruent modality representations. This raises the question of how accuratel…