Akshett Rai Jindal

Correlating instruction-tuning (in multimodal models) with vision-language processing (in the brain)

Transformer-based language models, though not explicitly trained to mimic brain recordings, have demonstrated surprising alignment with brain activity. Progress in these models—through increased size, instruction-tuning, and multimodality—has led to better representational alignment with neural data…