← Search

Vy A. Vo

3 accepted papers

2023

Brain encoding models based on multimodal transformers can transfer across language and vision

NeurIPS 2023poster

Encoding models have been used to assess how the human brain represents concepts in language and vision. While language and vision rely on similar concept representations, current encoding models are typically trained and tested on brain responses to each modality in isolation. Recent advances in mu…

Cited by 39SourcePDFScholar
2021

Low-dimensional Structure in the Space of Language Representations is Reflected in Brain Responses

NeurIPS 2021poster

How related are the representations learned by neural language models, translation models, and language tagging tasks? We answer this question by adapting an encoder-decoder transfer learning method from computer vision to investigate the structure among 100 different feature spaces extracted from…