Nicholas Lanuzo

Cross-Lingual Representation Alignment Through Contrastive Image-Caption Tuning

Multilingual alignment of sentence representations has mostly required bitexts to bridge the gap between languages. We investigate whether visual information can bridge this gap instead. Image caption datasets are very easy to create without requiring multilingual expertise, so this offers a more ef…