Exploring Geometric Representational Disparities between Multilingual and Bilingual Translation Models
Multilingual machine translation has proven immensely useful for both parameter efficiency and overall performance across many language pairs via complete multilingual parameter sharing. However, some language pairs in multilingual models can see worse performance than in bilingual models, especiall…