← Search

Mohammadreza Banaei

2 accepted papers

2023

Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention

EMNLP 2023long findings

In this work, we study whether multilingual language models (MultiLMs) can transfer logical reasoning abilities to other languages when they are fine-tuned for reasoning in a different language. We evaluate the cross-lingual reasoning abilities of MultiLMs in two schemes: (1) where the language of t…

Cited by 0SourcecodeScholar
2022

Discovering Language-neutral Sub-networks in Multilingual Language Models

EMNLP 2022main

Multilingual pre-trained language models transfer remarkably well on cross-lingual downstream tasks. However, the extent to which they learn language-neutral representations (i.e., shared representations that encode similar phenomena across languages), and the effect of such representations on cross…