← Search

Alireza Mohammadshahi

3 accepted papers

2023

RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question

ACL 2023findings

Existing metrics for evaluating the quality of automatically generated questions such as BLEU, ROUGE, BERTScore, and BLEURT compare the reference and predicted questions, providing a high score when there is a considerable lexical overlap or semantic similarity between the candidate and the referenc…

2022

SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages

EMNLP 2022main

In recent years, multilingual machine translation models have achieved promising performance on low-resource language pairs by sharing information between similar languages, thus enabling zero-shot translation. To overcome the “curse of multilinguality”, these models often opt for scaling up the num…

2022

What Do Compressed Multilingual Machine Translation Models Forget?

EMNLP 2022finding

Recently, very large pre-trained models achieve state-of-the-art results in various natural language processing (NLP) tasks, but their size makes it more challenging to apply them in resource-constrained environments. Compression techniques allow to drastically reduce the size of the models and ther…