← Search

Clemencia Siro

3 accepted papers

2024

AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages

NAACL 2024long

Despite the recent progress on scaling multilingual machine translation (MT) to several under-resourced African languages, accurately measuring this progress remains challenging, since evaluation is often performed on n-gram matching metrics such as BLEU, which typically show a weaker correlation wi…

2024

Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems

NAACL 2024findings

Crowdsourced labels play a crucial role in evaluating task-oriented dialogue systems (TDSs). Obtaining high-quality and consistent ground-truth labels from annotators presents challenges. When evaluating a TDS, annotators must fully comprehend the dialogue before providing judgments. Previous studie…

2023

Cross-lingual Open-Retrieval Question Answering for African Languages

EMNLP 2023long findings

African languages have far less in-language content available digitally, making it challenging for question answering systems to satisfy the information needs of users. Cross-lingual open-retrieval question answering (XOR QA) systems -- those that retrieve answer content from other languages while s…

Cited by 0SourceScholar