← Search

Israel Abebe Azime

10 accepted papers

2025

AFRIDOC-MT: Document-level MT Corpus for African Languages

EMNLP 2025

This paper introduces AFRIDOC-MT, a document-level multi-parallel translation dataset covering English and five African languages: Amharic, Hausa, Swahili, Yorùbá, and Zulu. The dataset comprises 334 health and 271 information technology news documents, all human-translated from English to these lan

2025

Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches

EMNLP 2025

Large Language Models (LLMs) are increasingly employed in high-stakes decision-making tasks, such as loan approvals. While their applications expand across domains, LLMs struggle to process tabular data, ensuring fairness and delivering reliable predictions. In this work, we assess the performance a

Cited by 0SourcePDFScholar
2025

AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text

EMNLP 2025

Language models built from various sources are the foundation of today’s NLP progress. However, for many low-resource languages, the diversity of domains is often limited, more biased to a religious domain, which impacts their performance when evaluated on distant and rapidly evolving domains such a

Cited by 0SourcePDFScholar
2025

CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation

EMNLP 2025

Translating cultural content poses challenges for machine translation systems due to the differences in conceptualizations between cultures, where language alone may fail to convey sufficient context to capture region-specific meanings. In this work, we investigate whether images can act as cultural

2025

Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understanding

COLING 2025main

Large Language Models (LLMs) show promising learning and reasoning abilities. Compared to other NLP tasks, multilingual and multi-label emotion evaluation tasks are under-explored in LLMs. In this paper, we present EthioEmo, a multi-label emotion classification dataset for four Ethiopian languages,…

2025

INJONGO: A Multicultural Intent Detection and Slot-filling Dataset for 16 African Languages

ACL 2025long

Slot-filling and intent detection are well-established tasks in Conversational AI. However, current large-scale benchmarks for these tasks often exclude evaluations of low-resource languages and rely on translations from English benchmarks, thereby predominantly reflecting Western-centric concepts.…

Cited by 0SourcePDFScholar
2025

IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

NAACL 2025long

Despite the widespread adoption of Large language models (LLMs), their remarkable capabilities remain limited to a few high-resource languages. Additionally, many low-resource languages (e.g. African languages) are often evaluated only on basic text classification tasks due to the lack of appropriat…

2024

CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark

NeurIPS 2024oral

Visual Question Answering~(VQA) is an important task in multimodal AI, which requires models to understand and reason on knowledge present in visual and textual data. However, most of the current VQA datasets and models are primarily focused on English and a few major world languages, with images th…

Cited by 34SourcePDFScholar
2024

EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluation

COLING 2024main

Large language models (LLMs) have gained popularity recently due to their outstanding performance in various downstream Natural Language Processing (NLP) tasks. However, low-resource languages are still lagging behind current state-of-the-art (SOTA) developments in the field of NLP due to insufficie…

2024

Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasets

EMNLP 2024finding

Large language models (LLMs) have received a lot of attention in natural language processing (NLP) research because of their exceptional performance in understanding and generating human languages. However, low-resource languages are left behind due to the unavailability of resources. In this work,…