← Search

Abdelrahman Sadallah

3 accepted papers

2025

Commonsense Reasoning in Arab Culture

ACL 2025long

Despite progress in Arabic large language models, such as Jais and AceGPT, their evaluation on commonsense reasoning has largely relied on machine-translated datasets, which lack cultural depth and may introduce Anglocentric biases. Commonsense reasoning is shaped by geographical and cultural contex…

Cited by 0SourcePDFScholar
2025

What Makes Cryptic Crosswords Challenging for LLMs?

COLING 2025main

Cryptic crosswords are puzzles that rely on general knowledge and the solver’s ability to manipulate language on different levels, dealing with various types of wordplay. Previous research suggests that solving such puzzles is challenging even for modern NLP models, including Large Language Models (…

2024

ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic

ACL 2024findings

The focus of language model evaluation has transitioned towards reasoning and knowledge-intensive tasks, driven by advancements in pretraining large models. While state-of-the-art models are partially trained on large Arabic texts, evaluating their performance in Arabic remains challenging due to th…