ElMoatez Billah Nagoudi

ORCA: A Challenging Benchmark for Arabic Language Understanding

Due to the crucial role pretrained language models play in modern NLP, several benchmarks have been proposed to evaluate their performance. In spite of these efforts, no public benchmark of diverse nature currently exists for evaluating Arabic NLU. This makes it challenging to measure progress for b…