Gianna Leoni

Fit for our purpose, not yours: Benchmark for a low-resource, Indigenous language

Influential and popular benchmarks in AI are largely irrelevant to developing NLP tools for low-resource, Indigenous languages. With the primary goal of measuring the performance of general-purpose AI systems, these benchmarks fail to give due consideration and care to individual language communitie…