Carla Troper

Position: Stop Using Culturally Biased Human Cognitive Benchmarks to Evaluate LLMs

Recent work uses human cognitive benchmarks to evaluate how LLMs represent concepts, claiming to assess "human-like" understanding. This position paper argues that this approach is misguided: these benchmarks come from narrow, typically Western populations yet are treated as universal standards, des…