Ryan M.C. Law

Position: Principles of Animal Cognition to Improve LLM Evaluations

It has become increasingly challenging to understand and evaluate LLM capabilities as these models exhibit a broader range of behaviors. In this position paper, we argue that LLM researchers should draw on the lessons from another field which has developed a rich set of experimental paradigms and de…