← Search

Jacob Gates Foster

2 accepted papers

2025

Position: Principles of Animal Cognition to Improve LLM Evaluations

ICML 2025oral

It has become increasingly challenging to understand and evaluate LLM capabilities as these models exhibit a broader range of behaviors. In this position paper, we argue that LLM researchers should draw on the lessons from another field which has developed a rich set of experimental paradigms and de…

Cited by 0SourcePDFScholar
2021

Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research

NeurIPS 2021poster

Benchmark datasets play a central role in the organization of machine learning research. They coordinate researchers around shared research problems and serve as a measure of progress towards shared goals. Despite the foundational role of benchmarking practices in this field, relatively little atte…

Cited by 176SourceScholar