← Search

Alex Hanna

2 accepted papers

2021

AI and the Everything in the Whole Wide World Benchmark

NeurIPS 2021poster

There is a tendency across different subfields in AI to see value in a small collection of influential benchmarks, which we term 'general' benchmarks. These benchmarks operate as stand-ins or abstractions for a range of anointed common problems that are frequently framed as foundational milestones o…

Cited by 344SourceScholar
2021

Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research

NeurIPS 2021poster

Benchmark datasets play a central role in the organization of machine learning research. They coordinate researchers around shared research problems and serve as a measure of progress towards shared goals. Despite the foundational role of benchmarking practices in this field, relatively little atte…

Cited by 176SourceScholar