Ryan Steed — accepted AI-conference papers

2026

Expanding the AI Evaluation Toolbox with Statistical Models

Drew Keller, Kweku Kwegyir-Aggrey, Ryan Steed, Anita Rao, Julia Sharp, A. Bergman

ICML 2026poster

Benchmarks are widely used to evaluate and compare the performance of artificial intelligence systems. However, some approaches to computing benchmark metrics produce invalid uncertainty estimates or make unrecognized assumptions about the evaluation setting. We leverage statistical modeling to make…

Cited by 0 Source ↗Scholar ↗

2022

Upstream Mitigation Is Not All You Need: Testing the Bias Transfer Hypothesis in Pre-Trained Language Models

Ryan Steed, Swetasudha Panda, Ari Kobren, Michael Wick

ACL 2022long

A few large, homogenous, pre-trained models undergird many machine learning systems — and often, these models contain harmful stereotypes learned from the internet. We investigate the bias transfer hypothesis: the theory that social biases (such as stereotypes) internalized by large language models…

Cited by 92 Source ↗PDF ↗Scholar ↗