← Search

Zac Hatfield-Dodds

2 accepted papers

2024

Towards Understanding Sycophancy in Language Models

ICLR 2024poster

Reinforcement learning from human feedback (RLHF) is a popular technique for training high-quality AI assistants. However, RLHF may also encourage model responses that match user beliefs over truthful responses, a behavior known as sycophancy. We investigate the prevalence of sycophancy in RLHF-trai…

2023

Discovering Language Model Behaviors with Model-Written Evaluations

ACL 2023findings

As language models (LMs) scale, they develop many novel behaviors, good and bad, exacerbating the need to evaluate how they behave. Prior work creates evaluations with crowdwork (which is time-consuming and expensive) or existing data sources (which are not always available). Here, we automatically…