Position: Anthropomorphic Misalignment Research Needs Stronger Evidence
Vansh Gupta, Peter Nutter, Samuel Stante, Andreas Krause, Florian Tramer, Lukas Fluri, Xin Chen, Anna Hedström
Abstract
We argue that many Anthropomorphized Misalignment Research (AMR) studies need stronger evidence to ensure that they can provide a robust foundation for critical safety decisions, such as model deployment and regulation. By evaluating failure modes across different misalignment concepts, such as deception, emergent misalignment, and sycophancy, we show how conceptual ambiguity, non-robust datasets and experimental design, and insufficient causal interventions can lead to overinterpretation of model behaviors. This position paper aims to offer guidance on evidentiary considerations that can help improve methodological rigor in AMR. To achieve this, we provide a clear call to action through a proposed framework of evidence levels and a diagnostic checklist. These shared standards will enable more productive scientific discourse and ensure that claims about AI risks rest on solid empirical foundations.
BibTeX
@inproceedings{icml2026_positionanthropo,
title = {Position: Anthropomorphic Misalignment Research Needs Stronger Evidence},
author = {Vansh Gupta and Peter Nutter and Samuel Stante and Andreas Krause and Florian Tramer and Lukas Fluri and Xin Chen and Anna Hedström},
booktitle = {ICML 2026},
year = {2026}
}