Abhinav Palia

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming

In this position paper we argue that conclusions drawn about relative system safety or attack method efficacy via AI red teaming are often not supported by evidence provided by attack success rate (ASR) comparisons. We show, through conceptual, theoretical, and empirical contributions, that many c…