Erik Brinkman

Automated Red Teaming with GOAT: the Generative Offensive Agent Tester

Red teaming aims to assess how large language models (LLMs) can produce content that violates norms, policies, and rules set forth during their safety training. However, most existing automated methods in literature are not representative of the way common users exploit the multi-turn conversational…