Kaivalya Hariharan — accepted AI-conference papers

2024

Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMs

Rudolf Laine, Bilal Chughtai, Jan Betley, Kaivalya Hariharan, Mikita Balesni, Jérémy Scheurer +3

NeurIPS 2024poster

AI assistants such as ChatGPT are trained to respond to users by saying, "I am a large language model”. This raises questions. Do such models "know'' that they are LLMs and reliably act on this knowledge? Are they "aware" of their current circumstances, such as being deployed to the public? We refer…

Cited by 25 Source ↗PDF ↗code ↗Scholar ↗

2023

Red Teaming Deep Neural Networks with Feature Synthesis Tools

Stephen Casper, Tong Bu, Yuxiao Li, Jiawei Li, Kevin Zhang, Kaivalya Hariharan +1

NeurIPS 2023poster

Interpretable AI tools are often motivated by the goal of understanding model behavior in out-of-distribution (OOD) contexts. Despite the attention this area of study receives, there are comparatively few cases where these tools have identified previously unknown bugs in models. We argue that this i…

Cited by 24 Source ↗PDF ↗code ↗Scholar ↗