← Search

Jan M Brauner

2 accepted papers

2024

How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions

ICLR 2024poster

Large language models (LLMs) can “lie”, which we define as outputting false statements when incentivised to, despite “knowing” the truth in a demonstrable sense. LLMs might “lie”, for example, when instructed to output misinformation. Here, we develop a simple lie detector that requires neither acce…

2022

Prioritized Training on Points that are Learnable, Worth Learning, and not yet Learnt

ICML 2022spotlight

Training on web-scale data can take months. But much computation and time is wasted on redundant and noisy points that are already learnt or not learnable. To accelerate training, we introduce Reducible Holdout Loss Selection (RHO-LOSS), a simple but principled technique which selects approximately…