← Search

Nathan Helm-Burger

3 accepted papers

2025

CoT Red-Handed: Stress Testing Chain-of-Thought Monitoring

NeurIPS 2025poster

As AI models are deployed with increasing autonomy, it is important to ensure they do not take harmful actions unnoticed. As a potential mitigation, we investigate Chain-of-Thought (CoT) monitoring, wherein a weaker trusted monitor model continuously oversees the intermediate reasoning steps of a mo…

Cited by 0SourceScholar
2025

Noise Injection Reveals Hidden Capabilities of Sandbagging Language Models

NeurIPS 2025poster

Capability evaluations play a crucial role in assessing and regulating frontier AI systems. The effectiveness of these evaluations faces a significant challenge: strategic underperformance, or ``sandbagging'', where models deliberately underperform during evaluation. Sandbagging can manifest either…

Cited by 0SourcecodeScholar
2024

The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning

ICML 2024poster

The White House Executive Order on Artificial Intelligence highlights the risks of large language models (LLMs) empowering malicious actors in developing biological, cyber, and chemical weapons. To measure these risks, government institutions and major AI labs are developing evaluations for hazardou…

Cited by 145SourcePDFScholar