From Flat Facts to Sharp Hallucinations: Detecting Stubborn Errors via Gradient Sensitivity
Liew Yee Zhing, Andrew Tan, Anwar Majeed
Abstract
Traditional hallucination detection fails on "Stubborn Hallucinations"—errors where LLMs are confidently wrong. We propose a geometric solution: Embedding-Perturbed Gradient Sensitivity (EPGS). We hypothesize that while robust facts reside in flat minima, stubborn hallucinations sit in sharp minima, supported by brittle memorization. EPGS detects this sharpness by perturbing input embeddings with Gaussian noise and measuring the resulting spike in gradient magnitude. This acts as an efficient proxy for the Hessian spectrum, differentiating stable knowledge from unstable memorization. Our experiments show that EPGS significantly outperforms entropy-based and representation-based baselines, providing a robust signal for detecting high-confidence factual errors.
BibTeX
@inproceedings{
zhing2026from,
title={From Flat Facts to Sharp Hallucinations: Detecting Stubborn Errors via Gradient Sensitivity},
author={Liew Yee Zhing and Andrew Huey Ping Tan and Anwar P.P. Abdul Majeed},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=hQYbnNccMq}
}