Michal P. Karpowicz

Representation-based Broad Hallucination Detectors Fail to Generalize Out of Distribution

We critically assess the efficacy of the current SOTA in hallucination detection and find that its performance on the RAGTruth dataset is largely driven by a spurious correlation with data. Controlling for this effect, state-of-the-art performs no better than supervised linear probes, while requirin