Elia Onofri

A Geometric Analysis of Small-sized Language Model Hallucinations

Hallucinations---fluent but factually incorrect responses---pose a major challenge to the reliability of language models, especially in multi-step or agentic settings. This work investigates hallucinations in small-sized LLMs through a geometric perspective, starting from the hypothesis that when mo…