Tianqiang Yan

Entrospect: Information-Theoretic Self-Reflection Elicits Better Response Refinement of Small Language Models

Self-reflection helps de-hallucinate Large Language Models (LLMs). However, the effectiveness of self-reflection remains insufficiently validated in the context of Small Language Models (SLMs), which exhibit limited semantic capacities. In particular, we demonstrate that the conventional self-reflec…