Shike Li

CoFact: Dynamic Coordination of Attention Heads for Improving Factual Consistency in LLMs

Large language models (LLMs) frequently generate fluent yet factually inaccurate content, a phenomenon known as hallucination. Recent inference-time approaches aim to improve truthfulness by steering model activations toward semantically meaningful directions. While effective to some extent, these m