Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation
In tasks such as summarization and open-book question answering (QA), Large Language Models (LLMs) frequently experience “contextual hallucination”, where they generate irrelevant or incorrect responses despite having access to accurate information in the input. This issue often stems from the model…