Exploiting Contextual Knowledge in LLMs through 𝒱-usable Information based Layer Enhancement
Large Language Models (LLMs) have demonstrated remarkable capabilities in various tasks, yet they often struggle with context-faithfulness generations that properly reflect contextual knowledge. While existing approaches focus on enhancing the decoding strategies, they ignore the fundamental mechani…