2024
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study
COLING 2024main
Previous work has showcased the intriguing capability of large language models (LLMs) in retrieving facts and processing context knowledge. However, only limited research exists on the layer-wise capability of LLMs to encode knowledge, which challenges our understanding of their internal mechanisms.…