Haiyue Zhang

Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework

Pre-trained language models (PLMs) are widely used in NLP but struggle with capturing entity knowledge. To address this, knowledge enhancement techniques have been proposed. However, existing methods rely heavily on external knowledge bases embedding and often introduce noisy entity representations.…