2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness
EMNLP 2023long findings
In recent years, Pre-trained Language Models (PLMs) have shown their superiority by pre-training on unstructured text corpus and then fine-tuning on downstream tasks. On entity-rich textual resources like Wikipedia, Knowledge-Enhanced PLMs (KEPLMs) incorporate the interactions between tokens and men…