Zibin Lin

Fine-grained Pluggable Gradient Ascent for Knowledge Unlearning in Language Models

Pre-trained language models acquire knowledge from vast amounts of text data, which can inadvertently contain sensitive information. To mitigate the presence of undesirable knowledge, the task of knowledge unlearning becomes crucial for language models. Previous research relies on gradient ascent me…