2022
An Empirical Analysis of Memorization in Fine-tuned Autoregressive Language Models
EMNLP 2022main
Large language models are shown to present privacy risks through memorization of training data, andseveral recent works have studied such risks for the pre-training phase. Little attention, however, has been given to the fine-tuning phase and it is not well understood how different fine-tuning metho…