Marcello Hasegawa

Privacy Regularization: Joint Privacy-Utility Optimization in LanguageModels

Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy im- plications when training models on user content such as email correspondence. Differential privacy (DP), a popular choice to train models with privacy guarantees, comes wi…