2024
Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Models
NAACL 2024long
We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable, making them difficult to directly DP-train with since common tech…