2025
DPED: Multi-Layer Noise Distillation for Privacy-Preserving Text Embeddings
EMNLP 2025
Training text embedding models under differential privacy constraints is challenging due to the high dimensionality of language data and the presence of rare, identifying linguistic features. We propose (Differentially Private Embedding Distillation), a framework that leverages teacher-student disti