Daeyoung Hong

DP-FROST: Differentially Private Fine-tuning of Pre-trained Models with Freezing Model Parameters

Training models with differential privacy has received a lot of attentions since differential privacy provides theoretical guarantee of privacy preservation. For a task in a specific domain, since a large-scale pre-trained model in the same domain contains general knowledge of the task, using such a…