Shaoyang Song

2 accepted papers

2024

Generate Synthetic Text Approximating the Private Distribution with Differential Privacy

Wenhao Zhao, Shaoyang Song, Chunlai Zhou

IJCAI 2024poster

Due to the potential leakage of sensitive information in text, there is a societal call for feeding privacy-preserving text to model training. Recently, a lot of work showed that using synthetic text with differential privacy, rather than private text, can provide a strong privacy protection. Howeve…

Cited by 1 Source ↗PDF ↗Scholar ↗

2024

Locally Differentially Private In-Context Learning

Chunyan Zheng, Keke Sun, Wenhao Zhao, Haibo Zhou, Lixing Jiang, Shaoyang Song +1

COLING 2024main

Large pretrained language models (LLMs) have shown surprising In-Context Learning (ICL) ability. An important application in deploying large language models is to augment LLMs with a private database for some specific task.The main problem with this promising commercial use is that LLMs have been sh…

Cited by 3 Source ↗PDF ↗Scholar ↗