Rushil Thareja

DP-Fusion: Token-Level Differentially Private Inference for Large Language Models

Large language models (LLMs) do not preserve privacy at inference-time. The LLM's outputs can inadvertently reveal information about the model's context, which presents a privacy challenge when the LLM is augmented via tools or databases containing sensitive information. Existing privacy-preserving…