Deyi Zhang

DR-Encoder: Encode Low-rank Gradients with Random Prior for Large Language Models Differentially Privately

The emergence of the large language model (LLM) has shown its superiority in a wide range of disciplines, including language understanding and translation, relational logic reasoning, and even partial differential equations solving. The transformer is the pervasive backbone architecture for the foun…