Songhang Deng

DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models

Large language models have repeatedly shown outstanding performance across diverse applications. However, deploying these models can inadvertently risk user privacy. The significant memory demands during training pose a major challenge in terms of resource consumption. This substantial size places a…