Dongjin Park

Powerformer: Efficient and High-Accuracy Privacy-Preserving Language Model with Homomorphic Encryption

We propose Powerformer, an efficient homomorphic encryption (HE)-based privacy-preserving language model (PPLM) designed to reduce computation overhead while maintaining model performance. Powerformer incorporates three key techniques to optimize encrypted computations:1. A novel distillation techni…