2023
LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing
ACL 2023findings
Transformer has become an important technique for natural language processing tasks with great success. However, it usually requires huge storage space and computational cost, making it difficult to be deployed on resource-constrained edge devices. To compress and accelerate Transformer, we propose…