Lexuan Chen

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors

Foundation models have achieved tremendous success in different domains. However, their huge computation and storage complexity make these models difficult to fine-tune and also less applicable in practice. Recent study shows training in Fourier domain can be an effective fine-tuning method in terms