Junseo Hwang

PiCa: Parameter-Efficient Fine-Tuning with Column Space Projection

Fine-tuning large foundation models is essential for building expert models tailored to specialized tasks and domains, but fully updating billions of parameters is computationally prohibitive. Reducing the number of trainable parameters using parameter-efficient fine-tuning is therefore crucial not…