Tiancan Feng

LAVA: A Unified Framework for Finetuning Language and Vision Models

LoRA and its variants have attracted considerable attention because of their abilities to tune a negligible number of parameters while achieving comparable downstream performance. This success is largely attributed to the intrinsic low-rank structure of model parameter spaces, which allows LoRA to t…