Chi Zhang*

An Optimal Control View of LoRA and Binary Controller Design for Vision Transformers

"While recent advancements in model fine-tuning predominantly emphasize the utilization of low-rank adaptation (LoRA), we propose an alternative approach centered on reducing the precision of adaptation matrices. In particular, we depart from the common viewpoint that considers adaptation matrices s…