2025
dEBORA: Efficient Bilevel Optimization-based low-Rank Adaptation
ICLR 2025poster
Low-rank adaptation methods are a popular approach for parameter-efficient fine-tuning of large-scale neural networks. However, selecting the optimal rank for each layer remains a challenging problem that significantly affects both performance and efficiency. In this paper, we introduce a novel bile…