2026
A Language-Guided Bayesian Optimization for Efficient LoRA Hyperparameter Search
ICML 2026poster
Fine-tuning Large Language Models (LLMs) with Low-Rank Adaptation (LoRA) offers a resource-efficient way to personalize or specialize. However, LoRA is highly sensitive to hyperparameter choices, and performing an exhaustive hyperparameter search remains computationally intensive. To address these c…