Baek Seong-Eun

A Language-Guided Bayesian Optimization for Efficient LoRA Hyperparameter Search

Fine-tuning Large Language Models (LLMs) with Low-Rank Adaptation (LoRA) offers a resource-efficient way to personalize or specialize. However, LoRA is highly sensitive to hyperparameter choices, and performing an exhaustive hyperparameter search remains computationally intensive. To address these c…