← Search

Gagik Magakyan

2 accepted papers

2026

Collaborative and Efficient Fine-tuning: Leveraging Task Similarity

ICML 2026poster

*Adaptability* has been regarded as a central feature in the foundation models, enabling them to effectively acclimate to unseen downstream tasks. Parameter-efficient fine-tuning methods such as celebrated LoRA facilitate efficient adaptation of large foundation models using labeled, high-quality an…

Cited by 0SourceScholar
2025

General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization

ICML 2025oral

This work investigates the effectiveness of schedule-free methods, developed by A. Defazio et al. (NeurIPS 2024), in nonconvex optimization settings, inspired by their remarkable empirical success in training neural networks. Specifically, we show that schedule-free SGD achieves optimal iteration co…

Cited by 1SourcePDFScholar