Hanyun Yin

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Fine-tuning is essential to adapting pre-trained large language models to downstream applications. With the increasing popularity of LLM-enabled applications, fine-tuning has been performed intensively worldwide, incurring a tremendous amount of computing costs that correspond to big carbon footprin…