Mohammad Akbar-Tajari

Stochastic Fine-Tuning of Language Models Using Masked Gradients

Large Language Models (LLMs) have emerged as the dominant paradigm in Natural Language Processing owing to their remarkable performance across various target tasks. However, naively fine-tuning them for specific downstream tasks often requires updating a vast number of parameters, resulting in high…