← Search

Sahar Rajabi

2 accepted papers

2025

GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge Subtraction

ACL 2025short

Large language models (LLMs) often struggle with zero-shot generalization, and several modular approaches have been proposed to address this challenge. Yet, we hypothesize that a key limitation remains: the entanglement of general knowledge and task-specific adaptations. To overcome this, we propose…

2025

SubTrack++ : Gradient Subspace Tracking for Scalable LLM Training

NeurIPS 2025poster

Training large language models (LLMs) is highly resource-intensive due to their massive number of parameters and the overhead of optimizer states. While recent work has aimed to reduce memory consumption, such efforts often entail trade-offs among memory efficiency, training time, and model performa…

Cited by 0SourcecodeScholar