SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference
Modern large language models are increasingly deployed under compute and memory constraints, making flexible control of model capacity a central challenge. While sparse and low-rank structures naturally trade off capacity and performance, existing approaches often rely on heuristic designs that igno…