2025
Dobi-SVD: Differentiable SVD for LLM Compression and Some New Perspectives
ICLR 2025poster
Large language models (LLMs) have sparked a new wave of AI applications; however, their substantial computational costs and memory demands pose significant challenges to democratizing access to LLMs for a broader audience. Singular Value Decomposition (SVD), a technique studied for decades, offers a…