Ryan Solgi

Saten: Sparse Augmented Tensor Networks for Post-Training Compression of Large Language Models

The efficient implementation of large language models (LLMs) is crucial for deployment on resource-constrained devices. Low-rank tensor compression techniques, such as tensor-train (TT) networks, have been widely studied for over-parameterized neural networks. However, their applications to compress