Zhenxuan Yu

Slender-Mamba: Fully Quantized Mamba in 1.58 Bits From Head to Toe

Large language models (LLMs) have achieved significant performance improvements in natural language processing (NLP) domain. However, these models often require large computational resources for training and inference. Recently, Mamba, a language model architecture based on State-Space Models (SSMs)…