2025
Exploring the Limitations of Mamba in COPY and CoT Reasoning
EMNLP 2025
Transformers have become the backbone of modern Large Language Models (LLMs); however, their inference overhead grows linearly with the sequence length, posing challenges for modeling long sequences. In light of this, Mamba has attracted attention for maintaining a constant inference size, with empi