Arya Honarpisheh

Generalization Error Analysis for Selective State-Space Models Through the Lens of Attention

State-space models (SSMs) have recently emerged as a compelling alternative to Transformers for sequence modeling tasks. This paper presents a theoretical generalization analysis of selective SSMs, the core architectural component behind the Mamba model. We derive a novel covering number-based gener…