2025
Trained Mamba Emulates Online Gradient Descent in In-Context Linear Regression
NeurIPS 2025poster
State-space models (SSMs), particularly Mamba, emerge as an efficient Transformer alternative with linear complexity for long-sequence modeling. Recent empirical works demonstrate Mamba's in-context learning (ICL) capabilities competitive with Transformers, a critical capacity for large foundation m…