2025
Let SSMs be ConvNets: State-space Modeling with Optimal Tensor Contractions
ICLR 2025spotlight
We introduce Centaurus, a class of networks composed of generalized state-space model (SSM) blocks, where the SSM operations can be treated as tensor contractions during training. The optimal order of tensor contractions can then be systematically determined for every SSM block to maximize training…