JiqunChu JiqunChu

Incorporating Exponential Smoothing into MLP: a Simple but Effective Sequence Model

Modeling long-range dependencies in sequential data is a crucial step in sequence learning. A recently developed model, the Structured State Space (S4), demonstrated significant effectiveness in modeling long-range sequences. However, It is unclear whether the success of S4 can be attributed to its…