← Search

Mengqi Li

2 accepted papers

2026

FRACTAL: State Space Model with Fractional Recurrent Architecture for Computational Temporal Analysis of Long Sequences

ICML 2026poster

Effective sequence modeling fundamentally requires balancing the retention of unbounded history with the high-resolution detection of abrupt short-term variations common in real-world phenomena. However, existing state space models (SSMs) relying on high-order polynomial projection operators (HiPPO)…

Cited by 0SourceScholar
2025

StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs

NeurIPS 2025poster

Training language models on long sequence data is a demanding requirement for enhancing the model's capability on complex tasks, e.g., long-chain reasoning. However, as the sequence length scales up, the memory cost for storing activation values becomes huge during the Backpropagation (BP) process,…

Cited by 3SourcecodeScholar