← Search

Viresh Pati

2 accepted papers

2026

StretchTime: Adaptive Time Series Forecasting via Symplectic Attention

ICML 2026poster

Transformer architectures have established strong baselines in time series forecasting, yet they typically rely on positional encodings that assume uniform, index-based temporal progression. However, real-world systems, from shifting financial cycles to elastic biological rhythms, frequently exhibit…

Cited by 0SourceScholar
2025

ZeroS: Zero‑Sum Linear Attention for Efficient Transformers

NeurIPS 2025spotlight

Linear attention methods offer Transformers $O(N)$ complexity but typically underperform standard softmax attention. We identify two fundamental limitations affecting these approaches: the restriction to convex combinations that only permits additive information blending, and uniform accumulated wei…

Cited by 0SourceScholar