← Search

Vijay Srinivas Agneeswaran

2 accepted papers

2025

SiMBA-TS: Simplified Channel Mixing and Mamba for Long-term Time Series Forecasting

ICASSP 2025accepted

We investigate the question of whether transformers are effective for long-term time series forecasting. They suffer from temporal information loss, even though they use positional encoding to embed order information. This is due to the inherent permutation-invariant nature of attention nets. Mamba…

Cited by 0SourceScholar
2023

Scattering Vision Transformer: Spectral Mixing Matters

NeurIPS 2023poster

Vision transformers have gained significant attention and achieved state-of-the-art performance in various computer vision tasks, including image classification, instance segmentation, and object detection. However, challenges remain in addressing attention complexity and effectively capturing fine-…