← Search

Abu Sebastian

5 accepted papers

2026

A foundation model with multi-variate parallel attention to generate neuronal activity

ICLR 2026poster

Learning from multi-variate time-series with heterogeneous channel configurations remains a fundamental challenge for deep neural networks, particularly in clinical domains such as intracranial electroencephalography (iEEG), where channel setups vary widely across subjects. In this work, we introduc…

Cited by 0SourcecodeScholar
2025

Analog Foundation Models

NeurIPS 2025poster

Analog in-memory computing (AIMC) is a promising compute paradigm to improve speed and power efficiency of neural network inference beyond the limits of conventional von Neumann-based architectures. However, AIMC introduces fundamental challenges such as noisy computations and strict constraints on…

Cited by 0SourcecodeScholar
2025

On the Expressiveness and Length Generalization of Selective State Space Models on Regular Languages

AAAI 2025technical

Selective state-space models (SSMs) are an emerging alternative to the Transformer, offering the unique advantage of parallel training and sequential inference. Although these models have shown promising performance on a variety of tasks, their formal expressiveness and length generalization propert…

2023

MIMONets: Multiple-Input-Multiple-Output Neural Networks Exploiting Computation in Superposition

NeurIPS 2023poster

With the advent of deep learning, progressively larger neural networks have been designed to solve complex tasks. We take advantage of these capacity-rich models to lower the cost of inference by exploiting computation in superposition. To reduce the computational burden per input, we propose Multip…

2022

Constrained Few-Shot Class-Incremental Learning

CVPR 2022poster

Continually learning new classes from fresh data without forgetting previous knowledge of old classes is a very challenging research problem. Moreover, it is imperative that such learning must respect certain memory and computational constraints such as (i) training samples are limited to only a few…

Cited by 187PDFcodeScholar