← Search

Sourav Pal

6 accepted papers

2026

MnemoDyn: Learning Resting State Dynamics from $40$K FMRI sequences

ICLR 2026poster

We present a dynamical-systems based model for resting-state functional magnetic resonance imaging (rs-fMRI), trained on a dataset of roughly $40$K rs-fMRI sequences covering a wide variety of public and available-by-permission datasets. While most existing proposals use transformer backbones, we u…

Cited by 0SourceScholar
2024

Implicit Representations via Operator Learning

ICML 2024poster

The idea of representing a signal as the weights of a neural network, called *Implicit Neural Representations* (INRs), has led to exciting implications for compression, view synthesis and 3D volumetric data understanding. One problem in this setting pertains to the use of INRs for downstream process…

2023

Controlled Differential Equations on Long Sequences via Non-standard Wavelets

ICML 2023poster

Neural Controlled Differential equations (NCDE) are a powerful mechanism to model the dynamics in temporal sequences, e.g., applications involving physiological measures, where apart from the initial condition, the dynamics also depend on subsequent measures or even a different "control" sequence. B…

Cited by 2SourcePDFScholar
2022

Deep Unlearning via Randomized Conditionally Independent Hessians

CVPR 2022poster

Recent legislation has led to interest in machine unlearning, i.e., removing specific training samples from a predictive model as if they never existed in the training dataset. Unlearning may also be required due to corrupted/adversarial data or simply a user's updated privacy requirement. For model…

Cited by 100PDFcodeScholar
2022

Multi Resolution Analysis (MRA) for Approximate Self-Attention

ICML 2022spotlight

Transformers have emerged as a preferred model for many tasks in natural langugage processing and vision. Recent efforts on training and deploying Transformers more efficiently have identified many strategies to approximate the self-attention matrix, a key module in a Transformer architecture. Effec…