2026
Scaling Vision Transformers for Functional MRI with Flat Maps
Connor Lane, Ratna Grandhi, Leema Krishna Murali, Mihir Tripathy, Shamus Zi Yang Sim, Will Beddow +12
ICML 2026poster
We propose a simple strategy for training a foundation model on functional MRI (fMRI) data: we adapt the standard Vision Transformer to fMRI by first converting each 3D fMRI volume to a 2D map using a standard cortical flat map projection. We train spatiotemporal masked autoencoders (MAE) on 2.3K ho…