← Search

Ben Sorscher

4 accepted papers

2022

A theory of weight distribution-constrained learning

NeurIPS 2022accept

A central question in computational neuroscience is how structure determines function in neural networks. Recent large-scale connectomic studies have started to provide a wealth of structural information such as the distribution of excitatory/inhibitory cell and synapse types as well as the distribu…

Cited by 3SourcePDFScholar
2022

Beyond neural scaling laws: beating power law scaling via data pruning

NeurIPS 2022accept

Widely observed neural scaling laws, in which error falls off as a power of the training set size, model size, or both, have driven substantial performance improvements in deep learning. However, these improvements through scaling alone require considerable costs in compute and energy. Here we focus…

2021

Explaining heterogeneity in medial entorhinal cortex with task-driven neural networks

NeurIPS 2021spotlight

Medial entorhinal cortex (MEC) supports a wide range of navigational and memory related behaviors. Well-known experimental results have revealed specialized cell types in MEC --- e.g. grid, border, and head-direction cells --- whose highly stereotypical response profiles are suggestive of the role t…

2019

A unified theory for the origin of grid cells through the lens of pattern formation

NeurIPS 2019spotlight

Grid cells in the brain fire in strikingly regular hexagonal patterns across space. There are currently two seemingly unrelated frameworks for understanding these patterns. Mechanistic models account for hexagonal firing fields as the result of pattern-forming dynamics in a recurrent neural network…