← Search

João Sacramento

4 accepted papers

2022

Minimizing Control for Credit Assignment with Strong Feedback

ICML 2022spotlight

The success of deep learning ignited interest in whether the brain learns hierarchical representations using gradient-based learning. However, current biologically plausible methods for gradient-based credit assignment in deep neural networks need infinitesimally small feedback signals, which is pro…

2020

A Theoretical Framework for Target Propagation

NeurIPS 2020spotlight

The success of deep learning, a brain-inspired form of AI, has sparked interest in understanding how the brain could similarly learn across multiple layers of neurons. However, the majority of biologically-plausible learning algorithms have not yet reached the performance of backpropagation (BP), no…

2020

Continual learning with hypernetworks

ICLR 2020spotlight

Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. To overcome this problem, we present a novel approach based on task-conditioned hypernetworks, i.e., networks that generate the weights of a target model based on task identity. Conti…

Cited by 481SourcecodeScholar
2018

Dendritic cortical microcircuits approximate the backpropagation algorithm

NeurIPS 2018oral

Deep learning has seen remarkable developments over the last years, many of them inspired by neuroscience. However, the main learning mechanism behind these advances – error backpropagation – appears to be at odds with neurobiology. Here, we introduce a multilayer neuronal network model with simplif…

Cited by 395SourcePDFScholar