← Search

Timoleon Moraitis

4 accepted papers

2023

Hebbian Deep Learning Without Feedback

ICLR 2023top-25%

Recent approximations to backpropagation (BP) have mitigated many of BP's computational inefficiencies and incompatibilities with biology, but important limitations still remain. Moreover, the approximations significantly decrease accuracy in benchmarks, suggesting that an entirely different approac…

2022

Short-Term Plasticity Neurons Learning to Learn and Forget

ICML 2022spotlight

Short-term plasticity (STP) is a mechanism that stores decaying memories in synapses of the cerebral cortex. In computing practice, STP has been used, but mostly in the niche of spiking neurons, even though theory predicts that it is the optimal solution to certain dynamic tasks. Here we present a n…

2022

Spike-inspired rank coding for fast and accurate recurrent neural networks

ICLR 2022spotlight

Biological spiking neural networks (SNNs) can temporally encode information in their outputs, e.g. in the rank order in which neurons fire, whereas artificial neural networks (ANNs) conventionally do not. As a result, models of SNNs for neuromorphic computing are regarded as potentially more rapid a…