← Search

David Kappel

3 accepted papers

2023

Efficient recurrent architectures through activity sparsity and sparse back-propagation through time

ICLR 2023top-25%

Recurrent neural networks (RNNs) are well suited for solving sequence tasks in resource-constrained systems due to their expressivity and low computational requirements. However, there is still a need to bridge the gap between what RNNs are capable of in terms of efficiency and performance and real…

2018

Deep Rewiring: Training very sparse deep networks

ICLR 2018poster

Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently for sparse networks. Several methods exist for pruning connections of a neural network after it was t…

Cited by 352SourcePDFScholar
2015

Synaptic Sampling: A Bayesian Approach to Neural Network Plasticity and Rewiring

NeurIPS 2015poster

We reexamine in this article the conceptual and mathematical framework for understanding the organization of plasticity in spiking neural networks. We propose that inherent stochasticity enables synaptic plasticity to carry out probabilistic inference by sampling from a posterior distribution of syn…

Cited by 29SourcePDFScholar