← Search

Axel Laborieux

3 accepted papers

2024

Improving equilibrium propagation without weight symmetry through Jacobian homeostasis

ICLR 2024poster

Equilibrium propagation (EP) is a compelling alternative to the back propagation of error algorithm (BP) for computing gradients of neural networks on biological or analog neuromorphic substrates. Still, the algorithm requires weight symmetry and infinitesimal equilibrium perturbations, i.e., nudge…

2023

Implicit variance regularization in non-contrastive SSL

NeurIPS 2023poster

Non-contrastive SSL methods like BYOL and SimSiam rely on asymmetric predictor networks to avoid representational collapse without negative samples. Yet, how predictor networks facilitate stable learning is not fully understood. While previous theoretical analyses assumed Euclidean losses, most prac…

2022

Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillations

NeurIPS 2022accept

Equilibrium propagation (EP) is an alternative to backpropagation (BP) that allows the training of deep neural networks with local learning rules. It thus provides a compelling framework for training neuromorphic systems and understanding learning in neurobiology. However, EP requires infinitesimal…