2026
Log-Normal Multiplicative Dynamics for Stable Low-Precision Deep Learning
ICML 2026poster
We propose a new algorithm enabling stable training under low-precision computations. We call this algorithm Log-normal Multiplicative Dynamics (LMD), and derive it by taking inspiration from the robustness of biological neural networks. Such networks use synapses whose size follow log-normal distri…