2021
SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning
ICLR 2021poster
Backward locking and update locking are well-known sources of inefficiency in backpropagation that prevent from concurrently updating layers. Several works have recently suggested using local error signals to train network blocks asynchronously to overcome these limitations. However, they often requ…