2022
SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models
ICLR 2022spotlight
In recent years, implicit deep learning has emerged as a method to increase the depth of deep neural networks. While their training is memory-efficient, they are still significantly slower to train than their explicit counterparts. In Deep Equilibrium Models~(DEQs), the training is performed as a bi…