← Search

Howard Heaton

3 accepted papers

2022

JFB: Jacobian-Free Backpropagation for Implicit Networks

AAAI 2022technical

A promising trend in deep learning replaces traditional feedforward networks with implicit networks. Unlike traditional networks, implicit networks solve a fixed point equation to compute inferences. Solving for the fixed point varies in complexity, depending on provided data and an error tolerance.…

2021

Learning A Minimax Optimizer: A Pilot Study

ICLR 2021poster

Solving continuous minimax optimization is of extensive practical interest, yet notoriously unstable and difficult. This paper introduces the learning to optimize(L2O) methodology to the minimax problems for the first time and addresses its accompanying unique challenges. We first present Twin-L2O,…