Rasmus Kjær Høier

AdaSTE: An Adaptive Straight-Through Estimator To Train Binary Neural Networks

We propose a new algorithm for training deep neural networks (DNNs) with binary weights. In particular, we first cast the problem of training binary neural networks (BiNNs) as a bilevel optimization instance and subsequently construct flexible relaxations of this bilevel program. The resulting train…