Wang Zhe Mark

Training Binary Neural Networks via Gaussian Variational Inference and Low-Rank Semidefinite Programming

Current methods for training Binarized Neural Networks (BNNs) heavily rely on the heuristic straight-through estimator (STE), which crucially enables the application of SGD-based optimizers to the combinatorial training problem. Although the STE heuristics and their variants have led to significant…