2022
A Combinatorial Perspective on the Optimization of Shallow ReLU Networks
NeurIPS 2022accept
The NP-hard problem of optimizing a shallow ReLU network can be characterized as a combinatorial search over each training example’s activation pattern followed by a constrained convex problem given a fixed set of activation patterns. We explore the implications of this combinatorial aspect of ReLU…