2026
Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations
ICML 2026poster
This paper studies the gradient flow dynamics that arise when training deep homogeneous neural networks assumed to have locally Lipschitz gradients and an order of homogeneity strictly greater than two. It is shown here that for sufficiently small initializations, during the early stages of training…