← Search

Hailiang Liu

3 accepted papers

2025

Global Convergence in Neural ODEs: Impact of Activation Functions

ICLR 2025oral

Neural Ordinary Differential Equations (ODEs) have been successful in various applications due to their continuous nature and parameter-sharing efficiency. However, these unique characteristics also introduce challenges in training, particularly with respect to gradient computation accuracy and conv…

Cited by 0SourcePDFScholar
2023

Wide Neural Networks as Gaussian Processes: Lessons from Deep Equilibrium Models

NeurIPS 2023poster

Neural networks with wide layers have attracted significant attention due to their equivalence to Gaussian processes, enabling perfect fitting of training data while maintaining generalization performance, known as benign overfitting. However, existing results mainly focus on shallow or finite-depth…

Cited by 9SourcePDFScholar
2022

A global convergence theory for deep ReLU implicit networks via over-parameterization

ICLR 2022poster

Implicit deep learning has received increasing attention recently due to the fact that it generalizes the recursive prediction rule of many commonly used neural network architectures. Its prediction rule is provided implicitly based on the solution of an equilibrium equation. Although a line of rece…

Cited by 22SourcePDFScholar