← Search

Chenghan Xie

3 accepted papers

2024

Sketched Newton Value Iteration for Large-Scale Markov Decision Processes

AAAI 2024technical

Value Iteration (VI) is one of the most classic algorithms for solving Markov Decision Processes (MDPs), which lays the foundations for various more advanced reinforcement learning algorithms, such as Q-learning. VI may take a large number of iterations to converge as it is a first-order method. In…

2024

Trust Region Methods for Nonconvex Stochastic Optimization beyond Lipschitz Smoothness

AAAI 2024technical

In many important machine learning applications, the standard assumption of having a globally Lipschitz continuous gradient may fail to hold. This paper delves into a more general (L0, L1)-smoothness setting, which gains particular significance within the realms of deep neural networks and distribut…