← Search

Vijay Gupta

5 accepted papers

2026

Parameter-free Optimal Rates for Nonlinear Semi-Norm Contractions with Applications to Q-Learning

AAAI 2026technical

Algorithms for solving nonlinear fixed-point equations---such as average-reward Q-learning and TD-learning---often involve semi-norm contractions. Achieving parameter-free optimal convergence rates for these methods via Polyak–Ruppert averaging has remained elusive, largely due to the non-monotonici

Cited by 0SourcePDFScholar
2025

End-to-End Learning Framework for Solving Non-Markovian Optimal Control

ICML 2025poster

Integer-order calculus fails to capture the long-range dependence (LRD) and memory effects found in many complex systems. Fractional calculus addresses these gaps through fractional-order integrals and derivatives, but fractional-order dynamical systems pose substantial challenges in system identifi…

Cited by 0SourcePDFScholar
2024

Sampling-based Safe Reinforcement Learning for Nonlinear Dynamical Systems

AISTATS 2024poster

We develop provably safe and convergent reinforcement learning (RL) algorithms for control of nonlinear dynamical systems, bridging the gap between the hard safety guarantees of control theory and the convergence guarantees of RL theory. Recent advances at the intersection of control and RL follow a…

2022

Revisit last-iterate convergence of mSGD under milder requirement on step size

NeurIPS 2022accept

Understanding convergence of SGD-based optimization algorithms can help deal with enormous machine learning problems. To ensure last-iterate convergence of SGD and momentum-based SGD (mSGD), the existing studies usually constrain the step size $\epsilon_{n}$ to decay as $\sum_{n=1}^{+\infty}\ep…

Cited by 6SourcePDFScholar