← Search

Shangqin Mao

3 accepted papers

2026

DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation

ICML 2026poster

Auto-bidding is a core component of real-time advertising systems, where decisions must optimize long-term performance under budget and cost constraints, while online exploration is prohibitively risky. Offline reinforcement learning and, more recently, Transformer-based sequence modeling have shown…

Cited by 0SourceScholar
2024

Off-Policy Primal-Dual Safe Reinforcement Learning

ICLR 2024poster

Primal-dual safe RL methods commonly perform iterations between the primal update of the policy and the dual update of the Lagrange Multiplier. Such a training paradigm is highly susceptible to the error in cumulative cost estimation since this estimation serves as the key bond connecting the primal…

2023

Safe Offline Reinforcement Learning with Real-Time Budget Constraints

ICML 2023poster

Aiming at promoting the safe real-world deployment of Reinforcement Learning (RL), research on safe RL has made significant progress in recent years. However, most existing works in the literature still focus on the online setting where risky violations of the safety budget are likely to be incurred…