← Search

Qingpeng Cai

12 accepted papers

2026

DIYHealth Suite: Dataset, Model, and Benchmark for Health Management at Home

ICML 2026poster

Generative AI is reshaping healthcare, yet most existing advances rely on hospital-grade devices, which limits their accessibility and potential for health management outside clinical settings. With the proliferation of portable devices and telemedicine, healthcare is shifting toward home-based Diag…

Cited by 1SourceScholar
2026

Phase-Aware Mixture of Experts for Agentic Reinforcement Learning

ICML 2026poster

Reinforcement learning (RL) has equipped LLM agents with a strong ability to solve complex tasks. However, existing RL methods normally use a single policy network, causing simplicity bias where simple tasks occupy most parameters and dominate gradient updates, leaving insufficient capacity for comp…

Cited by 0SourceScholar
2026

Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewards

ICLR 2026poster

RL with Verifiable Rewards (RLVR) has emerged as a promising paradigm for improving the reasoning abilities of large language models (LLMs). Current methods rely primarily on policy optimization frameworks like PPO and GRPO, which follow generalized policy iteration that alternates between evaluatin…

Cited by 0SourcecodeScholar
2025

Flow Factorization for Efficient Generative Flow Networks

AAAI 2025technical

Generative Flow Networks (GFlowNets) is a new family of probabilistic samplers for generating objects under an unnormalized reward distribution. It has emerged as a promising framework for learning stochastic policies that generate high-quality and diverse discrete objects proportional to their rewa…

Cited by 0SourcePDFScholar
2025

LLM-Powered User Simulator for Recommender System

AAAI 2025technical

User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user simulators generally suffer from significant limitations, i…

2025

Random Policy Evaluation Uncovers Policies of Generative Flow Networks

ICML 2025poster

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects with probability proportional to an unnormalized reward function. GFlowNets share a strong connection with reinforcement learning (RL) that typically…

Cited by 0SourcePDFScholar
2023

ResAct: Reinforcing Long-term Engagement in Sequential Recommendation with Residual Actor

ICLR 2023poster

Long-term engagement is preferred over immediate engagement in sequential recommendation as it directly affects product operational metrics such as daily active users (DAUs) and dwell time. Meanwhile, reinforcement learning (RL) is widely regarded as a promising framework for optimizing long-term en…

Cited by 30SourcePDFScholar
2023

State Regularized Policy Optimization on Data with Dynamics Shift

NeurIPS 2023poster

In many real-world scenarios, Reinforcement Learning (RL) algorithms are trained on data with dynamics shift, i.e., with different underlying environment dynamics. A majority of current methods address such issue by training context encoders to identify environment parameters. Data with dynamics shi…

Cited by 17SourcePDFScholar
2022

BoostMIS: Boosting Medical Image Semi-Supervised Learning With Adaptive Pseudo Labeling and Informative Active Annotation

CVPR 2022poster

In this paper, we propose a novel semi-supervised learning (SSL) framework named BoostMIS that combines adaptive pseudo labeling and informative active annotation to unleash the potential of medical image SSL models: (1) BoostMIS can adaptively leverage the cluster assumption and consistency regular…

Cited by 122PDFcodeScholar
2022

MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-Based Image Captioning

AAAI 2022technical

Text-based image captioning (TextCap) requires simultaneous comprehension of visual content and reading the text of images to generate a natural language description. Although a task can teach machines to understand the complex human environment further given that text is omnipresent in our daily su…

2020

Reinforcement Learning with Dynamic Boltzmann Softmax Updates

IJCAI 2020poster

Value function estimation is an important task in reinforcement learning, i.e., prediction. The Boltzmann softmax operator is a natural value estimator and can provide several benefits. However, it does not satisfy the non-expansion property, and its direct use may fail to converge even in value ite…

Cited by 0SourcePDFScholar