← Search

Shuang Ao

4 accepted papers

2024

CSS: Contrastive Semantic Similarities for Uncertainty Quantification of LLMs

UAI 2024poster

Despite the impressive capability of large language models (LLMs), knowing when to trust their generations remains an open challenge. The recent literature on uncertainty quantification of natural language generation (NLG) utilizes a conventional natural language inference (NLI) classifier to measur…

2023

Two Sides of Miscalibration: Identifying Over and Under-Confidence Prediction for Network Calibration

UAI 2023poster

Proper confidence calibration of deep neural networks is essential for reliable predictions in safety-critical tasks. Miscalibration can lead to model over-confidence and/or under-confidence; i.e., the model’s confidence in its prediction can be greater or less than the model’s accuracy. Recent stud…

2022

EAT-C: Environment-Adversarial sub-Task Curriculum for Efficient Reinforcement Learning

ICML 2022spotlight

Reinforcement learning (RL) is inefficient on long-horizon tasks due to sparse rewards and its policy can be fragile to slightly perturbed environments. We address these challenges via a curriculum of tasks with coupled environments, generated by two policies trained jointly with RL: (1) a co-operat…

2021

CO-PILOT: COllaborative Planning and reInforcement Learning On sub-Task curriculum

NeurIPS 2021poster

Goal-conditioned reinforcement learning (RL) usually suffers from sparse reward and inefficient exploration in long-horizon tasks. Planning can find the shortest path to a distant goal that provides dense reward/guidance but is inaccurate without a precise environment model. We show that RL and plan…