← Search

Wenshuo Guo

11 accepted papers

2023

Reward Learning as Doubly Nonparametric Bandits: Optimal Design and Scaling Laws

AISTATS 2023poster

Specifying reward functions for complex tasks like object manipulation or driving is challenging to do by hand. Reward learning seeks to address this by learning a reward model using human feedback on selected query policies. This shifts the burden of reward specification to the optimal design of th…

Cited by 1SourcePDFScholar
2022

Learning Competitive Equilibria in Exchange Economies with Bandit Feedback

AISTATS 2022poster

The sharing of scarce resources among multiple rational agents is one of the classical problems in economics. In exchange economies, which are used to model such situations, agents begin with an initial endowment of resources and exchange them in a way that is mutually beneficial until they reach a…

Cited by 4SourcePDFScholar
2022

Learning from an Exploring Demonstrator: Optimal Reward Estimation for Bandits

AISTATS 2022poster

We introduce the “inverse bandit” problem of estimating the rewards of a multi-armed bandit instance from observing the learning process of a low-regret demonstrator. Existing approaches to the related problem of inverse reinforcement learning assume the execution of an optimal policy, and thereby s…

2020

Approximate Heavily-Constrained Learning with Lagrange Multiplier Models

NeurIPS 2020poster

In machine learning applications such as ranking fairness or fairness over intersectional groups, one often encounters optimization problems with an extremely large number of constraints. In particular, with ranking fairness tasks, there may even be a variable number of constraints, e.g. one for eac…

2020

Fast Algorithms for Computational Optimal Transport and Wasserstein Barycenter

AISTATS 2020poster

We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance compared to state-of-art primal-dual algorithms. First, we introduce the \emph{accelerate…

Cited by 42SourcePDFScholar
2020

Neural Kernels Without Tangents

ICML 2020poster

We investigate the connections between neural networks and simple building blocks in kernel space. In particular, using well established feature space tools such as direct sum, averaging, and moment lifting, we present an algebra for creating “compositional” kernels from bags of features. We show th…

Cited by 110SourcePDFScholar
2020

Robust Optimization for Fairness with Noisy Protected Groups

NeurIPS 2020poster

Many existing fairness criteria for machine learning involve equalizing some metric across protected groups such as race or gender. However, practitioners trying to audit or enforce such group-based criteria can easily face the problem of noisy or biased protected group information. First, we study…