← Search

Andrew Critch

6 accepted papers

2021

Aligning AI With Shared Human Values

ICLR 2021poster

We show how to assess a language model's knowledge of basic concepts of morality. We introduce the ETHICS dataset, a new benchmark that spans concepts in justice, well-being, duties, virtues, and commonsense morality. Models predict widespread moral judgments about diverse text scenarios. This requi…

2021

Optimal Policies Tend To Seek Power

NeurIPS 2021spotlight

Some researchers speculate that intelligent reinforcement learning (RL) agents would be incentivized to seek resources and power in pursuit of the objectives we specify for them. Other researchers point out that RL agents need not have human-like power-seeking instincts. To clarify this discussion,…

2020

Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Design

NeurIPS 2020oral

A wide range of reinforcement learning (RL) problems --- including robustness, transfer learning, unsupervised RL, and emergent complexity --- require specifying a distribution of tasks or environments in which a policy will be trained. However, creating a useful distribution of environments is err…

2018

Negotiable Reinforcement Learning for Pareto Optimal Sequential Decision-Making

NeurIPS 2018poster

It is commonly believed that an agent making decisions on behalf of two or more principals who have different utility functions should adopt a Pareto optimal policy, i.e. a policy that cannot be improved upon for one principal without making sacrifices for another. Harsanyi's theorem shows that when…

Cited by 16SourcePDFScholar