← Search

Siddharth Reddy

10 accepted papers

2023

Bootstrapping Adaptive Human-Machine Interfaces with Offline Reinforcement Learning

IROS 2023

Adaptive interfaces can help users perform sequential decision-making tasks like robotic teleoperation given noisy, high-dimensional command signals (e.g., from a brain-computer interface). Recent advances in human-in-the-loop machine learning enable such systems to improve by interacting with users

Cited by 1SourceScholar
2022

ASHA: Assistive Teleoperation via Human-in-the-Loop Reinforcement Learning

ICRA 2022poster

Building assistive interfaces for controlling robots through arbitrary, high-dimensional, noisy inputs (e.g., webcam images of eye gaze) can be challenging, especially when it involves inferring the user's desired action in the absence of a natural ‘default’ interface. Reinforcement learning from on…

Cited by 25SourceScholar
2022

First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximization

NeurIPS 2022accept

How can we train an assistive human-machine interface (e.g., an electromyography-based limb prosthesis) to translate a user's raw command signals into the actions of a robot or computer when there is no prior mapping, we cannot ask the user for supervision in the form of action labels or reward feed…

2021

Pragmatic Image Compression for Human-in-the-Loop Decision-Making

NeurIPS 2021spotlight

Standard lossy image compression algorithms aim to preserve an image's appearance, while minimizing the number of bits needed to transmit it. However, the amount of information actually needed by the user for downstream tasks -- e.g., deciding which product to click on in a shopping website -- is li…

2021

X2T: Training an X-to-Text Typing Interface with Online Learning from User Feedback

ICLR 2021poster

We aim to help users communicate their intent to machines using flexible, adaptive interfaces that translate arbitrary user input into desired actions. In this work, we focus on assistive typing applications in which a user cannot operate a keyboard, but can instead supply other inputs, such as webc…

Cited by 10SourcePDFScholar
2020

Learning Human Objectives by Evaluating Hypothetical Behavior

ICML 2020poster

We seek to align agent behavior with a user’s objectives in a reinforcement learning setting with unknown dynamics, an unknown reward function, and unknown unsafe states. The user knows the rewards and unsafe states, but querying the user is expensive. We propose an algorithm that safely and efficie…

Cited by 95SourcePDFScholar
2020

SQIL: Imitation Learning via Reinforcement Learning with Sparse Rewards

ICLR 2020poster

Learning to imitate expert behavior from demonstrations can be challenging, especially in environments with high-dimensional, continuous observations and unknown dynamics. Supervised learning methods based on behavioral cloning (BC) suffer from distribution shift: because the agent greedily imitates…

Cited by 312SourceScholar
2020

Scaled Autonomy: Enabling Human Operators to Control Robot Fleets

ICRA 2020poster

Autonomous robots often encounter challenging situations where their control policies fail and an expert human operator must briefly intervene, e.g., through teleoperation. In settings where multiple robots act in separate environments, a single human operator can manage a fleet of robots by identif…

Cited by 56SourceScholar