← Search

Marvin Zhang

7 accepted papers

2021

WILDS: A Benchmark of in-the-Wild Distribution Shifts

ICML 2021oral

Distribution shifts—where the training distribution differs from the test distribution—can substantially degrade the accuracy of machine learning (ML) systems deployed in the wild. Despite their ubiquity in the real-world deployments, these distribution shifts are under-represented in the datasets w…

2020

AVID: Learning Multi-Stage Tasks via Pixel-Level Translation of Human Videos

RSS 2020poster

Robotic reinforcement learning (RL) holds the promise of enabling robots to learn complex behaviors through experience. However, realizing this promise for long-horizon tasks in the real world requires mechanisms to reduce human burden in terms of defining the task and scaffolding the learning proce…

Cited by 180SourcePDFScholar
2019

SOLAR: Deep Structured Representations for Model-Based Reinforcement Learning

ICML 2019oral

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning representations that are suitable for iterative model-based p…

2019

When to Trust Your Model: Model-Based Policy Optimization

NeurIPS 2019poster

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy optimization both theoretically and empirically. We first formulate a…

2017

Combining Model-Based and Model-Free Updates for Trajectory-Centric Reinforcement Learning

ICML 2017poster

Reinforcement learning algorithms for real-world robotic applications must be able to handle complex, unknown dynamical systems while maintaining data-efficient learning. These requirements are handled well by model-free and model-based RL approaches, respectively. In this work, we aim to combine th…

Cited by 227SourcePDFScholar
2017

Deep reinforcement learning for tensegrity robot locomotion

ICRA 2017poster

Tensegrity robots, composed of rigid rods connected by elastic cables, have a number of unique properties that make them appealing for use as planetary exploration rovers. However, control of tensegrity robots remains a difficult problem due to their unusual structures and complex dynamics. In this…

Cited by 135SourceScholar
2016

Learning deep neural network policies with continuous memory states

ICRA 2016

Policy learning for partially observed control tasks requires policies that can remember salient information from past observations. In this paper, we present a method for learning policies with internal memory for high-dimensional, continuous systems, such as robotic manipulators. Our approach cons

Cited by 95SourceScholar