← Search

James Harrison

16 accepted papers

2025

Bayesian Optimization via Continual Variational Last Layer Training

ICLR 2025spotlight

Gaussian Processes (GPs) are widely seen as the state-of-the-art surrogate models for Bayesian optimization (BO) due to their ability to model uncertainty and their performance on tasks where correlations are easily captured (such as those defined by Euclidean metrics) and their ability to be effici…

Cited by 1SourcePDFScholar
2025

Offline Hierarchical Reinforcement Learning via Inverse Optimization

ICLR 2025poster

Hierarchical policies enable strong performance in many sequential decision-making problems, such as those with high-dimensional action spaces, those requiring long-horizon planning, and settings with sparse rewards. However, learning hierarchical policies from static offline datasets presents a si…

2024

Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments

NeurIPS 2024poster

The ability of Language Models (LMs) to understand natural language makes them a powerful tool for parsing human instructions into task plans for autonomous robots. Unlike traditional planning methods that rely on domain-specific knowledge and handcrafted rules, LMs generalize from diverse data and…

2023

Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning

ICRA 2023poster

Learning-based behavior prediction methods are increasingly being deployed in real-world autonomous systems, e.g., in fleets of self-driving vehicles, which are beginning to commercially operate in major cities across the world. Despite their advancements, however, the vast majority of prediction sy…

Cited by 33SourceScholar
2023

Graph Reinforcement Learning for Network Control via Bi-Level Optimization

ICML 2023poster

Optimization problems over dynamic networks have been extensively studied and widely used in the past decades to formulate numerous real-world problems. However, (1) traditional optimization-based approaches do not scale to large networks, and (2) the design of good heuristics or approximation algor…

2023

Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies

NeurIPS 2023poster

Unrolled computation graphs are prevalent throughout machine learning but present challenges to automatic differentiation (AD) gradient estimation methods when their loss functions exhibit extreme local sensitivtiy, discontinuity, or blackbox characteristics. In such scenarios, online evolution stra…

2022

A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biases

NeurIPS 2022accept

Learned optimizers---neural networks that are trained to act as optimizers---have the potential to dramatically accelerate training of machine learning models. However, even when meta-trained across thousands of tasks at huge computational expense, blackbox learned optimizers often struggle with sta…

2021

Deep Reinforcement Learning amidst Continual Structured Non-Stationarity

ICML 2021spotlight

As humans, our goals and our environment are persistently changing throughout our lifetime based on our experiences, actions, and internal and external drives. In contrast, typical reinforcement learning problem set-ups consider decision processes that are stationary across episodes. Can we develop…

Cited by 47SourcePDFScholar
2019

BaRC: Backward Reachability Curriculum for Robotic Reinforcement Learning

ICRA 2019poster

Model-free Reinforcement Learning (RL) offers an attractive approach to learn control policies for high dimensional systems, but its relatively poor sample complexity often necessitates training in simulated environments. Even in simulation, goal-directed tasks whose natural reward function is spars…

Cited by 80SourcecodeScholar
2019

Network Offloading Policies for Cloud Robotics: A Learning-Based Approach

RSS 2019poster

Today's robotic systems are increasingly turning to computationally expensive models such as deep neural networks (DNNs) for tasks like localization, perception, planning, and object detection. However, resource-constrained robots, like low-power drones, often have insufficient on-board compute reso…

2015

Characterizing device dynamics for haptic manipulation and navigation

ICRA 2015poster

In this work we present a method of systematically selecting regions of a haptic workspace to be used for navigation of large virtual environments. Existing navigational techniques require the partitioning of the workspace into a region of manipulation and a separate region for navigation tasks. The…

Cited by 3SourceScholar