← Search

Yisong Yue

111 accepted papers

2026

A Narwhal-Inspired Sensing-To-Control Framework for Small Fixed-Wing Aircraft

ICRA 2026poster

Fixed-wing unmanned aerial vehicles (UAVs) offer endurance and efficiency but lack low-speed agility because its highly-coupled dynamical model. We present an end-to-end sensing-to-control pipeline that combines bio-inspired hardware instrumentation, physics-informed dynamics learning, and convex co…

2026

Discrete Diffusion Trajectory Alignment via Stepwise Decomposition

ICLR 2026poster

Discrete diffusion models have demonstrated great promise in modeling various sequence data, ranging from human language to biological sequences. Inspired by the success of RL in language models, there is growing interest in further improving the models by alignment with a certain reward. In this wo…

Cited by 0SourcecodeScholar
2026

End-to-End Autoregressive Image Generation with 1D Semantic Tokenizer

ICML 2026spotlight

Autoregressive image modeling relies on visual tokenizers to compress images into compact latent representations. We design an end-to-end training pipeline that jointly optimizes reconstruction and generation, enabling direct supervision from generation results to the tokenizer. This contrasts with …

Cited by 0SourceScholar
2026

Evaluating Agentic Optimization on Large Codebases

ICML 2026poster

Large language model (LLM) coding agents increasingly operate at the repository level, motivating benchmarks that evaluate their ability to optimize entire codebases under realistic constraints. Existing code benchmarks largely rely on synthetic tasks, binary correctness signals, or single-objective…

Cited by 0SourceScholar
2026

KALIKO: Kalman-Implicit Koopman Operator Learning for Prediction of Nonlinear Dynamical Systems

ICRA 2026poster

Long-horizon dynamical prediction is fundamental in robotics and control, underpinning canonical methods like model predictive control. Yet, many systems and disturbance phenomena are difficult to model due to effects like nonlinearity, chaos, and high-dimensionality. Koopman theory addresses this b…

2026

NitroGen: An Open Foundation Model for Generalist Gaming Agents

CVPR 2026

We introduce NitroGen, a vision-action foundation model for generalist gaming agents that is trained on 40,000 hours of gameplay videos across more than 1,000 games. We scale embodied agents through three key ingredients: 1) an internet-scale video-action dataset constructed by automatically extract

Cited by 0SourcecodeScholar
2026

Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization

CVPR 2026

Adapting production-level computer vision tools to bespoke scientific datasets is a critical "last mile" bottleneck. Current solutions are impractical: fine-tuning requires large annotated datasets scientists often lack, while manual code adaptation costs scientists weeks to months of effort. We con

Cited by 0SourcecodeScholar
2026

SpeeDiff: Scalable Pixel-Anchored End-to-End Latent Diffusion Model

CVPR 2026

We present Scalable Pixel-anchored End-to-end Diffusion (SpeeDiff), a latent diffusion method that jointly trains the VAE and the diffusion model from scratch. In principle, joint training allows the diffusion loss gradient to directly guide the VAE encoder, encouraging the formation of a generation

Cited by 0SourceScholar
2025

CLEVER: A Curated Benchmark for Formally Verified Code Generation

NeurIPS 2025poster

We introduce ${\rm C{\small LEVER}}$, a high-quality, manually curated benchmark of 161 problems for end-to-end verified code generation in Lean. Each problem consists of (1) the task of generating a specification that matches a held-out ground-truth specification, and (2) the task of generating a L…

Cited by 0SourcecodeScholar
2025

Conformal Risk Training: End-to-End Optimization of Conformal Risk Control

NeurIPS 2025poster

While deep learning models often achieve high predictive accuracy, their predictions typically do not come with any provable guarantees on risk or reliability, which are critical for deployment in high-stakes applications. The framework of conformal risk control (CRC) provides a distribution-free, f…

Cited by 0SourceScholar
2025

DISC: Dynamic Decomposition Improves LLM Inference Scaling

NeurIPS 2025poster

Inference scaling methods for LLMs often rely on decomposing problems into steps (or groups of tokens), followed by sampling and selecting the best next steps. However, these steps and their sizes are often predetermined or manually designed based on domain knowledge. We propose dynamic decompositio…

Cited by 0SourceScholar
2025

EnCompass: Enhancing Agent Programming with Search Over Program Execution Paths

NeurIPS 2025poster

We introduce a new approach to *agent programming*, the development of LLM-based agents. Current approaches to agent programming often entangle two aspects of agent design: the core workflow logic and the inference-time strategy (e.g., tree search). We introduce *probabilistic angelic nondeterminism…

Cited by 0SourceScholar
2025

Hybrid Data-Driven Predictive Control for Robust and Reactive Exoskeleton Locomotion Synthesis

IROS 2025

Robust bipedal locomotion in exoskeletons requires the ability to dynamically react to changes in the environment in real time. This paper introduces the hybrid data-driven predictive control (HDDPC) framework, an extension of the data-enabled predictive control, that addresses these challenges by s

Cited by 0SourceScholar
2025

InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences

ICLR 2025spotlight

Plug-and-play diffusion priors (PnPDP) have emerged as a promising research direction for solving inverse problems. However, current studies primarily focus on natural image restoration, leaving the performance of these algorithms in scientific inverse problems largely unexplored. To address this…

2025

Kuramoto Orientation Diffusion Models

NeurIPS 2025poster

Orientation-rich images, such as fingerprints and textures, often exhibit coherent angular directional patterns that are challenging to model using standard generative approaches based on isotropic Euclidean diffusion. Motivated by the role of phase synchronization in biological systems, we propose…

Cited by 0SourceScholar
2025

Population Transformer: Learning Population-level Representations of Neural Activity

ICLR 2025oral

We present a self-supervised framework that learns population-level codes for arbitrary ensembles of neural recordings at scale. We address key challenges in scaling models with neural time-series data, namely, sparse and variable electrode distribution across subjects and datasets. The Population T…

2025

Self-Evolving Visual Concept Library using Vision-Language Critics

CVPR 2025poster

We study the problem of building a visual concept library for visual recognition. Building effective visual concept libraries is challenging, as manual definition is labor-intensive, while relying solely on LLMs for concept generation can result in concepts that lack discriminative power or fail to…

Cited by 0SourcePDFScholar
2025

Steering Generative Models with Experimental Data for Protein Fitness Optimization

NeurIPS 2025poster

Protein fitness optimization involves finding a protein sequence that maximizes desired quantitative properties in a combinatorially large design space of possible sequences. Recent advances in steering protein generative models (e.g., diffusion models and language models) with labeled data offer a…

Cited by 0SourcecodeScholar
2025

Strategist: Self-improvement of LLM Decision Making via Bi-Level Tree Search

ICLR 2025poster

Traditional reinforcement learning and planning require a lot of data and training to develop effective strategies. On the other hand, large language models (LLMs) can generalize well and perform tasks without prior training but struggle with complex planning and decision-making. We introduce **STRA…

Cited by 0SourcePDFScholar
2025

Visual Agentic AI for Spatial Reasoning with a Dynamic API

CVPR 2025poster

Visual reasoning -- the ability to interpret the visual world -- is crucial for embodied agents that operate within three-dimensional scenes. Progress in AI has led to vision and language models capable of answering questions from images. However, their performance declines when tasked with 3D spati…

2024

CARE: a Benchmark Suite for the Classification and Retrieval of Enzymes

NeurIPS 2024poster

Enzymes are important proteins that catalyze chemical reactions. In recent years, machine learning methods have emerged to predict enzyme function from sequence; however, there are no standardized benchmarks to evaluate these methods. We introduce CARE, a benchmark and dataset suite for the Classif…

2024

Data-Driven Predictive Control for Robust Exoskeleton Locomotion

IROS 2024poster

Exoskeleton locomotion must be robust while being adaptive to different users with and without payloads. To address these challenges, this work introduces a data-driven predictive control (DDPC) framework to synthesize walking gaits for lower-body exoskeletons, employing Hankel matrices and a state…

Cited by 3SourceScholar
2024

Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models

ICML 2024poster

Large pretrained protein language models (PLMs) have improved protein property and structure prediction from sequences via transfer learning, in which weights and representations from PLMs are repurposed for downstream tasks. Although PLMs have shown great promise, currently there is little understa…

Cited by 38SourcePDFScholar
2024

Hierarchical Meta-learning-based Adaptive Controller

ICRA 2024poster

We study how to design learning-based adaptive controllers that enable fast and accurate online adaptation in changing environments. In these settings, learning is typically done during an initial (offline) design phase, where the vehicle is exposed to different environmental conditions and disturba…

Cited by 2SourceScholar
2024

Practical Bayesian Algorithm Execution via Posterior Sampling

NeurIPS 2024poster

We consider Bayesian algorithm execution (BAX), a framework for efficiently selecting evaluation points of an expensive function to infer a property of interest encoded as the output of a base algorithm. Since the base algorithm typically requires more evaluations than are feasible, it cannot be dir…

2024

Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors

NeurIPS 2024poster

Diffusion models (DMs) have recently shown outstanding capabilities in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on approximations in the generative process to be generic to different…

2024

ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search

NeurIPS 2024poster

Recent methodologies in LLM self-training mostly rely on LLM generating responses and filtering those with correct output answers as training data. This approach often yields a low-quality fine-tuning training set (e.g., incorrect plans or intermediate reasoning). In this paper, we develop a reinfor…

2024

Robust Agility via Learned Zero Dynamics Policies

IROS 2024poster

We study the design of robust and agile controllers for hybrid underactuated systems. Our approach breaks down the task of creating a stabilizing controller into: 1) learning a mapping that is invariant under optimal control, and 2) driving the actuated coordinates to the output of that mapping. Thi…

Cited by 4SourceScholar
2024

SceneCraft: An LLM Agent for Synthesizing 3D Scenes as Blender Code

ICML 2024oral

This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial planning and arrangement. We tackle these challenges through a co…

Cited by 39SourcePDFScholar
2024

SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Models

NeurIPS 2024poster

Large Language Models (LLMs) have shown promise in assisting scientific discovery. However, such applications are currently limited by LLMs' deficiencies in understanding intricate scientific concepts, deriving symbolic equations, and solving advanced numerical calculations. To bridge these gaps, we…

2024

Symbolic Music Generation with Non-Differentiable Rule Guided Diffusion

ICML 2024oral

We study the problem of symbolic music generation (e.g., generating piano rolls), with a technical focus on non-differentiable rule guidance. Musical rules are often expressed in symbolic form on note characteristics, such as note density or chord progression, many of which are non-differentiable wh…

2024

Uncertainty Calibration for Tool-Using Language Agents

EMNLP 2024finding

There is increasing interest in equipping language models with the ability to leverage external tools for complex, goal-oriented tasks. However, interacting with external tools introduces inherent uncertainties due to imperfections and misalignments between the tools’ outputs and the agents’ interna…

Cited by 2SourcePDFScholar
2023

BKinD-3D: Self-Supervised 3D Keypoint Discovery From Multi-View Videos

CVPR 2023poster

Quantifying motion in 3D is important for studying the behavior of humans and other animals, but manual pose annotations are expensive and time-consuming to obtain. Self-supervised keypoint discovery is a promising strategy for estimating 3D poses without annotations. However, current keypoint disco…

2023

Eventual Discounting Temporal Logic Counterfactual Experience Replay

ICML 2023poster

Linear temporal logic (LTL) offers a simplified way of specifying tasks for policy optimization that may otherwise be difficult to describe with scalar reward functions. However, the standard RL framework can be too myopic to find maximally LTL satisfying policies. This paper makes two contributions…

Cited by 11SourcePDFScholar
2023

Learning Calibrated Uncertainties for Domain Shift: A Distributionally Robust Learning Approach

IJCAI 2023poster

We propose a framework for learning calibrated uncertainties under domain shifts, considering the case where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts through the use of a differentiable density ratio estimator and train it together…

2023

Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimation

ICML 2023poster

We study Bayesian optimization (BO) in high-dimensional and non-stationary scenarios. Existing algorithms for such scenarios typically require extensive hyperparameter tuning, which limits their practical effectiveness. We propose a framework, called BALLET, which adaptively filters for a high-confi…

Cited by 8SourcePDFScholar
2023

MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior

ICML 2023poster

We introduce MABe22, a large-scale, multi-agent video and trajectory benchmark to assess the quality of learned behavior representations. This dataset is collected from a variety of biology experiments, and includes triplets of interacting mice (4.7 million frames video+pose tracking data, 10 millio…

2023

Online Adaptive Policy Selection in Time-Varying Systems: No-Regret via Contractive Perturbations

NeurIPS 2023poster

We study online adaptive policy selection in systems with time-varying costs and dynamics. We develop the Gradient-based Adaptive Policy Selection (GAPS) algorithm together with a general analytical framework for online policy selection via online optimization. Under our proposed notion of contracti…

Cited by 16SourcePDFScholar
2023

SustainGym: Reinforcement Learning Environments for Sustainable Energy Systems

NeurIPS 2023poster

The lack of standardized benchmarks for reinforcement learning (RL) in sustainability applications has made it difficult to both track progress on specific domains and identify bottlenecks for researchers to focus their efforts. In this paper, we present SustainGym, a suite of five environments desi…

2022

Automatic Synthesis of Diverse Weak Supervision Sources for Behavior Analysis

CVPR 2022poster

Obtaining annotations for large training sets is expensive, especially in settings where domain knowledge is required, such as behavior analysis. Weak supervision has been studied to reduce annotation costs by using weak labels from task-specific labeling functions (LFs) to augment ground truth labe…

Cited by 11PDFcodeScholar
2022

Investigating Generalization by Controlling Normalized Margin

ICML 2022spotlight

Weight norm $\|w\|$ and margin $\gamma$ participate in learning theory via the normalized margin $\gamma/\|w\|$. Since standard neural net optimizers do not control normalized margin, it is hard to test whether this quantity causally relates to generalization. This paper designs a series of experime…

2022

LyaNet: A Lyapunov Framework for Training Neural ODEs

ICML 2022spotlight

We propose a method for training ordinary differential equations by using a control-theoretic Lyapunov condition for stability. Our approach, called LyaNet, is based on a novel Lyapunov loss formulation that encourages the inference dynamics to converge quickly to the correct prediction. Theoretical…

2022

MLNav: Learning to Safely Navigate on Martian Terrains

RA-L 2022

We present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">MLNav</i> , a learning-enhanced path planning framework for safety-critical and resource-limited systems operating in complex environments, such as rovers navigating on Mars. MLNav makes judi

Cited by 23SourceScholar
2022

Natural Multicontact Walking for Robotic Assistive Devices via Musculoskeletal Models and Hybrid Zero Dynamics

RA-L 2022

Generating stable walking gaits that yield natural locomotion when executed on robotic-assistive devices is a challenging task that often requires hand-tuning by domain experts. This letter presents an alternative methodology, where we propose the addition of musculoskeletal models directly into the

Cited by 17SourceScholar
2022

Policy Optimization with Linear Temporal Logic Constraints

NeurIPS 2022accept

We study the problem of policy optimization (PO) with linear temporal logic (LTL) constraints. The language of LTL allows flexible description of tasks that may be unnatural to encode as a scalar cost function. We consider LTL-constrained PO as a systematic framework, decoupling task specification f…

Cited by 24SourcePDFScholar
2022

Self-Supervised Keypoint Discovery in Behavioral Videos

CVPR 2022poster

We propose a method for learning the posture and structure of agents from unlabelled behavioral videos. Starting from the observation that behaving agents are generally the main sources of movement in behavioral videos, our method, Behavioral Keypoint Discovery (B-KinD), uses an encoder-decoder arch…

Cited by 36PDFcodeScholar
2022

Self-Supervised Online Learning for Safety-Critical Control using Stereo Vision

ICRA 2022poster

With the increasing prevalence of complex vision-based sensing methods for use in obstacle identification and state estimation, characterizing environment-dependent measurement errors has become a difficult and essential part of modern robotics. This paper presents a self-supervised learning approac…

Cited by 17SourceScholar
2021

Chance-Constrained Trajectory Optimization for Safe Exploration and Learning of Nonlinear Systems

RA-L 2021

Learning-based control algorithms require data collection with abundant supervision for training. Safe exploration algorithms ensure the safety of this data collection process even when only partial knowledge is available. We present a new approach for optimal motion planning with safe exploration t

Cited by 55SourceScholar
2021

Competitive policy optimization

UAI 2021poster

A core challenge in policy optimization in competitive Markov decision processes is the design of efficient optimization methods with desirable convergence and stability properties. We propose competitive policy optimization (CoPO), a novel policy gradient approach that exploits the game-theoretic n…

2021

Deep Bayesian Quadrature Policy Optimization

AAAI 2021technical

We study the problem of obtaining accurate policy gradient estimates using a finite number of samples. Monte-Carlo methods have been the default choice for policy gradient estimation, despite suffering from high variance in the gradient estimates. On the other hand, more sample efficient alternative…

2021

DeepGEM: Generalized Expectation-Maximization for Blind Inversion

NeurIPS 2021poster

Typically, inversion algorithms assume that a forward model, which relates a source to its resulting measurements, is known and fixed. Using collected indirect measurements and the forward model, the goal becomes to recover the source. When the forward model is unknown, or imperfect, artifacts due t…

2021

Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning

NeurIPS 2021poster

We offer an experimental benchmark and empirical study for off-policy policy evaluation (OPE) in reinforcement learning, which is a key problem in many safety critical applications. Given the increasing interest in deploying learning-based methods, there has been a flurry of recent proposals for OPE…

Cited by 176SourceScholar
2021

Iterative Amortized Policy Optimization

NeurIPS 2021poster

Policy networks are a central feature of deep reinforcement learning (RL) algorithms for continuous control, enabling the estimation and sampling of high-value actions. From the variational inference perspective on RL, policy networks, when used with entropy or KL regularization, are a form of amort…

2021

Learning Invariant Representation of Tasks for Robust Surgical State Estimation

RA-L 2021

Surgical state estimators in robot-assisted surgery (RAS)-especially those trained via learning techniques-rely heavily on datasets that capture surgeon actions in laboratory or real-world surgical tasks. Real-world RAS datasets are costly to acquire, are obtained from multiple surgeons who may use

Cited by 8SourceScholar
2021

Learning by Turning: Neural Architecture Aware Optimisation

ICML 2021spotlight

Descent methods for deep networks are notoriously capricious: they require careful tuning of step size, momentum and weight decay, and which method will work best on a new benchmark is a priori unclear. To address this problem, this paper conducts a combined study of neural architecture and optimisa…

2021

Learning to Control an Unstable System with One Minute of Data: Leveraging Gaussian Process Differentiation in Predictive Control

IROS 2021poster

We present a straightforward and efficient way to control unstable robotic systems using an estimated dynamics model. Specifically, we show how to exploit the differentiability of Gaussian Processes to create a state-dependent linearized approximation of the true continuous dynamics that can be inte…

Cited by 3SourcecodeScholar
2021

Learning to Make Decisions via Submodular Regularization

ICLR 2021poster

Many sequential decision making tasks can be viewed as combinatorial optimization problems over a large number of actions. When the cost of evaluating an action is high, even a greedy algorithm, which iteratively picks the best action given the history, is prohibitive to run. In this paper, we aim t…

Cited by 14SourcePDFScholar
2021

Meta-Adaptive Nonlinear Control: Theory and Algorithms

NeurIPS 2021poster

We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-Adaptive Control (OMAC). The goal is to control a nonlinear system subject to adversarial disturbance and unknown \emph{environment-dependent} nonlinear dynamics, under the assumption that the…

2021

Online Robust Control of Nonlinear Systems with Large Uncertainty

AISTATS 2021poster

Robust control is a core approach for controlling systems with performance guarantees that are robust to modeling error, and is widely used in real-world systems. However, current robust control approaches can only handle small system uncertainty, and thus require significant effort in system identi…

Cited by 19SourcePDFScholar
2021

ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton Gait Preference Landscapes

ICRA 2021poster

Characterizing what types of exoskeleton gaits are comfortable for users, and understanding the science of walking more generally, require recovering a user’s utility landscape. Learning these landscapes is challenging, as walking trajectories are defined by numerous gait parameters, data collection…

Cited by 52SourcecodeScholar
2021

Task Programming: Learning Data Efficient Behavior Representations

CVPR 2021poster

Specialized domain knowledge is often necessary to accurately annotate training sets for in-depth analysis, but can be burdensome and time-consuming to acquire from domain experts. This issue arises prominently in automated behavior analysis, in which agent movements or actions of interest are detec…

Cited by 63PDFcodeScholar
2021

The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions

NeurIPS 2021poster

Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dataset consists of trajectory data of social interactions, recorded from videos of…

Cited by 58SourcecodeScholar
2020

A General Large Neighborhood Search Framework for Solving Integer Linear Programs

NeurIPS 2020poster

This paper studies how to design abstractions of large-scale combinatorial optimization problems that can leverage existing state-of-the-art solvers in general-purpose ways, and that are amenable to data-driven design. The goal is to arrive at new approaches that can reliably outperform existing so…

Cited by 91SourcePDFScholar
2020

Dueling Posterior Sampling for Preference-Based Reinforcement Learning

UAI 2020poster

In preference-based reinforcement learning (RL), an agent interacts with the environment while receiving preferences instead of absolute feedback. While there is increasing research activity in preference-based RL, the design of formal frameworks that admit tractable theoretical analysis remains an…

2020

GLAS: Global-to-Local Safe Autonomy Synthesis for Multi-Robot Motion Planning With End-to-End Learning

RA-L 2020

We present GLAS: Global-to-Local Autonomy Synthesis, a provably-safe, automated distributed policy generation for multi-robot motion planning. Our approach combines the advantage of centralized planning of avoiding local minima with the advantage of decentralized controllers of scalability and distr

Cited by 101SourcecodeScholar
2020

Human Preference-Based Learning for High-dimensional Optimization of Exoskeleton Walking Gaits

IROS 2020poster

Optimizing lower-body exoskeleton walking gaits for user comfort requires understanding users' preferences over a high-dimensional gait parameter space. However, existing preference-based learning methods have only explored low-dimensional domains due to computational limitations. To learn user pref…

Cited by 48SourcecodeScholar
2020

Learning Calibratable Policies using Programmatic Style-Consistency

ICML 2020poster

We study the problem of controllable generation of long-term sequential behaviors, where the goal is to calibrate to multiple behavior styles simultaneously. In contrast to the well-studied areas of controllable generation of images, text, and speech, there are two questions that pose significant ch…

2020

Learning Differentiable Programs with Admissible Neural Heuristics

NeurIPS 2020poster

We study the problem of learning differentiable functions expressed as programs in a domain-specific language. Such programmatic models can offer benefits such as composability and interpretability; however, learning them requires optimizing over a combinatorial space of program "architectures". We…

Cited by 58SourcePDFScholar
2020

Learning compositional functions via multiplicative weight updates

NeurIPS 2020poster

Compositionality is a basic structural feature of both biological and artificial neural networks. Learning compositional functions via gradient descent incurs well known problems like vanishing and exploding gradients, making careful learning rate tuning essential for real-world applications. This p…

2020

Multiresolution Tensor Learning for Efficient and Interpretable Spatial Analysis

ICML 2020poster

Efficient and interpretable spatial analysis is crucial in many fields such as geology, sports, and climate science. Tensor latent factor models can describe higher-order correlations for spatial data. However, they are computationally expensive to train and are sensitive to initialization, leading…

2020

Neural-Swarm: Decentralized Close-Proximity Multirotor Control Using Learned Interactions

ICRA 2020poster

In this paper, we present Neural-Swarm, a nonlinear decentralized stable controller for close-proximity flight of multirotor swarms. Close-proximity control is challenging due to the complex aerodynamic interaction effects between multirotors, such as downwash from higher vehicles to lower ones. Con…

Cited by 89SourceScholar
2020

On the distance between two neural networks and the stability of learning

NeurIPS 2020poster

This paper relates parameter distance to gradient breakdown for a broad class of nonlinear compositional functions. The analysis leads to a new distance function called deep relative trust and a descent lemma for neural networks. Since the resulting learning rule seems to require little to no learni…

2020

Online Optimization with Memory and Competitive Control

NeurIPS 2020poster

This paper presents competitive algorithms for a novel class of online optimization problems with memory. We consider a setting where the learner seeks to minimize the sum of a hitting cost and a switching cost that depends on the previous $p$ decisions. This setting generalizes Smoothed Online Conv…

Cited by 63SourcePDFScholar
2020

Preference-Based Learning for Exoskeleton Gait Optimization

ICRA 2020poster

This paper presents a personalized gait optimization framework for lower-body exoskeletons. Rather than optimizing numerical objectives such as the mechanical cost of transport, our approach directly learns from user prefer-ences, e.g., for comfort. Building upon work in preference-based interactive…

Cited by 126SourceScholar
2019

A General Framework for Multi-fidelity Bayesian Optimization with Gaussian Processes

AISTATS 2019poster

How can we efficiently gather information to optimize an unknown function, when presented with multiple, mutually dependent information sources with different costs? For example, when optimizing a physical system, intelligently trading off computer simulations and real-world tests can lead to signif…

Cited by 149SourcePDFScholar
2019

Batched Stochastic Bayesian Optimization via Combinatorial Constraints Design

AISTATS 2019poster

In many high-throughput experimental design settings, such as those common in biochemical engineering, batched queries are often more cost effective than one-by-one sequential queries. Furthermore, it is often not possible to directly choose items to query. Instead, the experimenter specifies a set…

Cited by 25SourcePDFScholar
2019

Control Regularization for Reduced Variance Reinforcement Learning

ICML 2019oral

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on problems arising in continuous control, we propose a functional…

2019

Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems

IROS 2019poster

Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge, weakening theoretical guarantees and causing implementation fai…

Cited by 91SourceScholar
2019

Generating Multi-Agent Trajectories using Programmatic Weak Supervision

ICLR 2019poster

We study the problem of training sequential generative models for capturing coordinated multi-agent trajectory behavior, such as offensive basketball gameplay. When modeling such settings, it is often beneficial to design hierarchical models that can capture long-term coordination using intermedia…

Cited by 101SourcePDFScholar
2019

Imitation-Projected Programmatic Reinforcement Learning

NeurIPS 2019poster

We study the problem of programmatic reinforcement learning, in which policies are represented as short programs in a symbolic language. Programmatic policies can be more interpretable, generalizable, and amenable to formal verification than neural policies; however, designing rigorous learning appr…

Cited by 121SourcePDFScholar
2019

NAOMI: Non-Autoregressive Multiresolution Sequence Imputation

NeurIPS 2019poster

Missing value imputation is a fundamental problem in spatiotemporal modeling, from motion tracking to the dynamics of physical systems. Deep autoregressive models suffer from error propagation which becomes catastrophic for imputing long-range sequences. In this paper, we take a non-autoregressive a…

2019

Neural Lander: Stable Drone Landing Control Using Learned Dynamics

ICRA 2019poster

Precise near-ground trajectory control is difficult for multi-rotor drones, due to the complex aerodynamic effects caused by interactions between multi-rotor airflow and the environment. Conventional control methods often fail to properly account for these complex effects and fall short in accomplis…

Cited by 370SourceScholar
2019

Teaching Multiple Concepts to a Forgetful Learner

NeurIPS 2019poster

How can we help a forgetful learner learn multiple concepts within a limited time frame? While there have been extensive studies in designing optimal schedules for teaching a single concept given a learner's memory model, existing approaches for teaching multiple concepts are typically based on heur…

Cited by 29SourcePDFScholar
2018

Hierarchical Imitation and Reinforcement Learning

ICML 2018oral

We study how to effectively leverage expert feedback to learn sequential decision-making policies. We focus on problems with sparse rewards and long time horizons, which typically pose significant challenges in reinforcement learning. We propose an algorithmic framework, called hierarchical guidance…

Cited by 251SourcePDFScholar
2018

Learning to Infer

ICLR 2018workshop

Inference models, which replace an optimization-based inference procedure with a learned model, have been fundamental in advancing Bayesian deep learning, the most notable example being variational auto-encoders (VAEs). In this paper, we propose iterative inference models, which learn how to optimiz…

Cited by 7SourceScholar
2018

Near-Optimal Machine Teaching via Explanatory Teaching Sets

AISTATS 2018poster

Modern applications of machine teaching for humans often involve domain-specific, non- trivial target hypothesis classes. To facilitate understanding of the target hypothesis, it is crucial for the teaching algorithm to use examples which are interpretable to the human learner. In this paper, we pro…

Cited by 0SourcePDFScholar
2018

Teaching Categories to Human Learners With Visual Explanations

CVPR 2018poster

We study the problem of computer-assisted teaching with explanations. Conventional approaches for machine teaching typically only provide feedback at the instance level e.g., the category or label of the instance. However, it is intuitive that clear explanations from a knowledgeable teacher can…

Cited by 86SourcePDFScholar
2018

Understanding the Role of Adaptivity in Machine Teaching: The Case of Version Space Learners

NeurIPS 2018poster

In real-world applications of education, an effective teacher adaptively chooses the next example to teach based on the learner’s current state. However, most existing work in algorithmic machine teaching focuses on the batch setting, where adaptivity plays no role. In this paper, we study the case…

Cited by 53SourcePDFScholar
2017

Factorized Variational Autoencoders for Modeling Audience Reactions to Movies

CVPR 2017poster

Matrix and tensor factorization methods are often used for finding underlying low-dimensional patterns from noisy data. In this paper, we study non-linear tensor factoriza- tion methods based on deep variational autoencoders. Our approach is well-suited for settings where the relationship between th…

Cited by 68PDFScholar
2017

Learning Recurrent Representations for Hierarchical Behavior Modeling

ICLR 2017poster

We propose a framework for detecting action patterns from motion sequences and modeling the sensory-motor relationship of animals, using a generative recurrent neural network. The network has a discriminative part (classifying actions) and a generative part (predicting motion), whose recurrent cells…

Cited by 59SourceScholar
2016

Learning Online Smooth Predictors for Realtime Camera Planning Using Recurrent Decision Trees

CVPR 2016oral

We study the problem of online prediction for realtime camera planning, where the goal is to predict smooth trajectories that correctly track and frame objects of interest (e.g., players in a basketball game). The conventional approach for training predictors does not directly consider temporal cons…

Cited by 69PDFScholar