← Search

John Z Zhang

8 accepted papers

2025

Real-Time Whole-Body Control of Legged Robots with Model-Predictive Path Integral Control

ICRA 2025

This paper presents a system for enabling real-time synthesis of whole-body locomotion and manipulation policies for real-world legged robots. Motivated by recent advancements in robot simulation, we leverage the efficient parallelization capabilities of the MuJoCo simulator on a multi-core CPU to a

Cited by 33SourcecodeScholar
2025

Robots with Attitude: Singularity-Free Quaternion-Based Model-Predictive Control for Agile Legged Robots

ICRA 2025

We present a model-predictive control (MPC) framework for legged robots that avoids the singularities associated with common three-parameter attitude representations like Euler angles during large-angle rotations. Our method parameterizes the robot's attitude with singularity-free unit quaternions a

Cited by 2SourcecodeScholar
2025

Wallbounce: Push Wall to Navigate with Contact-Implicit MPC

ICRA 2025

In this work, we introduce a framework that enables highly maneuverable locomotion using non-periodic contacts. This task is challenging for traditional optimization and planning methods to handle due to difficulties in specifying contact mode sequences in real-time. To address this, we use a bi-lev

Cited by 1SourcecodeScholar
2024

ReLU-QP: A GPU-Accelerated Quadratic Programming Solver for Model-Predictive Control

ICRA 2024poster

We present ReLU-QP, a GPU-accelerated solver for quadratic programs (QPs) that is capable of solving high-dimensional control problems at real-time rates. ReLU-QP is derived by exactly reformulating the Alternating Direction Method of Multipliers (ADMM) algorithm for solving QPs as a deep, weight-ti…

Cited by 15SourcecodeScholar
2023

PPR: Physically Plausible Reconstruction from Monocular Videos

ICCV 2023oral

Given monocular videos, we build 3D models of articulated objects and environments whose 3D configurations satisfy dynamics and contact constraints. At its core, our method leverages differentiable physics simulation to aid visual reconstructions. We couple differentiable physics simulation with dif…

Cited by 31PDFcodeScholar
2023

SLoMo: A General System for Legged Robot Motion Imitation From Casual Videos

RA-L 2023

We present SLoMo: a first-of-its-kind framework for transferring skilled motions from casually captured “in-the-wild” video footage of humans and animals to legged robots. SLoMo works in three stages: 1) synthesize a physically plausible reconstructed key-point trajectory from monocular videos; 2) o

Cited by 29SourcecodeScholar
2022

Fast Aquatic Swimmer Optimization with Differentiable Projective Dynamics and Neural Network Hydrodynamic Models

ICML 2022spotlight

Aquatic locomotion is a classic fluid-structure interaction (FSI) problem of interest to biologists and engineers. Solving the fully coupled FSI equations for incompressible Navier-Stokes and finite elasticity is computationally expensive. Optimizing robotic swimmer design within such a system gener…

Cited by 16SourcePDFScholar
2022

Sim2Real for Soft Robotic Fish via Differentiable Simulation

IROS 2022poster

Accurate simulation of soft mechanisms under dynamic actuation is critical for the design of soft robots. We address this gap with our differentiable simulation tool by learning the material parameters of our soft robotic fish. On the example of a soft robotic fish, we demonstrate an experimentally-…

Cited by 22SourceScholar