← Search

Junyao Shi

5 accepted papers

2026

VLMgineer: Vision-Language Models as Robotic Toolsmiths

ICLR 2026poster

Tool design and use reflect the ability to understand and manipulate the physical world through creativity, planning, and foresight. As such, it is often regarded as a measurable indicator of cognitive intelligence across biological species. While much of today’s research on robotics intelligence fo…

Cited by 0SourcecodeScholar
2025

ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos

ICRA 2025

Many recent advances in robotic manipulation have come through imitation learning, yet these rely largely on mimicking a particularly hard-to-acquire form of demonstrations: those collected on the same robot in the same room with the same objects as the trained policy must handle at test time. In co

Cited by 23SourcecodeScholar
2024

Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Models

ICRA 2024poster

There have recently been large advances both in pre-training visual representations for robotic control and segmenting unknown category objects in general images. To leverage these for improved robot learning, we propose POCR, a new framework for building pre-trained object-centric representations f…

Cited by 5SourceScholar
2020

Accelerated Robot Learning via Human Brain Signals

ICRA 2020poster

In reinforcement learning (RL), sparse rewards are a natural way to specify the task to be learned. However, most RL algorithms struggle to learn in this setting since the learning signal is mostly zeros. In contrast, humans are good at assessing and predicting the future consequences of actions and…

Cited by 25SourceScholar