Grace Tang

KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation Without Robot Data

Building generalist robotic systems involves effectively endowing robots with the capabilities to handle novel objects in an open-world setting. Inspired by the advances of large pre-trained models, we propose Keypoint Affordance Learning from Imagined Environments (KALIE), which adapts pre-trained