Nikhil Sridhar

This&That: Language-Gesture Controlled Video Generation for Robot Planning

Clear, interpretable instructions are invaluable for complex tasks, helping to clarify goals and anticipate necessary steps. In this work, we propose a robot learning framework for communicating, planning, and executing a wide range of tasks, dubbed This&That. This&That solves general tasks by lever