Jayaganesh Kalyanasundaram

Talk to the Vehicle: Language Conditioned Autonomous Navigation of Self Driving Cars

We propose a novel pipeline that blends encodings from natural language and 3D semantic maps obtained from visual imagery to generate local trajectories that are executed by a low-level controller. The pipeline precludes the need for a prior registered map through a local waypoint generator neural n…