Miaosen Chai

PSALM-V: Automating Symbolic Planning in Interactive Visual Environments with Large Language Models

We propose PSALM-V, the first autonomous neuro-symbolic learning system able to induce symbolic action semantics (i.e., pre- and post-conditions) in visual environments through interaction. PSALM-V bootstraps reliable symbolic planning without expert action definitions, using LLMs to generate heuris…