Antara R Bhattacharya

Schema-Guided World Modeling for Understanding Hierarchical Visual Dynamics

Multimodal LLMs lack a systematic understanding of visual dynamics in complex human world activities, which requires the model to predict or simulate multiple levels of dynamic constituents, such as the general progression of actions and the associated changes of low-level details in the world. To a…