Anson Lei

SPARTAN: A Sparse Transformer World Model Attending to What Matters

Capturing the interactions between entities in a structured way plays a central role in world models that flexibly adapt to changes in the environment. Recent works motivate the benefits of models that explicitly represent the structure of interactions and formulate the problem as discovering local…