Astra: Efficient Transformer Architecture and Contrastive Dynamics Learning for Embodied Instruction Following
Vision-language-action models have gained significant attention for their ability to model multimodal sequences in embodied instruction following tasks. However, most existing models rely on causal attention, which we find suboptimal for processing sequences composed of interleaved segments from dif