Dennis Koelma

TWIST & SCOUT: Grounding Multimodal LLM-Experts by Forget-Free Tuning

Spatial awareness is key to enable embodied multimodal AI systems. Yet, without vast amounts of spatial supervision, current Multimodal Large Language Models (MLLMs) struggle at this task. In this paper, we introduce TWIST & SCOUT, a framework that equips pre-trained MLLMs with visual grounding abil…