Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
In this paper, we present the Draw-and-Understand framework, exploring how to integrate visual prompting understanding capabilities into Multimodal Large Language Models (MLLMs). Visual prompts allow users to interact through multi-modal instructions, enhancing the models' interactivity and fine-gra…