Ruyi Ouyang

Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

The rapid development of multimodal large language models (MLLMs), such as GPT-4V, has led to significant advancements. However, these models still face challenges in medical multimodal capabilities due to limitations in the quantity and quality of medical vision-text data, stemming from data privac…