Futang Peng

"MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"

"In this work, we discuss building performant Multimodal Large Language Models (MLLMs). In particular, we study the importance of various architecture components and data choices. Through careful and comprehensive ablations of the image encoder, the vision language connector, and various pre-trainin…