Sipeng Zheng*

UniCode : Learning a Unified Codebook for Multimodal Large Language Models

"In this paper, we propose UniCode, a novel approach within the domain of multimodal large language models (MLLMs) that learns a unified codebook to efficiently tokenize visual, text, and potentially other types of signals. This innovation addresses a critical limitation in existing MLLMs: their rel…