Haebin Na

Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM

The Transformer’s quadratic complexity with input length imposes an unsustainable computational load on large language models (LLMs). In contrast, the Selective Scan Structured State-Space Model, or Mamba, addresses this computational challenge effectively. This paper explores a query-based cross-mo…