2026
CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs
ICLR 2026poster
Recently, efficient Multimodal Large Language Models (MLLMs) have gained significant attention as a solution to their high computational complexity, making them more practical for real-world applications. In this regard, the knowledge distillation (KD) approach has emerged as a promising alternative…