MAITFuse: Multi-Dimension Adaptive Interaction Transform Network For Infrared-visible Image Fusion

Abstract

In recent years, Transformers have achieved significant success in image fusion. These methods utilize self-attention mechanism across different spatial or channel dimensions and have demonstrated impressive performance. However, existing methods only optimize along a single dimension and struggle to simultaneously capture the complex dependencies between spatial and channel dimensions. To address this problem, we propose a novel multi-dimensional adaptive interaction transformer network, named as MAITFuse, to enhance the multilevel information expression and detail retention capabilities of images. We design a Multi-Dimensional Feature Extraction (MDFE) module to extract features across spatial and channel dimensions in parallel, and introduce a novel weighted cross-attention fusion method to integrate multi-dimensional information effectively. Experimental results show that, compared to existing fusion methods, our proposed method achieves superior fusion performance across various datasets.