ALIC: Adaptive Fusion Entropy Model for Learned Image Compression

Abstract

Recently, learned image compression algorithms have achieved significant performance. The entropy model is crucial for improving the rate-distortion performance by estimating the probability distribution of latent representation. In this paper, we propose an adaptive fusion entropy model for learned image compression (ALIC). To explore the correlation between channel and global spatial features, an adaptive fusion entropy model (AFEM) is designed. AFEM first slices the latent representation along the channels and leverages the adaptive channel fusion context module (ACFC) to capture correlations between the decoded and current slices. Subsequently, AFEM uses the adaptive spatial fusion context module (ASFC) to further divide the current slice into encoding pixels and reference pixels, thus improving the accuracy of probability estimation. The attention map and modulation parameter are introduced in ACFC and ASFC to interact with channel and spatial features. In addition, the variable-rate residual transformer (VResFormer) is proposed to control dynamic bit-rate by selectively modulating the high-frequency component according to coefficient weight and bias. Experimental results indicate that our ALIC outperforms other learned image compression algorithms. Our ALIC saves 5.89% bit-rate compared with VVC (4:4:4) on Kodak dataset.