ICAA-Mamba: Vision Mamba for Image Color Aesthetics Assessment

Abstract

Image Color Aesthetics Assessment (ICAA) focuses on evaluating the aesthetic quality of color composition within images. This task involves analyzing and quantifying the visual appeal of color arrangements, taking into account factors such as harmony, contrast, and balance, to provide an objective assessment of color aesthetics. In this paper, we investigate the application of the State Space Model (Mamba) to the ICAA task, with a focus on exploring the perceptual capabilities of vision Mamba. To this end, we propose a novel framework that employs Mamba as the backbone to extract informative patterns from images, leveraging its global receptive field and linear complexity with respect to input length. Instead of relying solely on a final-layer feature, followed by fully connected layers for quality prediction, we exploit a comprehensive set of multi-scale features, thereby constructing a richer global representation of color information. To fuse these multi-scale features effectively, we introduce a Weighted Feature Fusion Module (WFFM), which adaptively assigns weights to emphasize salient color-related information. We conduct extensive experiments on two benchmark datasets, ICAA17K and SPAQ, successfully demonstrating its effectiveness for the ICAA task. The code is available at https://github.com/qinghaoya/icaa-mamba.