Self-Support Prototype-Aware For Few-Shot Semantic Segmentation

Abstract

In recent years, significant progress has been made in prototype-based learning methods for few-shot semantic segmentation. However, prototype features originating from the support images are interfered with by intra-class diversity and thus cannot be aligned with the query foreground, resulting in poor segmentation accuracy. Therefore, we propose a novel self-support prototype-aware (SSPA) network to obtain highly confident query foreground pixel points and their corresponding query features. We design Cycle Consistency Collection module and Self-Support Collection module to address the interference of invalid support prototypes. Experimental results demonstrate that our SSPA significantly improves the quality of prototypes and achieves state-of-the-art segmentation results on multiple datasets. In particular, SSPA achieves mIoU scores of 69.7% and 76.4% for 1-shot and 5-shot segmentation, respectively, on PASCAL-5<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">i</sup>.