Domain Connection based Unsupervised Domain Adaptation for Semantic Segmentation

Abstract

Collecting and annotating data for semantic segmentation can end up costing a lot of time and energy. Unsupervised Domain Adaptation (UDA) for semantic segmentation allows models trained on certain source domain data (such as the GTA synthetic dataset) to be applied to certain target data (like the Cityscapes real dataset), significantly decreasing the requirement for target-domain manual pixel-level annotations.In this paper, we suggest a cross-domain unified semantic segmentation network training framework, the Attention Distribution Adaptation Network (ADAN). It (1) proposes the Content Consistency Transformation (CCT), which maps source domain data to an intermediate domain that has a data distribution that is comparable to that of the target domain, and (2) introduces the Attention Adaptation Module (AAM), which bolsters the synchronization of attention between the intermediate domain and the target domain. ADAN achieved unprecedented mIoUs of 77.2 and 68.8 on GTA→Cityscapes and Synthia→Cityscapes, respectively, corresponding to improvements of +1.3 and +0.6 over the state of the art.