DiffRS: An Extensible Diffusion Model for Remote Sensing Image Generation

Abstract

Remote sensing image generation is of great value for virtual environment creation and adversarial learning for fake news detection. It could also address the learning sample shortage in the region of interest. However, most current image generation methods are limited to producing images of fixed sizes, few studies on extensible natural image generation largely focus on the stitching of random contents, lacking effective exploration of contextual information, which weakens the coherence of the extended images. To address this problem, we propose an extensible generation method for remote sensing images with the model DiffRS. This approach allows for sequential extension of arbitrary sizes by exploring the generated neighboring regions. The method is particularly suitable for scenes like remote sensing images where a generation block could cover multiple independent targets, rather than natural image tasks which may stitch across regions to form a completely target. Compared to the state-of-the-art extensible generation methods, DiffRS could improve the large scale image generation with better structure consistency, richer details and higher realism. Experiments showed that DiffRS could improve the FID score by 4.6% and 3.2% respectively in comparison with the MultiDiffusion and Mixture of Diffuser models.