Bishift-Net for Image Inpainting

Abstract

Image inpainting remains a challenging task in computer vision which aims to fill in the missing area of a corrupted image with proper contents and generate photorealistic images by using the information from the existing area. Most existing methods always generate contents with blurry texture caused by propogating the convolutional feature through a fully connected layer. To address this problem, Shift-Net[1] is proposed to shift the encoder feature from existing area to serve as an estimation of the missing parts. However, the decoder feature with new encoding information is ingnored. Inspired by this, we propose a new inpainting model, which is called BiShift-Net. BiShift-Net adopts the structure of U-Net, and we introduce a BiShift layer to it. We use the BiShift layer to capture the information from both encoder and decoder features, rearranging the features to generate sharp texture. Experiments show that Bishift-Net outperforms the other state-of-the-art CNN-based methods, while produce more faithful results at the same time.