Interactive Deep Colorization Using Simultaneous Global and Local Inputs

Abstract

Colorization methods using deep neural networks have become a recent trend. However, most of them do not allow user inputs, or only allow limited user inputs (only global inputs or only local inputs), to control the output colorful images. The possible reason is that it's difficult to differentiate the influence of different kind of user inputs in network training. To solve this problem, we propose a novel deep colorization method allowing inputting global and local inputs simultaneously or individually, which is not supported in previous deep colorization methods. The key steps include designing a neural network model that can appropriately combine the different inputs, and designing an appropriate loss function that can differentiate the influence of different inputs. Experimental results show that our method can magnificently control the colorized results and generate state-of-art results.