Remote Sensing Image Colorization Based on Multiscale SEnet GAN

Image colorization technique is to colorize the grayscale images or single-channel images. In the research of image colorization, the coloring of remote sensing images is a challenging problem. This paper proposes a new method of remote sensing image colorization method based on Deep Convolution Generative Adversarial Network (DCGAN). We combine multi-scale convolution with Squeeze-and-Excitation Networks (SEnet) to propose a new model that is applied to the generator of DCGAN. Therefore, the generator not only retains the largest image features in the process of the generating images, but also can adjust the channel weights in the training process. We have compared the proposed method with other image colorization methods, and the results show that the proposed method has a good performance on both human vision and image evaluation indicators on the colorization of remote sensing images.

[1]  Domonkos Varga,et al.  Fully automatic image colorization based on Convolutional Neural Network , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[2]  Dani Lischinski,et al.  Colorization by example , 2005, EGSR '05.

[3]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[5]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[6]  Qifeng Chen,et al.  Fully Automatic Video Colorization With Self-Regularization and Diversity , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[9]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  Xin Jin,et al.  Remote sensing image fusion method in CIELab color space using nonsubsampled shearlet transform and pulse coupled neural networks , 2016 .

[11]  Muhammad Usman Ghani Khan,et al.  Medical Image Colorization for Better Visualization and Segmentation , 2017, Annual Conference on Medical Image Understanding and Analysis.

[12]  Hiroshi Ishikawa,et al.  Let there be color! , 2016, ACM Trans. Graph..

[13]  Andrew Chi-Sing Leung,et al.  Scribble-based gradient mesh recoloring , 2017, Multimedia Tools and Applications.

[14]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Kamyar Nazeri,et al.  Image Colorization with Generative Adversarial Networks , 2018, ArXiv.

[17]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[18]  Yu-Kun Lai,et al.  Example-based image colorization via automatic feature selection and fusion , 2017, Neurocomputing.

[19]  Angel Domingo Sappa,et al.  Infrared Image Colorization Based on a Triplet DCGAN Architecture , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[20]  Yong Yu,et al.  Unsupervised Diverse Colorization via Generative Adversarial Networks , 2017, ECML/PKDD.

[21]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).