Cross-Spectral Image Dehaze through a Dense Stacked Conditional GAN Based Approach

This paper proposes a novel approach to remove haze from RGB images using a near infrared images based on a dense stacked conditional Generative Adversarial Network (CGAN). The architecture of the deep network implemented receives, besides the images with haze, its corresponding image in the near infrared spectrum, which serve to accelerate the learning process of the details of the characteristics of the images. The model uses a triplet layer that allows the independence learning of each channel of the visible spectrum image to remove the haze on each color channel separately. A multiple loss function scheme is proposed, which ensures balanced learning between the colors and the structure of the images. Experimental results have shown that the proposed method effectively removes the haze from the images. Additionally, the proposed approach is compared with a state of the art approach showing better results.

[1]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Zhihan Lv,et al.  A real-time image dehazing method considering dark channel and statistics features , 2017, Journal of Real-Time Image Processing.

[3]  Rudolf Richter,et al.  Atmospheric correction of satellite data with haze removal including a haze/clear transition region , 1996 .

[4]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[5]  Jizheng Xu,et al.  An All-in-One Network for Dehazing and Beyond , 2017, ArXiv.

[6]  Seung-Won Jung,et al.  A review on dark channel prior based image dehazing algorithms , 2016, EURASIP Journal on Image and Video Processing.

[7]  Angel D. Sappa,et al.  Cross-spectral image patch similarity using convolutional neural network , 2017, 2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM).

[8]  John E. Hopcroft,et al.  Stacked Generative Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Angel D. Sappa,et al.  Learning image vegetation index through a conditional generative adversarial network , 2017, 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM).

[11]  Vishal M. Patel,et al.  Joint Transmission Map Estimation and Dehazing Using Deep Networks , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[13]  Yunbo Rao,et al.  Hybrid single image dehazing with bright channel and dark channel priors , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[14]  Angel Domingo Sappa,et al.  Infrared Image Colorization Based on a Triplet DCGAN Architecture , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH 2008.

[16]  Theo Gevers,et al.  A Perceptual Comparison of Distance Measures for Color Constancy Algorithms , 2008, ECCV.

[17]  Martin Kleinsteuber,et al.  A RGB/NIR Data Set For Evaluating Dehazing Algorithms , 2017 .

[18]  Riad I. Hammoud,et al.  Deep Learning Based Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[20]  Hamzah Asyrani Sulaiman,et al.  Digital Image Enhancement Using Enhanced Detail and Dehaze Technique (DDE) , 2018 .

[21]  Qinchao Huang,et al.  Polarization filtering for automatic image dehazing based on contrast enhancement , 2017, 2017 IEEE 9th International Conference on Communication Software and Networks (ICCSN).

[22]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[23]  Yoav Y. Schechner,et al.  Blind Haze Separation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).