PHC-GAN: Physical Constraint Generative Adversarial Network for Single Image Dehazing

Recently, most existing single image dehazing methods adopt the physical scattering model to generate clear images. The model variables are often estimated by trainable neural networks. However, estimating the variables heavily rely on dataset that usually does not take into account of the physical process induced by the scattering model. In this scheme, error accumulation cannot be avoided when applying the end-to-end methods. In this paper, we propose a physical constraint generative adversarial network (PHC-GAN) for single image dehazing. The PHC-GAN is a physics aware model that leveraging the physical scattering process as an additional constraint. To the best of our knowledge, we are the first introducing physical constraint in learning an end-to-end image dehazing model. Our proposed model not only effectively reduce the error accumulation, but can be well adapted in complex and realistic natural scenes compared to the existing methods. In detail, we realize the physical constraint in terms of a double discriminator architecture. The self-attention module is also utilized to guarantee fast convergence. In experiments, quantitative and qualitative results on both synthetic and natural images demonstrate that PHC-GAN is superior to state-of-the-art dehazing methods.

[1]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[2]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[3]  Jinhui Tang,et al.  Single Image Dehazing via Conditional Generative Adversarial Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[6]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xin Fan,et al.  Two-Layer Gaussian Process Regression With Example Selection for Image Dehazing , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Hazim Kemal Ekenel,et al.  Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[10]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[11]  Vishal M. Patel,et al.  Densely Connected Pyramid Dehazing Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Alain Trémeau,et al.  Residual Conv-Deconv Grid Network for Semantic Segmentation , 2017, BMVC.

[13]  Huazhu Fu,et al.  A Cascaded Convolutional Neural Network for Single Image Dehazing , 2018, IEEE Access.

[14]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH Asia '08.

[15]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[16]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[19]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[20]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.