Single image dehazing based on fusion strategy

Abstract In this paper, we propose a deep convolutional network for single image dehazing based on derived image fusion strategy. Instead of estimating the transmission map and atmospheric light as previously performed, we directly generate a haze-free image by the proposed end-to-end trainable neural network. We derive five maps from the original hazy image based on the characteristics of the hazy scene to improve the dehazing performance. First, the exposure map (EM) and saliency map (SM) complement each other to focus on details in far-away and near-region scenes. Second, the white balance map (BM) and gamma correction map (GM) are employed to recover the latent colour and intensity components of the scene. Finally, the haze veil map (VM) is introduced to enhance the global image contrast. To efficiently blend the five derived maps, we propose a U-shaped deep convolutional network consisting of encoder and decoder layers to generate a haze-free image. The convolutional layers transferred from the pretrained ResNet50 are used as encoder layers for hierarchical feature extraction. Two efficient blocks, named the cascaded residual block and the channel compression block, are proposed in the network for better dehazing performance. The final dehazed result is generated by combining the significant features of the different derived maps. Additionally, perceptual loss is introduced for better visual quality. The experimental results for both synthetic and natural hazy images demonstrate that our algorithm performs comparably or even better than state-of-the-art methods in terms of the peak signal-to-noise ratio (PSNR), structure similarity (SSIM) and visual quality.

[1]  Christophe De Vleeschouwer,et al.  D-HAZY: A dataset to evaluate quantitatively dehazing algorithms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[2]  Shih-Chia Huang,et al.  Visibility Restoration of Single Hazy Images Captured in Real-World Weather Conditions , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Tae Hyun Kim,et al.  Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Zhe Liu,et al.  Single image dehazing using kernel regression model and dark channel prior , 2017, Signal Image Video Process..

[5]  E. J. Mccartney,et al.  Optics of the Atmosphere: Scattering by Molecules and Particles , 1977 .

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[9]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[10]  Raanan Fattal Single image dehazing , 2008, SIGGRAPH 2008.

[11]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Wei Liu,et al.  Gated Fusion Network for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[17]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[19]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[20]  W. Middleton,et al.  Vision Through the Atmosphere , 1952 .

[21]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[22]  Michael S. Brown,et al.  Haze Visibility Enhancement: A Survey and Quantitative Benchmarking , 2016, Comput. Vis. Image Underst..

[23]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[26]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[29]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[32]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[33]  Zhengguo Li,et al.  Edge-Preserving Decomposition-Based Single Image Haze Removal , 2015, IEEE Transactions on Image Processing.

[34]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[36]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[37]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.