Single image dehazing via self-constructing image fusion

Abstract Haze usually degrades the visibility of outdoor images and decreases their visual quality. Previous techniques are not sufficient enough to deal with dehazing problem by using various hand-crafted priors or supervised training on paired manners. In this paper, we propose a self-constructing image fusion method for single image dehazing, which does not rely on the accuracy of global atmospheric light and transmission map. Hence, the proposed method can avoid some visual problems, such as undesirable brightness perception, unsatisfied halo artifacts and edge blur in sky regions or bright objects in dehazed images. To produce several self-constructing images with different exposures, a novel segmentation method is exploited to capture the range of global atmospheric light approximately, and a new adaptive boundary-limited L0 gradient optimization method is employed to optimize the transmission map. An adaptive selective SIFT flow multi-exposure fusion method is constructed by applying the two-layer visual sensory selector. Extensive experimental results on both synthetic and real-world images demonstrate that the proposed algorithm performs favorably against the state-of-the-art algorithms in terms of no-reference and full-reference image quality.

[1]  Raanan Fattal Single image dehazing , 2008, SIGGRAPH 2008.

[2]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  Anna Wang,et al.  AIPNet: Image-to-Image Single Image Dehazing With Atmospheric Illumination Prior , 2019, IEEE Transactions on Image Processing.

[5]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Konstantinos N. Plataniotis,et al.  Image Sharpness Metric Based on Maxpol Convolution Kernels , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[8]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Adrian Galdran,et al.  Image dehazing by artificial multiple-exposure image fusion , 2018, Signal Process..

[10]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[13]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[14]  Wonha Kim,et al.  Single Image Dehazing Using Color Ellipsoid Prior , 2018, IEEE Transactions on Image Processing.

[15]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[16]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[17]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[18]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[19]  Jun Li,et al.  Single fog image restoration with multi-focus image fusion , 2018, J. Vis. Commun. Image Represent..

[20]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[21]  Hazim Kemal Ekenel,et al.  Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Different Scenes , 2008, ECCV.

[23]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[25]  Christophe De Vleeschouwer,et al.  D-HAZY: A dataset to evaluate quantitatively dehazing algorithms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[26]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jian Yao,et al.  Single Image Dehazing Using Deep Convolution Neural Networks , 2017, PCM.

[28]  Wei Liu,et al.  Gated Fusion Network for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Javier Vazquez-Corral,et al.  Fusion-Based Variational Image Dehazing , 2017, IEEE Signal Processing Letters.

[32]  Vishal M. Patel,et al.  Multi-scale Single Image Dehazing Using Perceptual Pyramid Deep Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[34]  Ling Shao,et al.  Single Image Dehazing Using Color Attenuation Prior , 2014, BMVC.

[35]  Weixing Wang,et al.  Single Image Dehazing Based on Deep Neural Network , 2017, 2017 International Conference on Computer Network, Electronic and Automation (ICCNEA).

[36]  Rui Li,et al.  Haze removal based on multiple scattering model with superpixel algorithm , 2016, Signal Process..

[37]  Joo-Hwee Lim,et al.  DehazeGAN: When Image Dehazing Meets Differential Programming , 2018, IJCAI.

[38]  Jean-Philippe Tarel,et al.  Towards Fog-Free In-Vehicle Vision Systems through Contrast Restoration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[41]  Xiaowu Chen,et al.  Single Image Dehazing Using Ranking Convolutional Neural Network , 2018, IEEE Transactions on Multimedia.

[42]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[43]  Vishal M. Patel,et al.  Densely Connected Pyramid Dehazing Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[44]  Liwei Zhang,et al.  Dark Channel: The Devil is in the Details , 2019, IEEE Signal Processing Letters.