Single image dehazing via atmospheric scattering model-based image fusion

Abstract Scene visibility in outdoor images is often deteriorated by bad weather conditions such as snow, haze, and rain. Especially, degradation due to haze is typically observed in the form of faded color and low contrast of images. To overcome image degradation, dehazing algorithms based on the atmospheric scattering model employ transmission map estimation, which is related to the haze density across the depth of scenes. However, estimating the depth of the outdoor scene without additional information is challenging, and an erroneously estimated depth leads to a dehazed image of poor quality. In this paper, we propose a fusion-based dehazing algorithm that does not require direct estimation of the transmission map. The intermediate latent images are obtained by restoring the scene radiance with several globally constant transmission values based on the atmospheric scattering model. Using this approach, only the region where the particular transmission corresponds to the ground truth is dehazed successfully in each image. These images are merged into a haze-free result via the fusion algorithm, which selectively uses the information of the patches from the latent images. Experimental results show that the proposed algorithm effectively removes haze and outperforms the several dehazing methods based on quantitative and qualitative evaluations.

[1]  Gaurav Sharma,et al.  HazeRD: An outdoor scene dataset and benchmark for single image dehazing , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[2]  Jean-Philippe Tarel,et al.  Improved visibility of road scene images under heterogeneous fog , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[4]  Ling-Yu Duan,et al.  Multi-scale Optimal Fusion model for single image dehazing , 2019, Signal Process. Image Commun..

[5]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[8]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[9]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[10]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Zhengguo Li,et al.  Single Image De-Hazing Using Globally Guided Image Filtering. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[14]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Ling Shao,et al.  Single Image Dehazing Based on the Physical Model and MSRCR Algorithm , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[17]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Xuelong Li,et al.  Exposure Fusion Using Boosting Laplacian Pyramid , 2014, IEEE Transactions on Cybernetics.

[19]  Raanan Fattal Single image dehazing , 2008, SIGGRAPH 2008.

[20]  Ming-Hsuan Yang,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks with Holistic Edges , 2019, International Journal of Computer Vision.

[21]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[22]  P. Chavez An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[23]  Zhengfang Duanmu,et al.  Multi-Exposure Image Fusion by Optimizing A Structural Similarity Index , 2018, IEEE Transactions on Computational Imaging.

[24]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[25]  Libao Zhang,et al.  Saliency-driven single image haze removal method based on reliable airlight and transmission , 2018 .

[26]  Kede Ma,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[27]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[28]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[29]  Hanseok Ko,et al.  Single image dehazing with image entropy and information fidelity , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[30]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[31]  Subhasis Chaudhuri,et al.  Bilateral Filter Based Compositing for Variable Exposure Photography , 2009, Eurographics.

[32]  Adrian Galdran,et al.  Image dehazing by artificial multiple-exposure image fusion , 2018, Signal Process..

[33]  Wei Liu,et al.  Gated Fusion Network for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[35]  Shree K. Nayar,et al.  Removing weather effects from monochrome images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[36]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[37]  Jean-Philippe Tarel,et al.  BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGES , 2011 .

[38]  Alessandro Rizzi,et al.  A proposal for Contrast Measure in Digital Images , 2004, CGIV.

[39]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[40]  Shree K. Nayar,et al.  Polarization-based vision through haze , 2003 .

[41]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[42]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[44]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..