Image dehazing by artificial multiple-exposure image fusion

Abstract Bad weather conditions can reduce visibility on images acquired outdoors, decreasing their visual quality. The image processing task concerned with the mitigation of this effect is known as image dehazing. In this paper we present a new image dehazing technique that can remove the visual degradation due to haze without relying on the inversion of a physical model of haze formation, but respecting its main underlying assumptions. Hence, the proposed technique avoids the need of estimating depth in the scene, as well as costly depth map refinement processes. To achieve this goal, the original hazy image is first artificially under-exposed by means of a sequence of gamma-correction operations. The resulting set of multiply-exposed images is merged into a haze-free result through a multi-scale Laplacian blending scheme. A detailed experimental evaluation is presented in terms of both qualitative and quantitative analysis. The obtained results indicate that the fusion of artificially under-exposed images can effectively remove the effect of haze, even in challenging situations where other current image dehazing techniques fail to produce good-quality results. An implementation of the technique is open-sourced for reproducibility ( https://github.com/agaldran/amef_dehazing ).

[1]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[3]  Baran Çürüklü,et al.  Intensity normalization of sidescan sonar imagery , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[4]  Subhasis Chaudhuri,et al.  Bilateral Filter Based Compositing for Variable Exposure Photography , 2009, Eurographics.

[5]  Shih-Chia Huang,et al.  Efficient Contrast Enhancement Using Adaptive Gamma Correction With Weighting Distribution , 2013, IEEE Transactions on Image Processing.

[6]  Hiroshi Nagahashi,et al.  Cross-Parameterization for Triangular Meshes with Semantic Features , 2007 .

[7]  Javier Vazquez-Corral,et al.  Simultaneous Blind Gamma Estimation , 2015, IEEE Signal Processing Letters.

[8]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH 2008.

[9]  Zhengjun Zhai,et al.  Video dehazing for surveillance unmanned aerial vehicle , 2016, 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC).

[10]  Michael S. Brown,et al.  Haze Visibility Enhancement: A Survey and Quantitative Benchmarking , 2016, Comput. Vis. Image Underst..

[11]  Javier Vazquez-Corral,et al.  Fusion-Based Variational Image Dehazing , 2017, IEEE Signal Processing Letters.

[12]  Javier Vazquez-Corral,et al.  Enhanced Variational Image Dehazing , 2015, SIAM J. Imaging Sci..

[13]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[14]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Marcelo Bertalmío,et al.  Image Processing for Cinema , 2014 .

[17]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[18]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[19]  Hai-Miao Hu,et al.  A fast image dehazing algorithm based on negative correction , 2014, Signal Process..

[20]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[21]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[22]  Zhou Wang,et al.  Perceptual evaluation of single image dehazing algorithms , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[23]  Jon Y. Hardeberg,et al.  Stress for dehazing , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[24]  Paul S. Heckbert,et al.  Graphics gems IV , 1994 .

[25]  Shanto Rahman,et al.  An adaptive gamma correction for image enhancement , 2016, EURASIP J. Image Video Process..

[26]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[27]  P. J. Burt,et al.  The Pyramid as a Structure for Efficient Computation , 1984 .

[28]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Chunxia Xiao,et al.  Fast image dehazing using guided joint bilateral filter , 2012, The Visual Computer.

[30]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[31]  Jean-Philippe Tarel,et al.  Towards Fog-Free In-Vehicle Vision Systems through Contrast Restoration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Xinbo Gao,et al.  Haze removal for a single visible remote sensing image , 2017, Signal Process..

[33]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[34]  Christophe De Vleeschouwer,et al.  D-HAZY: A dataset to evaluate quantitatively dehazing algorithms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[35]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  K. Pulli,et al.  Color Matching of Image Sequences with Combined Gamma and Linear Corrections , 2010 .

[38]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[39]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[40]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[41]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[42]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[44]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[45]  Hany Farid,et al.  Blind inverse gamma correction , 2001, IEEE Trans. Image Process..

[46]  Bo Gu,et al.  Gradient field multi-exposure images fusion for high dynamic range image visualization , 2012, J. Vis. Commun. Image Represent..

[47]  Alessandro Bria,et al.  On the Duality Between Retinex and Image Dehazing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[48]  Alan C. Bovik,et al.  Color and Depth Priors in Natural Images , 2013, IEEE Transactions on Image Processing.

[49]  Shih-Chia Huang,et al.  An Advanced Single-Image Visibility Restoration Algorithm for Real-World Hazy Scenes , 2015, IEEE Transactions on Industrial Electronics.

[50]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[51]  Seung-Won Jung,et al.  A review on dark channel prior based image dehazing algorithms , 2016, EURASIP Journal on Image and Video Processing.

[52]  Tianxu Zhang,et al.  Adaptive gamma correction based on cumulative histogram for enhancing near-infrared images , 2016 .

[53]  Shih-Chia Huang,et al.  Visibility Restoration of Single Hazy Images Captured in Real-World Weather Conditions , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[54]  Michael S. Brown,et al.  A Contrast Enhancement Framework with JPEG Artifacts Suppression , 2014, ECCV.

[55]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[56]  Chang-Su Kim,et al.  Optimized contrast enhancement for real-time image and video dehazing , 2013, J. Vis. Commun. Image Represent..

[57]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[58]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.