Single Image Defogging by Multiscale Depth Fusion

Restoration of fog images is important for the deweathering issue in computer vision. The problem is ill-posed and can be regularized within a Bayesian context using a probabilistic fusion model. This paper presents a multiscale depth fusion (MDF) method for defog from a single image. A linear model representing the stochastic residual of nonlinear filtering is first proposed. Multiscale filtering results are probabilistically blended into a fused depth map based on the model. The fusion is formulated as an energy minimization problem that incorporates spatial Markov dependence. An inhomogeneous Laplacian–Markov random field for the multiscale fusion regularized with smoothing and edge-preserving constraints is developed. A nonconvex potential, adaptive truncated Laplacian, is devised to account for spatially variant characteristics such as edge and depth discontinuity. Defog is solved by an alternate optimization algorithm searching for solutions of depth map by minimizing the nonconvex potential in the random field. The MDF method is experimentally verified by real-world fog images including cluttered-depth scene that is challenging for defogging at finer details. The fog-free images are restored with improving contrast and vivid colors but without over-saturation. Quantitative assessment of image quality is applied to compare various defog methods. Experimental results demonstrate that the accurate estimation of depth map by the proposed edge-preserved multiscale fusion should recover high-quality images with sharp details.

[1]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Ken D. Sauer,et al.  ML parameter estimation for Markov random fields with applications to Bayesian tomography , 1998, IEEE Trans. Image Process..

[3]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[5]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH Asia '08.

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Andrew Blake,et al.  LogCut - Efficient Graph Cut Optimization for Markov Random Fields , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Josiane Zerubia,et al.  Hyperparameter estimation for satellite image restoration using a MCMC maximum-likelihood method , 2002, Pattern Recognit..

[10]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Nikolas P. Galatsanos,et al.  Bayesian Restoration Using a New Nonstationary Edge-Preserving Image Prior , 2006, IEEE Transactions on Image Processing.

[12]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[14]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[15]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[16]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[17]  Manjunath V. Joshi,et al.  New Learning Based Super-Resolution: Use of DWT and IGMRF Prior , 2010, IEEE Transactions on Image Processing.

[18]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[19]  John W. Woods,et al.  Compound Gauss-Markov random fields for image estimation , 1991, IEEE Trans. Signal Process..

[20]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[21]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[22]  Federico Girosi,et al.  Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Aggelos K. Katsaggelos,et al.  Restoration of Severely Blurred High Range Images Using Stochastic and Deterministic Relaxation Algorithms in Compound Gauss Markov Random Fields , 1997, EMMCVPR.

[24]  Josiane Zerubia,et al.  An adaptive Gaussian model for satellite image deblurring , 2004, IEEE Transactions on Image Processing.

[25]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Peter Carr,et al.  Improved Single Image Dehazing Using Geometry , 2009, 2009 Digital Image Computing: Techniques and Applications.

[27]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[28]  Robert G. Aykroyd,et al.  Bayesian Estimation for Homogeneous and Inhomogeneous Gaussian Random Fields , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Jun Zhang,et al.  Parameter reduction for the compound Gauss-Markov model , 1995, IEEE Trans. Image Process..

[30]  John P. Oakley,et al.  Correction of Simple Contrast Loss in Color Images , 2007, IEEE Transactions on Image Processing.

[31]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[33]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Jean-Philippe Tarel,et al.  Markov Random Field model for single image defogging , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[35]  Manjunath V. Joshi,et al.  MAP Estimation for Multiresolution Fusion in Remotely Sensed Images Using an IGMRF Prior Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[37]  Jizhou Sun,et al.  Local albedo-insensitive single image dehazing , 2010, The Visual Computer.

[38]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.