A Second-Order Variational Framework for Joint Depth Map Estimation and Image Dehazing

Outdoor images captured in poor weather conditions (e.g., fog or haze) commonly suffer from reduced contrast and visibility. Increasing attention has recently been paid to single image dehazing, i.e., improving image contrast and visibility. It is generally thought that the dehazing performance highly depends on the accurate depth information. In this work, we first obtain the initial depth map by using the popular dark channel prior. A unified second-order variational framework is then proposed to refine the depth map and restore the haze-free image. The introduced second-order framework has the capacity of preserving important structures in both depth map and haze-free image. Furthermore, the proposed framework performs well for several different types of haze situations. The resulting optimization problems related to depth map estimation and latent image restoration can be effectively handled using the primal-dual algorithm under a two-step numerical framework. The effectiveness of our proposed method has been demonstrated by comparing the imaging performance with several state-of-the-art dehazing methods.

[1]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[2]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[3]  Chang-Su Kim,et al.  Optimized contrast enhancement for real-time image and video dehazing , 2013, J. Vis. Commun. Image Represent..

[4]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[5]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[6]  Yong Xu,et al.  Review of Video and Image Defogging Algorithms and Related Studies on Image Restoration and Enhancement , 2016, IEEE Access.

[7]  Kristian Bredies,et al.  Joint MR-PET Reconstruction Using a Multi-Channel Image Regularizer , 2017, IEEE Transactions on Medical Imaging.

[8]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[9]  Yuefeng Ji,et al.  Single color image dehazing based on digital total variation filter with color transfer , 2013, 2013 IEEE International Conference on Image Processing.

[10]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[11]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[12]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Ting Wang,et al.  Underwater image enhancement via extended multi-scale Retinex , 2017, Neurocomputing.

[14]  Michael S. Brown,et al.  Haze Visibility Enhancement: A Survey and Quantitative Benchmarking , 2016, Comput. Vis. Image Underst..

[15]  Defeng Wang,et al.  Box-constrained second-order total generalized variation minimization with a combined L1,2 data-fidelity term for image reconstruction , 2015, J. Electronic Imaging.

[16]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[18]  Yunlong Liu,et al.  Dehazing for images with large sky region , 2017, Neurocomputing.

[19]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[21]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[22]  Liang Li,et al.  Contrast enhancement based single image dehazing VIA TV-l1 minimization , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[23]  Tieyong Zeng,et al.  Single Image Dehazing and Denoising: A Fast Variational Approach , 2014, SIAM J. Imaging Sci..

[24]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[25]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[26]  Minghui Wang,et al.  Single Image Dehazing via Large Sky Region Segmentation and Multiscale Opening Dark Channel Model , 2017, IEEE Access.

[27]  M. Werman,et al.  Color lines: image specific color representation , 2004, CVPR 2004.