Learning Interleaved Cascade of Shrinkage Fields for Joint Image Dehazing and Denoising

Most existing image dehazing methods deteriorate to different extents when processing hazy inputs with noise. The main reason is that the commonly adopted two-step strategy tends to amplify noise in the inverse operation of division by the transmission. To address this problem, we learn an interleaved Cascade of Shrinkage Fields (CSF) to reduce noise in jointly recovering the transmission map and the scene radiance from a single hazy image. Specifically, an auxiliary shrinkage field (SF) model is integrated into each cascade of the proposed scheme to reduce undesirable artifacts during the transmission estimation. Different from conventional CSF, our learned SF models have special visual patterns, which facilitate the specific task of noise reduction in haze removal. Furthermore, a numerical algorithm is proposed to efficiently update the scene radiance and the transmission map in each cascade. Extensive experiments on synthetic and real-world data demonstrate that the proposed algorithm performs favorably against state-of-the-art dehazing methods on hazy and noisy images.

[1]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jean-Philippe Tarel,et al.  Markov Random Field model for single image defogging , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[3]  Michael K. Ng,et al.  On the Total Variation Dictionary Model , 2010, IEEE Transactions on Image Processing.

[4]  Lei Zhang,et al.  Learning Aggregated Transmission Propagation Networks for Haze Removal and Beyond , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Yuan Yan Tang,et al.  Efficient single image dehazing and denoising: An efficient multi-scale correlated wavelet approach , 2017, Comput. Vis. Image Underst..

[6]  Seong G. Kong,et al.  An Iterative Image Dehazing Method With Polarization , 2019, IEEE Transactions on Multimedia.

[7]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[8]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[9]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[10]  John P. Oakley,et al.  Improving image quality in poor visibility conditions using a physical model for contrast degradation , 1998, IEEE Trans. Image Process..

[11]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[12]  Pascal Getreuer,et al.  Rudin-Osher-Fatemi Total Variation Denoising using Split Bregman , 2012, Image Process. Line.

[13]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[14]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[15]  Xinbo Gao,et al.  Single Image Dehazing With Depth-Aware Non-Local Total Variation Regularization , 2018, IEEE Transactions on Image Processing.

[16]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Peyman Milanfar,et al.  Removal of haze and noise from a single image , 2012, Electronic Imaging.

[18]  Jinhui Tang,et al.  Single Image Dehazing via Conditional Generative Adversarial Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Fang Li,et al.  A Variational Approach for Pan-Sharpening , 2013, IEEE Transactions on Image Processing.

[21]  Jong-Sen Lee,et al.  Refined filtering of image noise using local statistics , 1981 .

[22]  Yang Li,et al.  Improved Techniques for Learning to Dehaze and Beyond: A Collective Study , 2018, ArXiv.

[23]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  Guangyong Chen,et al.  An Efficient Statistical Method for Image Noise Level Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[26]  Dong Yang,et al.  Proximal Dehaze-Net: A Prior Learning-Based Deep Network for Single Image Dehazing , 2018, ECCV.

[27]  Cosmin Ancuti,et al.  A Fast Semi-inverse Approach to Detect and Remove the Haze from a Single Image , 2010, ACCV.

[28]  Xiaochun Cao,et al.  Deep Video Dehazing With Semantic Segmentation , 2019, IEEE Transactions on Image Processing.

[29]  Wei Liu,et al.  Gated Fusion Network for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Yixin Du,et al.  Recursive Deep Residual Learning for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[32]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[33]  Truong Q. Nguyen,et al.  An Investigation of Dehazing Effects on Image and Video Coding , 2012, IEEE Transactions on Image Processing.

[34]  Hassan Mansour,et al.  Deepcasd: An End-to-End Approach for Multi-Spectral Image Super-Resolution , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Ko Nishino,et al.  Factorizing Scene Albedo and Depth from a Single Foggy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[36]  Jian Yao,et al.  Feed-Net: Fully End-to-End Dehazing , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[37]  Tieyong Zeng,et al.  Single Image Dehazing and Denoising: A Fast Variational Approach , 2014, SIAM J. Imaging Sci..

[38]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[39]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[40]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[41]  Vishal M. Patel,et al.  Densely Connected Pyramid Dehazing Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[42]  Yoav Y. Schechner,et al.  Regularized Image Recovery in Scattering Media , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Zhou Wang,et al.  Perceptual evaluation of single image dehazing algorithms , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[44]  Wolfgang Heidrich,et al.  Learning High-Order Filters for Efficient Blind Deconvolution of Document Photographs , 2016, ECCV.

[45]  Zhengguo Li,et al.  Single Image De-Hazing Using Globally Guided Image Filtering. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[46]  Stefan Roth,et al.  Shrinkage Fields for Effective Image Restoration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[48]  Jian Yao,et al.  Joint learning of image detail and transmission map for single image dehazing , 2018, The Visual Computer.

[49]  Xiaochun Cao,et al.  Deep Video Dehazing , 2017, PCM.

[50]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[51]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.