Two-Layer Gaussian Process Regression With Example Selection for Image Dehazing

Researchers have devoted great efforts to image dehazing with prior assumptions in the past decade. Recently developed example-based approaches typically lack elegant models for the hazy process and meanwhile demand synthetic hazy images by manual selection. The priors from observations, and those trained from synthetic images cannot always reflect true structural information of natural images in practice. In this paper, we present a learning model for haze removal by using two-layer Gaussian process regression (GPR). By using training examples, the two-layer GPR establishes a direct relationship from the input image to the depth-dependent transmission, and learns local image priors to further improve the estimation. We also provide a systematic scheme to automatically collect suitable training pairs, which works for both simulated examples and images of natural scenes. Both qualitative and quantitative comparisons on real-world and synthetic hazy images demonstrate the effectiveness of the proposed approach, especially for white or bright objects and heavy haze regions in which traditional methods may fail.

[1]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[2]  Patricia Ladret,et al.  The blur effect: perception and estimation with a new no-reference perceptual blur metric , 2007, Electronic Imaging.

[3]  Jianhua Li,et al.  Passive Image-Splicing Detection by a 2-D Noncausal Markov Model , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[5]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[6]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  曹飞龙,et al.  Image Interpolation via Low-Rank Matrix Completion and Recovery , 2015 .

[8]  Lianping Chen,et al.  Effects of different Gabor filters parameters on image retrieval by texture , 2004, 10th International Multimedia Modelling Conference, 2004. Proceedings..

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Jin Hyung Kim,et al.  Efficient Learning of Image Super-Resolution and Compression Artifact Removal with Semi-Local Gaussian Processes , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Wan-Chi Siu,et al.  Single image super-resolution using Gaussian process regression , 2011, CVPR 2011.

[14]  Huimin Lu,et al.  Underwater image enhancement using guided trigonometric bilateral filter and fast automatic color correction , 2013, 2013 IEEE International Conference on Image Processing.

[15]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[16]  Michael Isard,et al.  Nonparametric belief propagation , 2010, Commun. ACM.

[17]  Truong Q. Nguyen,et al.  Example based depth from fog , 2013, 2013 IEEE International Conference on Image Processing.

[18]  Zhou Wang,et al.  Perceptual evaluation of single image dehazing algorithms , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[19]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[20]  Ashutosh Saxena,et al.  Learning 3-D Scene Structure from a Single Still Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[22]  Yi Wang,et al.  Haze editing with natural transmission , 2015, The Visual Computer.

[23]  Hideo Yamashita,et al.  Display Method of the Sky Color Taking into Account Multiple Scattering , 2000 .

[24]  M. Springer,et al.  The Distribution of Products of Beta, Gamma and Gaussian Random Variables , 1970 .

[25]  Yaser S. Abu-Mostafa,et al.  Mismatched Training and Test Distributions Can Outperform Matched Ones , 2015, Neural Computation.

[26]  Chiou-Ting Hsu,et al.  Single-Image Dehazing via Optimal Transmission Map Under Scene Priors , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Xin Fan,et al.  Example-based Haze Removal with two-layer Gaussian Process Regressions , 2014, PG.

[29]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[30]  Ning Wu,et al.  Fast Facial Image Super-Resolution via Local Linear Transformations for Resource-Limited Applications , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Wei Zeng,et al.  Night video enhancement using improved dark channel prior , 2013, 2013 IEEE International Conference on Image Processing.

[32]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[33]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Cosmin Ancuti,et al.  A Fast Semi-inverse Approach to Detect and Remove the Haze from a Single Image , 2010, ACCV.

[37]  Truong Q. Nguyen,et al.  An Investigation of Dehazing Effects on Image and Video Coding , 2012, IEEE Transactions on Image Processing.

[38]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .