Image Blur Classification and Parameter Identification Using Two-stage Deep Belief Networks

Image blur kernel classification and parameter estimation are critical for blind image deblurring. Current dominant approaches use handcrafted blur features that are optimized for a certain type of blur, which is not applicable in real blind deconvolution application when the Point Spread Function (PSF) of the blur is unknown. In this paper, a Two-stage system using Deep Belief Networks (TDBN) is proposed to first classify the blur type and then identify its parameters. To the best of our knowledge, this is the first time that Deep Belief Network (DBN) has been applied to the problem of blur analysis. In the blur type classification, our method attempts to identify the blur type from mixed input of various blurs with different parameters, rather than blur estimation based on the assumption of a single blur type in current methodology. To this aim, a semi-supervised DBN is trained to project the input samples in a discriminative feature space, and then classify those features. Moreover, in the parameter identification, the proposed edge detection on logarithm spectrum helps DBN to identify the blur parameters with very high accuracy. Experiments demonstrate the effectiveness of the proposed methods with better results compared to the state-of-the-art on the Berkeley segmentation dataset and the Pascal VOC 2007 dataset.

[1]  Shijian Lu,et al.  Blurred image region detection and classification , 2011, ACM Multimedia.

[2]  Y. Liu,et al.  Bilinear deep learning for image classification , 2011, ACM Multimedia.

[3]  Brendt Wohlberg,et al.  Blind Image Deconvolution Motion Blur Estimation , 2006 .

[4]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[6]  G. S. Watson Statistics on Spheres , 1983 .

[7]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[8]  Aggelos K. Katsaggelos,et al.  Blind Deconvolution Using a Variational Approach to Parameter, Image, and Blur Estimation , 2006, IEEE Transactions on Image Processing.

[9]  S. Sathiya Keerthi,et al.  Which Is the Best Multiclass SVM Method? An Empirical Study , 2005, Multiple Classifier Systems.

[10]  M. Cannon Blind deconvolution of spatially invariant image blurs with phase , 1976 .

[11]  Deepa Kundur,et al.  Blind Image Deconvolution , 2001 .

[12]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[13]  Rasmus Berg Palm,et al.  Prediction as a candidate for learning deep hierarchical models of data , 2012 .

[14]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[15]  Jian-Feng Cai,et al.  High-quality curvelet-based motion deblurring from an image pair , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Fen Chen,et al.  An Empirical Identification Method of Gaussian Blur Parameter for Image Deblurring , 2009, IEEE Transactions on Signal Processing.

[17]  Nikolas P. Galatsanos,et al.  A variational approach for Bayesian blind image deconvolution , 2004, IEEE Transactions on Signal Processing.

[18]  Ioannis M. Rekleitis Optical flow recognition from the power spectrum of a single blurred image , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[19]  Wilfried Philips,et al.  Parametric PSF estimation via sparseness maximization in the wavelet domain , 2004, SPIE Optics East.

[20]  Lei Zhang,et al.  Canny edge detection enhancement by scale multiplication , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Alexandre G. Ciancio,et al.  No-Reference Blur Assessment of Digital Pictures Based on Multifeature Classifiers , 2011, IEEE Transactions on Image Processing.

[22]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[23]  Jiaya Jia,et al.  Image partial blur detection and classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Luís B. Almeida,et al.  Blind and Semi-Blind Deblurring of Natural Images , 2010, IEEE Transactions on Image Processing.

[25]  Nanning Zheng,et al.  PSF Estimation via Gradient Domain Correlation , 2012, IEEE Transactions on Image Processing.

[26]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Daniel P. Huttenlocher,et al.  Generating sharp panoramas from motion-blurred videos , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  William McIlhagga,et al.  The Canny Edge Detector Revisited , 2011, International Journal of Computer Vision.

[29]  J. Biemond,et al.  Basic Methods for Image Restoration and Identification , 2009 .

[30]  Sylvain Paris,et al.  Blur kernel estimation using the radon transform , 2011, CVPR 2011.

[31]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[32]  Jia Chen,et al.  Robust dual motion deblurring , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.