Evaluation of realistic blurring image quality by using a shallow convolutional neural network

Manifold causes of image blurring make the no-reference evaluation of realistic blurred images very challenging. Previous studies indicate that handcrafted features suffer from poor representation of the intrinsic characteristics of image blurring and thus blind image sharpness assessment (BISA) is unsatisfactory. This paper explores a shallow convolutional neural network (CNN) to address this problem facilitated by data augmentation. Superior to algorithms that necessitates considerable expertise and efforts to handcraft features for optimal representation of perceptual image quality, CNN directly integrates the retrieval of intrinsic features and the prediction of image blur quality into an optimization process. Moreover, experiments on Realistic Blurring Image Database have verified that CNN advances in retrieving intrinsic features and obtains good correlation with subjective image blurring evaluations.

[1]  Weisi Lin,et al.  Sparse Representation-Based Image Quality Index With Adaptive Sub-Dictionaries , 2016, IEEE Transactions on Image Processing.

[2]  Adam Finkelstein,et al.  A no-reference metric for evaluating the quality of motion deblurring , 2013, ACM Trans. Graph..

[3]  Lei Wang,et al.  A shallow convolutional neural network for blind image sharpness assessment , 2017, PloS one.

[4]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[5]  Phong V. Vu,et al.  A Fast Wavelet-Based Algorithm for Global and Local Image Sharpness Estimation , 2012, IEEE Signal Processing Letters.

[6]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[7]  Yaoqin Xie,et al.  Performance evaluation of edge-directed interpolation methods for noise-free images , 2013, ICIMCS '13.

[8]  Yaoqin Xie,et al.  Signal correlation measure in multi-echo T2∗-w MR images , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[9]  Xiaojun Wu,et al.  No-reference image blur index based on singular value curve , 2014, J. Vis. Commun. Image Represent..

[10]  Shiqi Wang,et al.  No-Reference Quality Assessment of Deblurred Images Based on Natural Scene Statistics , 2017, IEEE Access.

[11]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[12]  Yaoqin Xie,et al.  Nonrigid Registration of Lung CT Images Based on Tissue Features , 2013, Comput. Math. Methods Medicine.

[13]  Yaoqin Xie,et al.  Explicit vascular reconstruction based on adjacent vector projection , 2016, Bioengineered.

[14]  Xiao-Jun Wu,et al.  Blind Image Blur Assessment Using Singular Value Similarity and Blur Comparisons , 2014, PloS one.

[15]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  Alexandre G. Ciancio,et al.  No-Reference Blur Assessment of Digital Pictures Based on Multifeature Classifiers , 2011, IEEE Transactions on Image Processing.

[18]  Yaoqin Xie,et al.  Iterative image-domain ring artifact removal in cone-beam CT , 2017, Physics in medicine and biology.

[19]  Yaoqin Xie,et al.  CNN-GRNN for Image Sharpness Assessment , 2016, ACCV Workshops.

[20]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[21]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[22]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[23]  Nikolay N. Ponomarenko,et al.  Color image database TID2013: Peculiarities and preliminary results , 2013, European Workshop on Visual Information Processing (EUVIP).

[24]  Weisi Lin,et al.  Image Sharpness Assessment by Sparse Representation , 2016, IEEE Transactions on Multimedia.

[25]  Shao De Yu,et al.  Linear-fitting-based similarity coefficient map for tissue dissimilarity analysis in -w magnetic resonance imaging* , 2015 .

[26]  Weisi Lin,et al.  No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments , 2016, IEEE Transactions on Cybernetics.

[27]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[28]  Yaoqin Xie,et al.  An edge-directed interpolation method for fetal spine MR images , 2013, Biomedical engineering online.

[29]  Yaoqin Xie,et al.  Applications of edge preservation ratio in image processing , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[30]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[31]  Chaofeng Li,et al.  No-reference blur index using blur comparisons , 2011 .

[32]  Weisi Lin,et al.  No-reference quality assessment of deblocked images , 2016, Neurocomputing.

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[34]  Ling Shao,et al.  Non-distortion-specific no-reference image quality assessment: A survey , 2015, Inf. Sci..

[35]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[36]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[37]  Yi Li,et al.  Convolutional Neural Networks for No-Reference Image Quality Assessment , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[39]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[40]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[41]  Yaoqin Xie,et al.  Edge preservation ratio for image sharpness assessment , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[42]  Weisi Lin,et al.  No-Reference and Robust Image Sharpness Evaluation Based on Multiscale Spatial and Spectral Features , 2017, IEEE Transactions on Multimedia.

[43]  Alan C. Bovik,et al.  No-reference image blur assessment using multiscale gradient , 2009, QOMEX 2009.

[44]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.