Comparison of regression functions in a shallow convolutional neural network for natural image sharpness assessment

Our previous study proposed a shallow convolutional neural network (CNN) to quantify the sharpness of natural images. The network utilized a multilayer perceptron (MLP) as its regression function in the full-connection layer. In this paper, we make use of a polynomial mapping (the logistic map, LM) as the regression function in the natural image sharpness assessment (NISA). First, the coefficient of logistic map is experimentally determined based on the database of LIVE-II. Then, the prediction performance is evaluated on Gaussian blurred images from CSIQ and TID2013. After that, three regression functions, LM, BCF (the basic cubical function) and MLP, are evaluated with Pearson linear correlation coefficient (PLCC) and Spearman rank-order correlation coefficient (SROCC). In addition, eleven state-of-the-art NISA models are compared. Based on the same shallow CNN architecture, experimental results indicate that MLP achieves the best performance, followed by BCF and LM. Furthermore, its performance is rival to or better than other NISA models. Conclusively, in comparison to LM and BCF, MLP is relatively better as a regression function for automatic network optimization and numerical regression. Meanwhile, it achieves the state-of-the-art performance in NISA task.

[1]  Yaoqin Xie,et al.  Can Signal-to-Noise Ratio Perform as a Baseline Indicator for Medical Image Quality Assessment , 2018, IEEE Access.

[2]  Weisi Lin,et al.  No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments , 2016, IEEE Transactions on Cybernetics.

[3]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Alexandre G. Ciancio,et al.  No-Reference Blur Assessment of Digital Pictures Based on Multifeature Classifiers , 2011, IEEE Transactions on Image Processing.

[6]  Yaoqin Xie,et al.  Evaluation of realistic blurring image quality by using a shallow convolutional neural network , 2017, 2017 IEEE International Conference on Information and Automation (ICIA).

[7]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[8]  Phong V. Vu,et al.  A Fast Wavelet-Based Algorithm for Global and Local Image Sharpness Estimation , 2012, IEEE Signal Processing Letters.

[9]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[10]  Mikko Nuutinen,et al.  CID2013: A Database for Evaluating No-Reference Image Quality Assessment Algorithms , 2015, IEEE Transactions on Image Processing.

[11]  Weisi Lin,et al.  Image Sharpness Assessment by Sparse Representation , 2016, IEEE Transactions on Multimedia.

[12]  Zhengfang Duanmu,et al.  End-to-End Blind Image Quality Assessment Using Deep Neural Networks , 2018, IEEE Transactions on Image Processing.

[13]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[14]  Xiao-Jun Wu,et al.  Blind Image Blur Assessment Using Singular Value Similarity and Blur Comparisons , 2014, PloS one.

[15]  Mislav Grgic,et al.  Blind image sharpness assessment based on local contrast map statistics , 2018, J. Vis. Commun. Image Represent..

[16]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[17]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[18]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[19]  Yaoqin Xie,et al.  Edge preservation ratio for image sharpness assessment , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[20]  Weisi Lin,et al.  No-Reference and Robust Image Sharpness Evaluation Based on Multiscale Spatial and Spectral Features , 2017, IEEE Transactions on Multimedia.

[21]  Alan C. Bovik,et al.  No-reference image blur assessment using multiscale gradient , 2009, QOMEX 2009.

[22]  Lei Wang,et al.  A shallow convolutional neural network for blind image sharpness assessment , 2017, PloS one.

[23]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[24]  Yaoqin Xie,et al.  CNN-GRNN for Image Sharpness Assessment , 2016, ACCV Workshops.

[25]  Chaofeng Li,et al.  No-reference blur index using blur comparisons , 2011 .

[26]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[27]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..