No-reference image quality assessment using bag-of-features with feature selection

The aim of no-reference image quality assessment (NR-IQA) is to assess the quality of an image, which is consistent with the mean opinion score, without any prior knowledge about the reference image. This work proposes a new NR-IQA technique based on natural scene statistics properties of the bag-of-features representation and feature selection algorithms. The proposed bag-of-features technique utilizes Harris affine detector and scale invariant feature transform to compute points, which are clustered using the k-means clustering algorithm to extract features for IQA. The extracted features are utilized with a support vector regression model to assess the quality of the image. The proposed technique outperforms state-of-the-art NR-IQA techniques, when tested on three commonly used subjective image quality assessment databases. The experimental results have shown that the features extracted using the proposed technique are database independent and shows high correlation with the mean opinion score.

[1]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[2]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[3]  Ying Li,et al.  A weighted full-reference image quality assessment based on visual saliency , 2017, J. Vis. Commun. Image Represent..

[4]  Min Zhang,et al.  Blind Image Quality Assessment Using the Joint Statistics of Generalized Local Binary Pattern , 2015, IEEE Signal Processing Letters.

[5]  Khawar Khurshid,et al.  New feature selection algorithms for no-reference image quality assessment , 2018, Applied Intelligence.

[6]  Hocine Cherifi,et al.  A statistical reduced-reference method for color image quality assessment , 2014, Multimedia Tools and Applications.

[7]  Guangming Shi,et al.  Blind image quality assessment with improved natural scene statistics model , 2016, Digit. Signal Process..

[8]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[9]  Jing Liu,et al.  Comprehensive image quality assessment via predicting the distribution of opinion score , 2018, Multimedia Tools and Applications.

[10]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[11]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[12]  Mohamed Cheriet,et al.  Mean Deviation Similarity Index: Efficient and Reliable Full-Reference Image Quality Evaluator , 2016, IEEE Access.

[13]  Asadollah Shahbahrami,et al.  Image quality assessment using edge based features , 2015, Multimedia Tools and Applications.

[14]  Khawar Khurshid,et al.  Distortion-specific feature selection algorithm for universal blind image quality assessment , 2019, EURASIP J. Image Video Process..

[15]  Quansen Sun,et al.  Image quality assessment improvement via local gray-scale fluctuation measurement , 2018, Multimedia Tools and Applications.

[16]  Duan Wei,et al.  No-Reference Image Quality Assessment Based on SIFT Feature Points , 2016 .

[17]  Khawar Khurshid,et al.  Feature selection algorithm for no-reference image quality assessment using natural scene statistics , 2018, Turkish J. Electr. Eng. Comput. Sci..

[18]  Leida Li,et al.  No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation , 2018, IEEE Transactions on Image Processing.

[19]  Guangming Shi,et al.  Orientation selectivity based visual pattern for reduced-reference image quality assessment , 2016, Inf. Sci..

[20]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[21]  I. Nizami,et al.  Efficient feature selection for Blind Image Quality Assessment based on natural scene statistics , 2017, 2017 14th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[22]  Xuelong Li,et al.  Sparse representation for blind image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[24]  Morteza Khademi,et al.  An image quality assessment algorithm based on saliency and sparsity , 2018, Multimedia Tools and Applications.

[25]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[26]  Weisi Lin,et al.  Blind Image Quality Assessment Using Statistical Structural and Luminance Features , 2016, IEEE Transactions on Multimedia.

[27]  Mohammad Sadegh Helfroush,et al.  No-reference image quality assessment using local binary pattern in the wavelet domain , 2017, Multimedia Tools and Applications.

[28]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[29]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[31]  Alexander Tanchenko,et al.  Visual-PSNR measure of image quality , 2014, J. Vis. Commun. Image Represent..

[32]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[33]  Jose Miguel Puerta,et al.  Speeding up incremental wrapper feature subset selection with Naive Bayes classifier , 2014, Knowl. Based Syst..

[34]  Lina J. Karam,et al.  Reduced-Reference Quality Assessment Based on the Entropy of DWT Coefficients of Locally Weighted Gradient Magnitudes , 2016, IEEE Transactions on Image Processing.

[35]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognition Letters.

[36]  Sebastian Bosse,et al.  Shearlet-based reduced reference image quality assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[37]  Tan Yee Fan,et al.  A Tutorial on Support Vector Machine , 2009 .

[38]  Xiaojun Wu,et al.  Blind Image Quality Assessment Using a General Regression Neural Network , 2011, IEEE Transactions on Neural Networks.

[39]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[40]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[41]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[42]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[43]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[44]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[45]  Tongfeng Sun,et al.  No-Reference Image Quality Assessment through SIFT Intensity , 2014 .

[46]  Eibe Frank,et al.  Large-scale attribute selection using wrappers , 2009, 2009 IEEE Symposium on Computational Intelligence and Data Mining.

[47]  Wen Lu,et al.  Statistical modeling in the shearlet domain for blind image quality assessment , 2016, Multimedia Tools and Applications.

[48]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[49]  Mohsen Ebrahimi Moghaddam,et al.  BIQWS: efficient Wakeby modeling of natural scene statistics for blind image quality assessment , 2016, Multimedia Tools and Applications.

[50]  King Ngi Ngan,et al.  No-Reference Retargeted Image Quality Assessment Based on Pairwise Rank Learning , 2016, IEEE Transactions on Multimedia.

[51]  Zhiguo Jiang,et al.  No Reference Quality Assessment for Multiply-Distorted Images Based on an Improved Bag-of-Words Model , 2015, IEEE Signal Processing Letters.

[52]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[53]  Qingjie Zhao,et al.  Blind image quality assessment by relative gradient statistics and adaboosting neural network , 2016, Signal Process. Image Commun..

[54]  Jun Wu,et al.  No-reference image quality assessment with center-surround based natural scene statistics , 2017, Multimedia Tools and Applications.

[55]  Shiqi Wang,et al.  No-Reference Quality Assessment of Deblurred Images Based on Natural Scene Statistics , 2017, IEEE Access.

[56]  Alan C. Bovik,et al.  Perceptual quality prediction on authentically distorted images using a bag of features approach , 2016, Journal of vision.

[57]  Q. M. Jonathan Wu,et al.  Full-reference image quality assessment by combining global and local distortion measures , 2014, Signal Process..

[58]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[59]  Hongliang Li,et al.  A Perceptually Weighted Rank Correlation Indicator for Objective Image Quality Assessment , 2017, IEEE Transactions on Image Processing.

[60]  Huan Liu,et al.  A Probabilistic Approach to Feature Selection - A Filter Solution , 1996, ICML.

[61]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[62]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[63]  Mei Yu,et al.  Supervised dictionary learning for blind image quality assessment , 2015, 2015 Visual Communications and Image Processing (VCIP).

[64]  邵枫,et al.  Supervised dictionary learning for blind image quality assessment using quality-constraint sparsecoding , 2015 .

[65]  Muhammad Majid,et al.  No-reference image quality assessment using gradient magnitude and wiener filtered wavelet features , 2018, Multimedia Tools and Applications.

[66]  Khawar Khurshid,et al.  Impact of Feature Selection Algorithms on Blind Image Quality Assessment , 2018 .

[67]  Xin Chen,et al.  A harmonic means pooling strategy for structural similarity index measurement in image quality assessment , 2015, Multimedia Tools and Applications.

[68]  Guangming Shi,et al.  Visual structural degradation based reduced-reference image quality assessment , 2016, Signal Process. Image Commun..

[69]  Hamid Hassanpour,et al.  Model-based full reference image blurriness assessment , 2015, Multimedia Tools and Applications.

[70]  Alan C. Bovik,et al.  C-DIIVINE: No-reference image quality assessment based on local magnitude and phase statistics of natural scenes , 2014, Signal Process. Image Commun..

[71]  King Ngi Ngan,et al.  Blind Image Quality Assessment Based on Rank-Order Regularized Regression , 2017, IEEE Transactions on Multimedia.

[72]  Alan C. Bovik,et al.  Making image quality assessment robust , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[73]  Ke Gu,et al.  Blind quality index for camera images with natural scene statistics and patch-based sharpness assessment , 2016, J. Vis. Commun. Image Represent..

[74]  Weisi Lin,et al.  BSD: Blind image quality assessment based on structural degradation , 2017, Neurocomputing.