Towards a Referenceless Visual Quality Assessment Model Using Binarized Statistical Image Features

In many practical multimedia applications, the visual content is modified during transmission, enhancement, modification, and compression stages. These modifications often create visible distortions that may be perceived by humans. Therefore, the development of algorithms that are able to assess the visual quality as perceived by a human viewer can lead to significant progress in multimedia applications. Many researchers have developed algorithms that estimate visual quality. These algorithms can either make use of the full pristine content (full-reference metrics), partial aspects of the pristine content (reduced-reference metrics) or only the assessed content (referenceless or no-reference metrics). These three approaches have advantages and drawbacks. Nevertheless, although the design of a referenceless metric is more challenging, they have greater applicability in different scenarios. This paper introduces a novel referenceless image quality assessment (RIQA) metric. The proposed metric uses statistics of the Binarized Statistical Image Features descriptor (BSIF) to analyze the textures of an image. These statistics are mapped into subjective quality scores using a Random Forest Regression approach. Results show that the proposed metric is robust and accurate, outperforming other state-of-the-art RIQA methods.

[1]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[2]  David S. Doermann,et al.  No-Reference Image Quality Assessment Using Visual Codebooks , 2012, IEEE Transactions on Image Processing.

[3]  V. Rodriguez-Galiano,et al.  Machine learning predictive models for mineral prospectivity: an evaluation of neural networks, random forest, regression trees and support vector machines , 2015 .

[4]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[5]  Jun Wang,et al.  Comparison of random forest, support vector machine and back propagation neural network for electronic tongue data classification: Application to the recognition of orange beverage and Chinese vinegar , 2013 .

[6]  Yanqing Li,et al.  No-Reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics , 2017, 2017 2nd International Conference on Multimedia and Image Processing (ICMIP).

[7]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[8]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[10]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[11]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[12]  Rong Zhang,et al.  No-Reference JPEG Image Quality Assessment Based on Blockiness and Luminance Change , 2017, IEEE Signal Processing Letters.

[13]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[14]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[15]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[16]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[17]  Mylène C. Q. Farias,et al.  No-reference image quality assessment based on statistics of Local Ternary Pattern , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[21]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[22]  Lai-Man Po,et al.  Edge-Based Structural Similarity for Image Quality Assessment , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[23]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[24]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[25]  Mylène C. Q. Farias,et al.  On performance of image quality metrics enhanced with visual attention computational models , 2012 .

[26]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[27]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[28]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[29]  Alan C. Bovik,et al.  Automatic prediction of perceptual quality of multimedia signals—a survey , 2010, Multimedia Tools and Applications.

[30]  Xin Wang,et al.  Blind Image Quality Assessment for Measuring Image Blur , 2008, 2008 Congress on Image and Signal Processing.

[31]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..