An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis

No-reference image quality assessment (NR-IQA) uses only the test image for its quality assessment, and as video is essentially comprised of image frames with additional temporal dimension, video quality assessment (VQA) requires a thorough understanding of image quality assessment metrics and models. Therefore, in order to identify features that deteriorate video quality, a fundamental analysis of spatial and temporal artifacts with respect to individual video frames needs to be performed. Existing IQA and VQA metrics are primarily for capturing few distortions and hence may not be good for all types of images and videos. In this paper, we propose an NR-IQA model by combining existing three methods (namely NIQE, BRISQUE and BLIINDS-II) using multi-linear regression. We also present a holistic no-reference video quality assessment (NR-VQA) model by exploring quantification of certain distortions like ringing, frame difference, blocking, clipping and contrast in video frames. For the proposed NR-IQA model, the results represent improved performance as compared to the state-of-the-art methods and it requires very low fraction of samples for training to provide a consistent accuracy over different training-to-testing ratios. The performance of NR-VQA model is examined using a simple neural network model to attain high value of goodness of fit.

[1]  Joyce E. Farrell,et al.  PREDICTING FLICKER THRESHOLDS FOR VIDEO DISPLAY TERMINALS , 1987 .

[2]  Ke Gu,et al.  No-Reference Quality Assessment of Screen Content Pictures , 2017, IEEE Transactions on Image Processing.

[3]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[4]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[5]  H.R. Wu,et al.  A generalized block-edge impairment metric for video coding , 1997, IEEE Signal Processing Letters.

[6]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[7]  Xuelong Li,et al.  Spatiotemporal Statistics for Video Quality Assessment , 2016, IEEE Transactions on Image Processing.

[8]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[9]  Zhan Ma,et al.  Perceptual Quality Assessment of Video Considering Both Frame Rate and Quantization Artifacts , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Yuukou Horita,et al.  No reference image quality assessment for JPEG2000 based on spatial features , 2008, Signal Process. Image Commun..

[11]  Ihor O. Kirenko,et al.  A no-reference blocking artifact measure for adaptive video processing , 2005, 2005 13th European Signal Processing Conference.

[12]  Brian C. Lovell,et al.  Face Recognition from Still Images to Video Sequences: A Local-Feature-Based Framework , 2011, EURASIP J. Image Video Process..

[13]  Xiang Zhu,et al.  A no-reference sharpness metric sensitive to blur and noise , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[14]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[15]  Kishor M. Bhurchandi,et al.  No-reference image quality assessment algorithms: A survey , 2015 .

[16]  Tonghan Wang,et al.  An effective general-purpose NR-IQA model using natural scene statistics (NSS) of the luminance relative order , 2019, Signal Process. Image Commun..

[17]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[18]  Christian Keimel,et al.  No-reference video quality evaluation for high-definition video , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[21]  Lei Huang,et al.  Video quality monitoring of streamed videos , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[23]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[24]  Shan Suthaharan Perceptual quality metric for digital video coding , 2003 .

[25]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[26]  Xinbo Gao,et al.  Objective Video Quality Assessment Combining Transfer Learning With CNN , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[28]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[29]  Xuelong Li,et al.  Image quality assessment and human visual system , 2010, Visual Communications and Image Processing.

[30]  Alan C. Bovik,et al.  No-reference image blur assessment using multiscale gradient , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[31]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[32]  Alan C. Bovik,et al.  Blind quality assessment of videos using a model of natural scene statistics and motion coherency , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).