Bitrate-Based No-Reference Video Quality Assessment Combining the Visual Perception of Video Contents

In video communication, the quality of video is mainly determined by bitrate in general. Moreover, the effect of video contents and their visual perception on video quality assessment (VQA) is often overlooked. However, in fact, for different videos, although the bitrates are the same, their VQA scores are still significantly different. Hence, it is assumed that the bitrate, video contents, and human visual characteristics mainly affect the VQA. Based on the above three aspects, in this paper, we designed a bitrate-based no-reference (NR) VQA metric combining the visual perception of video contents, namely, BRVPVC. In this metric, first an initial VQA model was proposed by only considering the bitrate alone. Then, the visual perception model for video contents was designed based on the texture complexity and local contrast of image, temporal information of video, and their visual perception features. Finally, two models were synthesized by adding certain weight coefficients into an overall VQA metric, namely, BRVPVC. Furthermore, ten reference videos and 150 distorted videos in the LIVE video database were used to test the metric. Moreover, based on the results of evaluating the videos in LIVE, VQEG, IRCCyN, EPFL-PoliMI, IVP, CSIQ, and Lisbon databases, the performance of BRVPVC is respectively compared with that of six full-reference (FR) metrics and ten NR VQA metrics. The results show that our VQA metric has a higher accuracy than six common FR VQA metrics and eight NR VQA metrics, and it is close to other two NR VQA metrics in accuracy. The corresponding values of Pearson linear correlation coefficient and Spearman rank order correlation coefficient reached 0.8547 and 0.8260, respectively. In addition, the computational complexity of proposed VQA metric is lower than video signal-to-noise ratio, video quality model, motion-based video integrity evaluation, spatiotemporal most apparent distortion, V-BLINDS, and V-CORNIA metrics. Moreover, the proposed metric has a better generalization property than these metrics.

[1]  Li Su,et al.  COME for No-Reference Video Quality Assessment , 2018, 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).

[2]  Hongliang Li,et al.  Toward a Blind Quality Metric for Temporally Distorted Streaming Video , 2018, IEEE Transactions on Broadcasting.

[3]  Jacob Søgaard,et al.  No-Reference Video Quality Assessment Using Codec Analysis , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  M. Nadenau Integration of human color vision models into high quality image compression , 2000 .

[5]  Anil C. Kokaram,et al.  A no-reference video quality predictor for compression and scaling artifacts , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[6]  Christophe Charrier,et al.  Blind Prediction of Natural Video Quality , 2014, IEEE Transactions on Image Processing.

[7]  Hong Ren Wu,et al.  No-Reference Quality Assessment for Networked Video via Primary Analysis of Bit Stream , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Vijayan K. Asari,et al.  No-Reference Video Quality Assessment Based on Artifact Measurement and Statistical Analysis , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Stefano Tubaro,et al.  A H.264/AVC video database for the evaluation of quality metrics , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Yaowu Chen,et al.  No-reference video quality assessment in the compressed domain , 2012, IEEE Transactions on Consumer Electronics.

[11]  Xiaojun Wu,et al.  Video quality assessment using content-weighted spatial and temporal pooling method , 2015, J. Electronic Imaging.

[12]  Federica Battisti,et al.  Toward the Assessment of Quality of Experience for Asymmetric Encoding in Immersive Media , 2018, IEEE Transactions on Broadcasting.

[13]  Piet Demeester,et al.  Constructing a No-Reference H.264/AVC Bitstream-Based Video Quality Metric Using Genetic Programming-Based Symbolic Regression , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Shan Gao,et al.  Parametric Planning Model for Video Quality Evaluation of IPTV Services Combining Channel and Video Characteristics , 2017, IEEE Transactions on Multimedia.

[15]  David S. Doermann,et al.  No-reference video quality assessment via feature learning , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Reuben A. Farrugia,et al.  A no-reference video quality metric using a Natural Video Statistical Model , 2015, IEEE EUROCON 2015 - International Conference on Computer as a Tool (EUROCON).

[17]  Zhengfang Duanmu,et al.  A Quality-of-Experience Database for Adaptive Video Streaming , 2018, IEEE Transactions on Broadcasting.

[18]  Xuelong Li,et al.  Spatiotemporal Statistics for Video Quality Assessment , 2016, IEEE Transactions on Image Processing.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  James Nightingale,et al.  5G-QoE: QoE Modelling for Ultra-HD Video Streaming in 5G Networks , 2018, IEEE Transactions on Broadcasting.

[21]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[22]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[23]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[24]  Chaofeng Li,et al.  Content-weighted video quality assessment using a three-component image model , 2010, J. Electronic Imaging.

[25]  Is-Haka Mkwawa,et al.  Content-Based Video Quality Prediction for HEVC Encoded Videos Streamed Over Packet Networks , 2015, IEEE Transactions on Multimedia.

[26]  Lisimachos P. Kondi,et al.  A no-reference bitstream-based perceptual model for video quality estimation of videos affected by coding artifacts and packet losses , 2015, Electronic Imaging.

[27]  Mei Yu,et al.  No reference stereo video quality assessment based on motion feature in tensor decomposition domain , 2018, J. Vis. Commun. Image Represent..

[28]  D. H. Kelly Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[29]  Muhammad Uzair,et al.  No-Reference Transmission Distortion Modelling for H.264/AVC-Coded Video , 2015, IEEE Transactions on Signal and Information Processing over Networks.

[30]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[31]  Gabriel-Miro Muntean,et al.  Modeling User Quality of Experience of Olfaction-Enhanced Multimedia , 2018, IEEE Transactions on Broadcasting.

[32]  Touradj Ebrahimi,et al.  A quality assessment protocol for free-viewpoint video sequences synthesized from decompressed depth data , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[33]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[34]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[35]  Guizhong Liu,et al.  Improved SSIM IQA of contrast distortion based on the contrast sensitivity characteristics of HVS , 2018, IET Image Process..

[36]  Weisi Lin,et al.  Low-Complexity Video Quality Assessment Using Temporal Quality Variations , 2012, IEEE Transactions on Multimedia.

[37]  Hans-Jürgen Zepernick,et al.  No-reference image and video quality assessment: a classification and review of recent approaches , 2014, EURASIP Journal on Image and Video Processing.

[38]  José Joskowicz,et al.  Combining Full Reference and No Reference Models for Broadcast Digital TV Quality Monitoring in Real Time , 2016, IEEE Transactions on Broadcasting.

[39]  Cristian Perra,et al.  A Review of Predictive Quality of Experience Management in Video Streaming Services , 2018, IEEE Transactions on Broadcasting.

[40]  Damon M. Chandler,et al.  A spatiotemporal most-apparent-distortion model for video quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.