Reduced-Reference Video Quality Assessment of Compressed Video Sequences

In this paper, a novel reduced-reference (RR) video quality assessment (VQA) is proposed by exploiting the spatial information loss and the temporal statistical characteristics of the interframe histogram. From the spatial perspective, an energy variation descriptor (EVD) is proposed to measure the energy change of each individual encoded frame, which results from the quantization process. Besides depicting the energy change, EVD can further simulate the texture masking property of the human visual system (HVS). From the temporal perspective, the generalized Gaussian density (GGD) function is employed to capture the natural statistics of the interframe histogram distribution. The city-block distance (CBD) is used to calculate the histogram distance between the original video sequence and the encoded one. For simplicity, the difference image between adjacent frames is employed to characterize the temporal interframe relationship. By combining the spatial EVD together with the temporal CBD, an efficient RR VQA is developed. Evaluation on the subjective quality video database demonstrates that the proposed method outperforms the representative RR video quality metric and the full-reference VQAs, such as peak signal-to-noise ratio and structure similarity index in matching subjective ratings. This means that the proposed metric is more consistent with the HVS perception. Furthermore, as only a small number of RR features are extracted for representing the original video sequence (each frame requires only one parameter for describing EVD and three parameters for recording GGD), the RR features can be embedded into the video sequences or transmitted through the ancillary data channel, which can be used in the video quality monitoring system.

[1]  Sheila S. Hemami,et al.  No-reference image and video quality estimation: Applications and human-motivated design , 2010, Signal Process. Image Commun..

[2]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[3]  Tiago Rosa Maria Paula Queluz,et al.  No-reference image quality assessment based on DCT domain statistics , 2008, Signal Process..

[4]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[5]  Bernd Girod,et al.  Compression of VQM features for low bit-rate video quality monitoring , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[6]  Kai Zeng,et al.  Quality-aware video based on robust embedding of intra- and inter-frame reduced-reference features , 2010, 2010 IEEE International Conference on Image Processing.

[7]  K. Diepold,et al.  Building a Reduced Reference Video Quality Metric with Very Low Overhead using Multivariate Data Analysis , 2013 .

[8]  Tubagus Maulana Kusuma,et al.  Reduced-reference metric design for objective perceptual quality assessment in wireless imaging , 2009, Signal Process. Image Commun..

[9]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[10]  Khaled El-Maleh,et al.  Perceptual Temporal Quality Metric for Compressed Video , 2007, IEEE Transactions on Multimedia.

[11]  Shen-Chuan Tai,et al.  Fast full-search block-matching algorithm for motion-compensated video compression , 1997, IEEE Trans. Commun..

[12]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[13]  Tiago Rosa Maria Paula Queluz,et al.  No-Reference Quality Assessment of H.264/AVC Encoded Video , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Patrick Le Callet,et al.  An image quality assessment method based on perception of structural information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Alan C. Bovik,et al.  Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Seungjoon Yang Reduced reference MPEG-2 picture quality measure based on ratio of DCT coefficients , 2011 .

[18]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[19]  Fan Zhang,et al.  Adaptive Block-size Transform based Just-Noticeable Difference model for images/videos , 2011, Signal Process. Image Commun..

[20]  Kai Zeng,et al.  Temporal motion smoothness measurement for reduced-reference video quality assessment , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[22]  Weisi Lin,et al.  Just-noticeable difference estimation with pixels in images , 2008, J. Vis. Commun. Image Represent..

[23]  Christian Viard-Gaudin,et al.  A Convolutional Neural Network Approach for Objective Video Quality Assessment , 2006, IEEE Transactions on Neural Networks.

[24]  Zhou Wang,et al.  Quality-aware images , 2006, IEEE Transactions on Image Processing.

[25]  Alan C. Bovik,et al.  RRED indices: Reduced reference entropic differencing framework for image quality assessment , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Mohammed Ghanbari,et al.  Reduced-Reference Video Quality Assessment Using Discriminative Local Harmonic Strength With Motion Consideration , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[28]  N Krishna,et al.  Objective Video Quality Assessment , 2014 .

[29]  Mohammed Ghanbari,et al.  No-reference temporal quality metric for video impaired by frame freezing artefacts , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[30]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[31]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[32]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[34]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[35]  Fan Zhang,et al.  Practical Image Quality Metric Applied to Image Coding , 2011, IEEE Transactions on Multimedia.

[36]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[37]  Stefano Tubaro,et al.  A reduced-reference structural similarity approximation for videos corrupted by channel errors , 2010, Multimedia Tools and Applications.

[38]  King Ngi Ngan,et al.  Visual Horizontal Effect for Image Quality Assessment , 2010, IEEE Signal Processing Letters.

[39]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[40]  Judith Redi,et al.  Color Distribution Information for the Reduced-Reference Assessment of Perceived Image Quality , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Margaret H. Pinson Low Bandwidth Reduced Reference Video Quality Monitoring System , 2005 .

[42]  Chaminda T. E. R. Hewage,et al.  Reduced-reference quality assessment for 3D video compression and transmission , 2011, IEEE Transactions on Consumer Electronics.

[43]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[44]  Xuelong Li,et al.  Reduced-Reference IQA in Contourlet Domain , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[45]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[46]  Christian Viard-Gaudin,et al.  Continuous quality assessment of MPEG2 video with reduced reference , 2005 .

[47]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[48]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[49]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[50]  Patrick Le Callet,et al.  Visual features for image quality assessment with reduced reference , 2005, IEEE International Conference on Image Processing 2005.

[51]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[52]  Wen Gao,et al.  No-reference perceptual image quality metric using gradient profiles for JPEG2000 , 2010, Signal Process. Image Commun..

[53]  Margaret H. Pinson,et al.  Spatial-temporal distortion metric for in-service quality monitoring of any digital video system , 1999, Optics East.

[54]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[55]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[56]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[57]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[58]  Alan C. Bovik,et al.  Efficient Video Quality Assessment Along Temporal Trajectories , 2010, IEEE Transactions on Circuits and Systems for Video Technology.