The impact of temporal pooling and spatio-temporal quality interaction on the prediction accuracy of video quality metrics

We investigate to what extent temporal pooling and spatio-temporal quality interaction can help to increase a video quality metric's prediction accuracy. Our results prove that a significant gain is possible. The evaluations are conducted on high-definition video material. We propose a stand-alone Gaussian weighting as an alternative pooling strategy. Furthermore, a newly designed parameter set for an IIR filter is presented. Both approaches aim at predicting a video's quality. We show that they correlate well with human perception. Moreover, we check the observation that spatial quality contributes the most to the overall video quality. Taking the results of the provided paper into account, a completely blind video quality predictor useful for real-time video quality monitoring could be established.

[1]  M. Barkowsky,et al.  Perceptually motivated spatial and temporal integration of pixel based video quality measures , 2007 .

[2]  Alan C. Bovik,et al.  Temporal hysteresis model of time varying subjective video quality , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Maria Kihl,et al.  Evaluation of video quality metrics on transmission distortions in H.264 coded video , 2011, 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[4]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[5]  S. Tubaro,et al.  Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[6]  Weisi Lin,et al.  Low-Complexity Video Quality Assessment Using Temporal Quality Variations , 2012, IEEE Transactions on Multimedia.

[7]  Stefano Tubaro,et al.  A H.264/AVC video database for the evaluation of quality metrics , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Shuai Wan,et al.  Spatial-Temporal Video Quality Assessment Based on Two-Level Temporal pooling , 2011, Int. J. Image Graph..

[9]  Christian Keimel,et al.  The TUM high definition video datasets , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[10]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[11]  Christian Keimel,et al.  Visual quality of current coding technologies at high definition IPTV bitrates , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[12]  Stephen Wolf,et al.  Video Quality Model for Variable Frame Delay (VQM_VFD) , 2011 .

[13]  Margaret H. Pinson,et al.  The Consumer Digital Video Library , 2010 .

[14]  Alan C. Bovik,et al.  A subjective study to evaluate video quality assessment algorithms , 2010, Electronic Imaging.

[15]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[16]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[17]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[18]  Udo Zölzer,et al.  Full-reference video quality assessment on high-definition video content , 2012, 2012 6th International Conference on Signal Processing and Communication Systems.

[19]  Udo Zölzer,et al.  About the imperfection of objective quality metrics on high-definition video content , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[20]  Mohammed Ghanbari,et al.  Modelling of spatio-temporal interaction for video quality assessment , 2010, Signal Process. Image Commun..

[21]  Weisi Lin,et al.  Machine learning based modeling of spatial and temporal factors for video quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[22]  Stefan Winkler,et al.  Quality metric design: a closer look , 2000, Electronic Imaging.

[23]  Mislav Grgic,et al.  Comparison of HDTV formats using objective video quality measures , 2009, Multimedia Tools and Applications.

[24]  Mohammed Ghanbari,et al.  No-reference temporal quality metric for video impaired by frame freezing artefacts , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).