Spatial-Temporal Video Quality Assessment Based on Two-Level Temporal pooling

In this paper, a video quality assessment method based on two-level temporal pooling is proposed. By dividing a video sequence into groups of frames (GOFs) with variable lengths, a short-term temporal pooling is performed first at the eye fixation level to obtain the GOF quality. The determination of the GOF size is based on empirical observations from subjective tests that evaluate the duration of successive frames based on which steady quality judgment can be made by the human visual system. The video quality is further obtained by a second level of long-term temporal pooling using the GOF quality. The impact of strong impairment in part of the video on the cognitive system is incorporated in the proposed method for video quality assessment. Extensive experimental results have demonstrated the effectiveness of the proposed method for spatial-temporal distortion evaluation considering both regular and irregular frame loss.

[1]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[2]  Sheila S. Hemami,et al.  A metric for continuous quality evaluation of compressed video with severe distortions , 2004, Signal Process. Image Commun..

[3]  Mohammed Ghanbari,et al.  Modelling of spatio-temporal interaction for video quality assessment , 2010, Signal Process. Image Commun..

[4]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[5]  Weisi Lin,et al.  Measuring the negative impact of frame dropping on perceptual visual quality , 2005, IS&T/SPIE Electronic Imaging.

[6]  Santiago Aja-FernRa,et al.  Image Quality Assessment based on Local Variance , 2006 .

[7]  A. M. Rohaly,et al.  Comparison of temporal pooling methods for estimating the quality of complex video sequences , 1999, Electronic Imaging.

[8]  Gökçe Dane,et al.  Temporal Quality Evaluation for Enhancing Compressed Video , 2007, 2007 16th International Conference on Computer Communications and Networks.

[9]  Jun Okamoto,et al.  Objective video quality assessment method for evaluating effects of freeze distortion in arbitrary video scenes , 2007, Electronic Imaging.

[10]  Sheila S. Hemami,et al.  Subjective quality evaluation of low-bit-rate video , 2001, IS&T/SPIE Electronic Imaging.

[11]  Khaled El-Maleh,et al.  Perceptual Temporal Quality Metric for Compressed Video , 2007, IEEE Transactions on Multimedia.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Mohammed Ghanbari,et al.  Temporal Aspect of Perceived Quality in Mobile Video Broadcasting , 2008, IEEE Transactions on Broadcasting.

[14]  Tsuhan Chen,et al.  Multimedia Systems, Standards and Networks , 2000 .

[15]  Mohammed Ghanbari,et al.  Forgiveness effect in subjective assessment of packet video , 1992 .

[16]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[17]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[18]  Hong Ren Wu,et al.  No-Reference Quality Assessment for Networked Video via Primary Analysis of Bit Stream , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Xuelong Li,et al.  Reduced-Reference IQA in Contourlet Domain , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[21]  Hocine Cherifi,et al.  Predicting subjective video quality from separated spatial and temporal assessment , 2006, Electronic Imaging.