Temporal Quality Evaluation for Enhancing Compressed Video

This paper proposes a metric to quantify the effect of the video frame loss according to their impact toward perceived temporal quality. This metric utilizes information obtained from pixel domain and particularly aims at measuring the temporal video quality degradation caused by both regular and irregular frame loss. As one application, the proposed temporal quality metric is used to evaluate the benefit of adaptive thresholding in frame skipping algorithms at the encoder. Temporal quality metric shows high prediction accuracy compared to subjective quality evaluation. Furthermore, it is shown by the experimental results that proposed temporal quality metric precisely differentiates between different frame skipping approaches and can be effectively used to evaluate them. With the help of the proposed quality metric, encoders can be designed to drop frames effectively with minimal perceptual video quality degradation.

[1]  Rosario El-Feghali,et al.  Quality metric for video sequences with temporal scalability , 2005, IEEE International Conference on Image Processing 2005.

[2]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[3]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[4]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[5]  Franco Oberti,et al.  A new sharpness metric based on local kurtosis, edge and energy information , 2004, Signal Process. Image Commun..

[6]  Jun Okamoto,et al.  Objective video quality assessment method for freeze distortion based on freeze aggregation , 2006, Electronic Imaging.

[7]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[8]  Jean C. Gicquel,et al.  AUTOMATIC QUALITY ASSESSMENT OF VIDEO FLUIDITY IMPAIRMENTS USING A NO-REFERENCE METRIC , 2006 .

[9]  Michael Yuen Coding Artifacts and Visual Distortions , 2005 .

[10]  Giovanni Iacovoni,et al.  Quality-Temporal Transcoder Driven by the Jerkiness , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[11]  Clark C. Guest,et al.  Perceptual Sharpness Metric (PSM) for Compressed Video , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[12]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[13]  Seiichiro Hangai,et al.  Perceptual quality of motion of video sequences on mobile terminals , 2005, SIP.

[14]  Alessandro Neri,et al.  Objective quality evaluation of video services , 2006 .

[15]  Weisi Lin,et al.  Measuring the negative impact of frame dropping on perceptual visual quality , 2005, IS&T/SPIE Electronic Imaging.

[16]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[17]  M. Ghanbari,et al.  IMPACT OF JITTER AND JERKINESS ON PERCEIVED VIDEO QUALITY , 2006 .

[18]  Wei-Ying Ma,et al.  Blur determination in the compressed domain using DCT information , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[19]  Yuhong Jiang,et al.  Visual working memory for simple and complex visual stimuli , 2005 .