Content- adaptive scaling option selection in scalable video coding

Scalable video coders provide different options, such as temporal, spatial and SNR scalability, each option results in different kinds and levels of visual distortion depending on the content. We observe that a single scalability option does not fit the whole video content well, and the scalability operator should be varied for different temporal segments depending on the content of the segment. We propose a method to choose the best scaling option that results in minimum visual distortion. We employ four component metrics to quantify artifacts caused by bitrate reduction, spatial size reduction and temporal subsampling, which are a flatness measure, a blockiness measure, a blurriness measure, and a jerkiness measure. We define the best scaling operator as the one with the minimum distortion score which is given by a linear combination of these four component measures. Two subjective tests have been performed to validate the proposed procedure for optimal selection of scalability operators for soccer videos.

[1]  Stephen D. Voran,et al.  Objective video quality assessment system based on human perception , 1993, Electronic Imaging.

[2]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[3]  Yong Wang,et al.  Predicting optimal operation of MC-3DSBC multidimensional scalable video coding using subjective quality measurement , 2004, IS&T/SPIE Electronic Imaging.

[4]  Claudia Schremmer,et al.  Video-scaling algorithm based on human perception for spatiotemporal stimuli , 2000, IS&T/SPIE Electronic Imaging.

[5]  Mihaela van der Schaar,et al.  FGS+: optimizing the joint SNR-temporal video quality in MPEG-4 fine grained scalable coding , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[6]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[7]  Margaret H. Pinson,et al.  Spatial-temporal distortion metric for in-service quality monitoring of any digital video system , 1999, Optics East.

[8]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[9]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[10]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[11]  Weisi Lin,et al.  A locally-adaptive algorithm for measuring blocking artifacts in images and videos , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).