Content driven QoE assessment for video frame rate and frame resolution reduction

Video bit rate reduction is very important for all video streaming applications. One possibility involves quantization domain and the majority of the work devoted to bit rate reduction focuses on this aspect only. The other possibility is to modify a video in time or space domain i.e. change the frames per second FPS rate or frame resolution FR. In this paper we present two no reference metrics mapping FPS rate and FR into MOS (Mean Opinion Scale). The performance of both models is significantly improved by incorporating content characteristics such as spatial information SI and temporal information TI. The impact on Quality of Experience (QoE) of both content characteristics is discussed with relation to the FPS rate and FR changes and general conclusions are drawn. The models were estimated and verified upon results of subjective experiments performed using video sequences of diverse spatial and temporal variability. The considered FPS rate was changed from 5 to 30 and the considered FR was changed from SQCIF to SD.

[1]  Zhan Ma,et al.  Modeling the impact of frame rate on perceptual quality of video , 2008, 2008 15th IEEE International Conference on Image Processing.

[2]  Yoshinori Sakai,et al.  Estimation of the optimal frame rate for video communications under bit-rate constraints , 2003 .

[3]  John A. Nelder,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[4]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[5]  Lucjan Janowski,et al.  Modeling subjective tests of quality of experience with a Generalized Linear Model , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[6]  Weisi Lin,et al.  Perceptual Quality Evaluation on Periodic Frame-Dropping Video , 2007, 2007 IEEE International Conference on Image Processing.

[7]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[8]  Kevin Brownlow,et al.  Silent Films–What Was the Right Speed? , 1990 .

[9]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[10]  Mike Armstrong,et al.  High Frame-Rate Television , 2009 .

[11]  John M. Libert,et al.  Perceptual Effects of Noise in Digital Video Compression , 1998 .

[12]  J. Y. C. Chen,et al.  Review of Low Frame Rate Effects on Human Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Lucjan Janowski,et al.  Quality Assessment for a Licence Plate Recognition Task Based on a Video Streamed in Limited Networking Conditions , 2011, MCSS.

[14]  W. Martin The Global Information Society , 1995 .