Subjective preference of spatio-temporal rate in video adaptation using multi-dimensional scalable coding

Video adaptation allows for direct manipulation of existing encoded video streams to meet new resource constraints without having to encode the video from scratch. Multi-dimensional scalable coding, such as motion-compensated subband coding (MCSBC), offers an effective and flexible representation for video adaptation. In order to develop robust criteria for selecting optimal spatio-temporal rates used in adaptation, knowledge about subjective preference of spatio-temporal rates is needed. We study the optimal temporal frame rate over a wide range of bandwidth (50 kbps to 1 Mbps) using subjective quality evaluation with 128 clips and 31 subjects. We analyze the results using statistical testing methods and investigate the dependence of optimal frame rate on user, bandwidth, and video content characteristics. Our findings indicate agreement among most users and the existence of switching bandwidths at which preferred frame rates change. Dependence of the preference on video content types is also revealed.

[1]  Yong Wang,et al.  Content-based utility function prediction for real-time MPEG-4 video transcoding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[2]  Mihaela van der Schaar,et al.  FGS+: optimizing the joint SNR-temporal video quality in MPEG-4 fine grained scalable coding , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[3]  Sheila S. Hemami,et al.  Frame rate preferences in low bit rate video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  Sheila S. Hemami,et al.  CVQE: a metric for continuous video quality evaluation at low bit rates , 2003, IS&T/SPIE Electronic Imaging.

[5]  John W. Woods,et al.  Bidirectional MC-EZBC with lifting implementation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .