A Study of User Perception of the Quality of Video Content Rendered Inside a 3-D Virtual Environment

This paper reports on the result of a user study to assess the impact of resolution and frame rate of video on the quality of experience of the users, when the video is rendered inside a 3-D virtual space, and consequently viewed from arbitrary perspectives. A mathematical model for video rate is presented that expresses the total rate as the product of separate functions of spatial and temporal resolutions. Results from the user study are combined with the model to predict the rate parameters which will result in perceptually acceptable quality using the 3-D features of the virtual environment. The results show that by exploiting the insensitivity of users to controlled quality degradation, the downstream network load for the client can be significantly reduced with little or no perceptual impact on the clients.

[1]  Daniel Robert Franklin,et al.  Distributed Area of Interest Management for Large-Scale Immersive Video Conferencing , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[2]  J. Y. C. Chen,et al.  Review of Low Frame Rate Effects on Human Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  Alexander Eichhorn,et al.  Pick Your Layers Wisely - A Quality Assessment of H.264 Scalable Video Coding for Mobile Devices , 2009, 2009 IEEE International Conference on Communications.

[4]  Wei Ding,et al.  Rate control of MPEG video coding and recording by rate-quantization modeling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[5]  Liam Murphy,et al.  User perception of adapting video quality , 2006, Int. J. Hum. Comput. Stud..

[6]  Sheila S. Hemami,et al.  Frame rate preferences in low bit rate video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[7]  Rosario El-Feghali,et al.  Quality metric for video sequences with temporal scalability , 2005, IEEE International Conference on Image Processing 2005.

[8]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[9]  Wei Song,et al.  User-Centered Video Quality Assessment for Scalable Video Coding of H.264/AVC Standard , 2010, MMM.

[10]  Jianfei Cai,et al.  Three Dimensional Scalable Video Adaptation via User-End Perceptual Quality Assessment , 2008, IEEE Transactions on Broadcasting.

[11]  Touradj Ebrahimi,et al.  Subjective evaluation of scalable video coding for content distribution , 2010, ACM Multimedia.

[12]  Daniel Robert Franklin,et al.  Large-scale immersive video conferencing by altering video quality and distribution based on the virtual context , 2014, IEEE Communications Magazine.

[13]  D. Franklin.  Enhancements to channel models, DMT modulation and coding for channels subject to impulsive noise , 2007 .

[14]  Mohammed Ghanbari,et al.  Temporal Aspect of Perceived Quality in Mobile Video Broadcasting , 2008, IEEE Transactions on Broadcasting.

[15]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[16]  Zhan Ma,et al.  Optimization of spatial, temporal and amplitude resolution for rate-constrained video coding and scalable video adaptation , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[18]  Zhan Ma,et al.  Analytical rate model for compressed video considering impacts of spatial, temporal and amplitude resolutions , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[19]  Daniel Robert Franklin,et al.  Minimisation of video downstream bit rate for large scale immersive video conferencing by utilising the perceptual variations of quality , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[20]  Muhammad Shahid,et al.  Analysis of the impact of temporal, spatial, and quantization variations on perceptual video quality , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[21]  Demin Wang,et al.  Toward optimal rate control: a study of the impact of spatial resolution, frame rate, and quantization on subjective video quality and bit rate , 2003, Visual Communications and Image Processing.