Minimisation of video downstream bit rate for large scale immersive video conferencing by utilising the perceptual variations of quality

This paper aims at minimising the video downstream bit rate of immersive video conferencing (IVC) applications by judiciously modifying the video quality based on the relative virtual positions of participants in the virtual environment. The paper reports on the results of a user study to assess the influence of participants' perspectives on the perceptual impact of relevant video parameters, such as resolution and frame rate. A mathematical model for video rate is proposed that expresses the total rate as the product of spatial resolution and frame rate. Results from the user study are combined with the proposed model to predict the rate parameters which will result in perceptually acceptable quality for a given user perspective. The simulation results show that by exploiting the proposed method, the downstream network load for the client can be significantly reduced with little or no impact on the perceived quality.

[1]  Demin Wang,et al.  Toward optimal rate control: a study of the impact of spatial resolution, frame rate, and quantization on subjective video quality and bit rate , 2003, Visual Communications and Image Processing.

[2]  Zhan Ma,et al.  Optimization of spatial, temporal and amplitude resolution for rate-constrained video coding and scalable video adaptation , 2012, 2012 19th IEEE International Conference on Image Processing.

[3]  Mohammed Ghanbari,et al.  Temporal Aspect of Perceived Quality in Mobile Video Broadcasting , 2008, IEEE Transactions on Broadcasting.

[4]  Zhan Ma,et al.  Perceptual Quality Assessment of Video Considering Both Frame Rate and Quantization Artifacts , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Sheila S. Hemami,et al.  Frame rate preferences in low bit rate video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[6]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[7]  Touradj Ebrahimi,et al.  Subjective evaluation of scalable video coding for content distribution , 2010, ACM Multimedia.

[8]  Zhan Ma,et al.  Modeling of Rate and Perceptual Quality of Compressed Video as Functions of Frame Rate and Quantization Stepsize and Its Applications , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Alexander Eichhorn,et al.  Pick Your Layers Wisely - A Quality Assessment of H.264 Scalable Video Coding for Mobile Devices , 2009, 2009 IEEE International Conference on Communications.

[10]  Liam Murphy,et al.  User perception of adapting video quality , 2006, Int. J. Hum. Comput. Stud..

[11]  Daniel Robert Franklin,et al.  Distributed Area of Interest Management for Large-Scale Immersive Video Conferencing , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[12]  Wei Song,et al.  User-Centered Video Quality Assessment for Scalable Video Coding of H.264/AVC Standard , 2010, MMM.

[13]  J. Y. C. Chen,et al.  Review of Low Frame Rate Effects on Human Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Rosario El-Feghali,et al.  Quality metric for video sequences with temporal scalability , 2005, IEEE International Conference on Image Processing 2005.

[15]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .