Quality of experience for 3D video streaming

New 3D video applications and services are emerging to fulfill increasing user demand. This effort is well supported by the increasing 3D video content including user generated content (e.g., through 3D capture/display enabled mobile phones), technological advancements (e.g., HD 3D video capture and processing methods), affordable 3D displays, and standardization activities. However, not much attention has been given to how these technologies, along the end-to-end chain from content capture to display, affect user perception and whether the overall experience of 3D video users is satisfactory or not. 3D video streaming also introduces artifacts on the reconstructed 3D video at the receiver end, leading to inferior quality and user experience. In this article we present and discuss in detail how artifacts introduced during 3D video streaming affect the end-user perception and how we could use realtime quality evaluation methodologies to overcome these effects. The observations presented can underpin the design of future QoE-aware 3D video streaming systems.

[1]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual evaluations and requirements of three-dimensional TV , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Jyrki Huusko,et al.  Content adaptive network aware joint optimization of wireless video transmission , 2007, IEEE Communications Magazine.

[3]  Aldo Maalouf,et al.  CYCLOP: A stereo color image quality assessment metric , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Wijnand A. IJsselsteijn,et al.  Perceived quality of compressed stereoscopic images: Effects of symmetric and asymmetric JPEG coding and camera separation , 2006, TAP.

[5]  Marcus Barkowsky,et al.  Perceived 3D TV Transmission Quality Assessment: Multi-Laboratory Results Using Absolute Category Rating on Quality of Experience Scale , 2012, IEEE Transactions on Broadcasting.

[6]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[7]  Zhibo Chen,et al.  Guest Editorial QoE-Aware Wireless Multimedia Systems , 2012, IEEE J. Sel. Areas Commun..

[8]  Kwanghoon Sohn,et al.  An Objective Video Quality Metric for Compressed Stereoscopic Video , 2012, Circuits Syst. Signal Process..

[9]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[10]  Yuukou Horita,et al.  Stereoscopic image quality prediction , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[11]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[12]  Chaminda T. E. R. Hewage,et al.  Edge-Based Reduced-Reference Quality Metric for 3-D Video Compression and Transmission , 2012, IEEE Journal of Selected Topics in Signal Processing.

[13]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[14]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.