Evaluating Depth Perception of 3D Stereoscopic Videos

3D video quality of experience (QoE) is a multidimensional problem; many factors contribute to the global rating like image quality, depth perception and visual discomfort. Due to this multidimensionality, it is proposed in this paper, that as a complement to assessing the quality degradation due to coding or transmission, the appropriateness of the non-distorted signal should be addressed. One important factor here is the depth information provided by the source sequences. From an application-perspective, the depth-characteristics of source content are of relevance for pre-validating whether the content is suitable for 3D video services. In addition, assessing the interplay between binocular and monocular depth features and depth perception are relevant topics for 3D video perception research. To achieve the evaluation of the suitability of 3D content, this paper describes both a subjective experiment and a new objective indicator to evaluate depth as one of the added values of 3D video.

[1]  George Mather,et al.  Depth cue integration: stereopsis and image blur , 2000, Vision Research.

[2]  Horst Bischof,et al.  Motion estimation with non-local total variation regularization , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[4]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[5]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[6]  Jeremy R. Cooperstock,et al.  Stereoscopic display technologies, interaction paradigms, and rendering approaches for neurosurgical visualization , 2009, Electronic Imaging.

[7]  Mark A. Brown.  On the Evaluation of 3D Display Technologies for Air Traffic Control , 1994 .

[8]  Kang Ryoung Park,et al.  Measuring the degree of eyestrain caused by watching LCD and PDP devices , 2009 .

[9]  Tovi Grossman,et al.  An evaluation of depth perception on volumetric displays , 2006, AVI '06.

[10]  Robert S. Allison,et al.  The contribution of image blur to depth perception , 2004 .

[11]  Touradj Ebrahimi,et al.  Factors impacting quality of experience in stereoscopic images , 2011, Electronic Imaging.

[12]  Junle Wang,et al.  Quantifying how the combination of blur and disparity affects the perceived depth , 2011, Electronic Imaging.

[13]  Robert S. Allison,et al.  The Effect of Crosstalk on the Perceived Depth From Disparity and Monocular Occlusions , 2011, IEEE Transactions on Broadcasting.

[14]  Julie M. Harris,et al.  Stereoscopic perception of real depths at large distances. , 2010, Journal of vision.

[15]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[16]  Curtis L Baker,et al.  Contribution of motion parallax to segmentation and depth perception. , 2011, Journal of vision.

[17]  Jun Okamoto,et al.  Subjective characteristics for stereoscopic high definition video , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[19]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[20]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[21]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[22]  Dov Sagi,et al.  How do flankers' relations affect crowding? , 2010, Journal of vision.

[23]  Ahmet M. Kondoz,et al.  Predicting sensation of depth in 3D video , 2010 .

[24]  André Vincent,et al.  Stereo image quality: effects of mixed spatio-temporal resolution , 2000, IEEE Trans. Circuits Syst. Video Technol..

[25]  Marcus Barkowsky,et al.  NEW REQUIREMENTS OF SUBJECTIVE VIDEO QUALITY ASSESSMENT METHODOLOGIES FOR 3DTV , 2010 .

[26]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Alan C. Bovik,et al.  Planar surface orientation from texture spatial frequencies , 1995, Pattern Recognit..

[28]  Daniel Cremers,et al.  Anisotropic Huber-L1 Optical Flow , 2009, BMVC.

[29]  Makoto Okui,et al.  Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[31]  Alexander Raake,et al.  A Subjective Evaluation of 3D Iptv Broadcasting Implementations Considering Coding and Transmission Degradation , 2011, 2011 IEEE International Symposium on Multimedia.

[32]  Krzysztof Wegner,et al.  Similarity measures for depth estimation , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[33]  Aude Oliva,et al.  Estimating perception of scene layout properties from global image features. , 2011, Journal of vision.

[34]  Touradj Ebrahimi,et al.  Assessment of Stereoscopic Crosstalk Perception , 2012, IEEE Transactions on Multimedia.

[35]  Stephan Reichelt,et al.  Depth cues in human visual perception and their realization in 3D displays , 2010, Defense + Commercial Sensing.

[36]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[37]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[38]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[39]  Pjh Pieter Seuntiëns,et al.  Visual experience of 3D TV , 2006 .

[40]  Chunping Hou,et al.  HVS-Based Quality Assessment Metrics for 3-D Images , 2010, 2010 Second WRI Global Congress on Intelligent Systems.

[41]  Gaël Sourimant,et al.  Depth maps estimation and use for 3DTV , 2010 .