Predicting Visual Discomfort Using Object Size and Disparity Information in Stereoscopic Images

This paper proposes object-dependent disparity features to predict the visual discomfort in stereoscopic 3-D images. The proposed object-dependent disparity features quantify the level of visual comfort influenced by disparity gradient of nearby objects and object width, respectively. They consist of relative disparity (mean of disparity difference between nearby objects) and object thickness (ratio of mean width to mean absolute disparity of an object). The prediction performance of the proposed disparity features is evaluated using various types of stereoscopic images. Experimental results demonstrate that the combined use of the proposed object-dependent disparity features substantially improve the prediction performance of the conventional disparity magnitude- and spatial complexity-related features. The performance gain ranges from 0.045 to 0.135 of correlation coefficient, compared with the feature combinations used in the conventional visual comfort metrics.

[1]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[2]  Robert S. Allison,et al.  The effect of crosstalk on depth magnitude in thin structures , 2011, Electronic Imaging.

[3]  Kwanghoon Sohn,et al.  Visual fatigue evaluation and enhancement for 2D-plus-depth video , 2010, 2010 IEEE International Conference on Image Processing.

[4]  Michael Green,et al.  Comparison of standard resampling methods for performance estimation of artificial neural network ensembles , 2007 .

[5]  W Richards,et al.  Local versus global stereopsis: two mechanisms? , 1974, Vision research.

[6]  Sumio Yano,et al.  A study of visual fatigue and visual comfort for 3D HDTV/HDTV images , 2002 .

[7]  Do-Kyoung Kwon,et al.  Optimizing 3D image display using the stereoacuity function , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  R. Hess,et al.  D max for stereopsis depends on size, not spatial frequency content , 1995, Vision Research.

[9]  Mel Siegel,et al.  Perceptions of crosstalk and the possibility of a zoneless autostereoscopic display , 2001, IS&T/SPIE Electronic Imaging.

[10]  J. R. Quinlan.  Learning With Continuous Classes , 1992 .

[11]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[12]  Robert S. Allison,et al.  The Effect of Crosstalk on the Perceived Depth From Disparity and Monocular Occlusions , 2011, IEEE Transactions on Broadcasting.

[13]  Vladimir Zlokolica,et al.  Salient Motion Features for Video Quality Assessment , 2011, IEEE Transactions on Image Processing.

[14]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[15]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[16]  F A Miles,et al.  Optically induced changes in the couplings between vergence and accommodation , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[18]  Jianxiong Xiao,et al.  What makes an image memorable , 2011 .

[19]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[20]  Filippo Speranza,et al.  Effect of disparity and motion on visual comfort of stereoscopic images , 2006, Electronic Imaging.

[21]  Wijnand A. IJsselsteijn,et al.  Visual discomfort of 3D TV: Assessment methods and modeling , 2011, Displays.

[22]  F. Okano,et al.  PARALLAX DISTRIBUTION AND VISUAL COMFORT ON STEREOSCOPIC HDTV , 2002 .

[23]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[24]  Ian P. Howard,et al.  Seeing in Depth , 2008 .

[25]  Yong Man Ro,et al.  Visual comfort assessment metric based on salient object motion information in stereoscopic video , 2012, J. Electronic Imaging.

[26]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[27]  Nobuyuki Hiruma,et al.  Characteristics of accommodation toward apparent depth , 1999, Vision Research.

[28]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Jian-Chiun Liou,et al.  Shutter glasses stereo LCD with a dynamic backlight , 2009, Electronic Imaging.

[30]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[31]  C. Schor,et al.  Binocular sensory fusion is limited by spatial resolution , 1984, Vision Research.

[32]  Christopher W. Tyler,et al.  Binocular fusion limits are independent of contrast, luminance gradient and component phases , 1989, Vision Research.

[33]  B. Julesz,et al.  A disparity gradient limit for binocular fusion. , 1980, Science.

[34]  Nobuyuki Hiruma,et al.  Accommodation Response to Binocular Stereoscopic TV Images and Their Viewing Conditions , 1993 .

[35]  Touradj Ebrahimi,et al.  Impact of Acquisition Distortion on the Quality of Stereoscopic Images , 2010 .

[36]  Zhaoyang Zhang,et al.  Object segmentation using stereo images , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[37]  David M. Hoffman,et al.  Perceptual Issues in Stereoscopic Signal Processing , 2011, IEEE Transactions on Broadcasting.

[38]  Sergio Goma,et al.  3D discomfort from vertical and torsional disparities in natural images , 2012, Electronic Imaging.

[39]  Kwanghoon Sohn,et al.  Visual Fatigue Prediction for Stereoscopic Image , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  A E Kertesz,et al.  Effect of stimulus size on fusion and vergence. , 1981, Journal of the Optical Society of America.

[41]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[42]  Andrew J. Woods,et al.  Understanding Crosstalk in Stereoscopic Displays , 2010 .

[43]  Matthias Wöpking,et al.  Viewing comfort with stereoscopic pictures : an experimental study on the subjective effects of disparity magnitude and depth of focus , 1995 .

[44]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[45]  Abraham Bernstein,et al.  Improving defect prediction using temporal features and non linear models , 2007, IWPSE '07.