3D visual discomfort predictor based on neural activity statistics

Visual discomfort assessment (VDA) on stereoscopic images is of fundamental importance for making decisions regarding visual fatigue caused by unnatural binocular alignment. Nevertheless, no solid framework exists to quantify this discomfort using models of the responses of visual neurons. Binocular vision is realized by means of neural mechanisms that subserve the sensorimotor control of eye movements. We propose a neuronal model-based framework called Neural 3D Visual Discomfort Predictor (N3D-VDP) that automatically predicts the level of visual discomfort experienced when viewing stereoscopic 3D (S3D) images. The N3D-VDP model extracts features derived by estimating the neural activity associated with the processing of binocular disparities. In this regard we deploy a model of disparity processing in the extra-striate middle temporal (MT) region of occipital lobe. We compare the performance of N3D-VDP with other recent VDA algorithms using correlations against reported subjective visual discomfort, and show that N3D-VDP is statistically superior to the other methods.

[1]  Peter Neri,et al.  A stereoscopic look at visual cortex. , 2005, Journal of neurophysiology.

[2]  F. A. Miles,et al.  Single-unit activity in cortical area MST associated with disparity-vergence eye movements: evidence for population coding. , 2001, Journal of neurophysiology.

[3]  Gregory C DeAngelis,et al.  Disparity Channels in Early Vision , 2007, The Journal of Neuroscience.

[4]  U. Schwarz,et al.  Neuroophthalmology: a brief Vademecum. , 2004, European journal of radiology.

[5]  Fumio Okano,et al.  Measurement of parallax distribution and its application to the analysis of visual comfort for stereoscopic HDTV , 2003, IS&T/SPIE Electronic Imaging.

[6]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[7]  Sumio Yano,et al.  A study of visual fatigue and visual comfort for 3D HDTV/HDTV images , 2002 .

[8]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[9]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[10]  Kwanghoon Sohn,et al.  Visual Fatigue Prediction for Stereoscopic Image , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  H. Komatsu,et al.  Disparity sensitivity of neurons in monkey extrastriate area MST , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Kwanghoon Sohn,et al.  Visual fatigue modeling and analysis for stereoscopic video , 2012 .

[13]  Gregory C DeAngelis,et al.  Coding of horizontal disparity and velocity by MT neurons in the alert macaque. , 2003, Journal of neurophysiology.

[14]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .