Vergence eye movements signifying 3D depth perception from 2D movies

Abstract A sensation of depth can arise from two-dimensional (2D) movies without any stereoscopic depth cue. Depth perception in three-dimensional (3D) space depends on the stability of stereoscopic gaze by vergence – coordinated movement of the two eyes in opposite directions – compensating the misalignment of the retinal images from the two eyes ( i.e. binocular disparity) [1] . On the other hand, the oculomotor mechanisms that stabilize stereoscopic gaze and depth perception in 2D movie space remain unclear [2] . Here, we propose a hypothesis that vergence eye movements signifying 3D depth perception persist during prolonged 2D movie presentation without binocular disparity cues. By measuring eye positions while the subject viewed moving random-dot video stimuli, we show that sustained vergence is induced during 30-s exposure to radially expanding 2D optic flow. Moreover, a 2D video movie showing a passenger’s view of a roller coaster induces continuously changing vergence. In the absence of binocular disparity cues, the pictorial depth information within a 5° × 5° gaze window and optic flow in the movie simultaneously and independently influence vergence. The pictorial gaze-area depth information affects vergence mainly in the virtual far space, whereas optic flow robustly affects vergence irrespective of the nearness. These findings demonstrate that vergence serves as a reliable marker signifying 3D depth perception from 2D movies, imposing critical constraints on creation of an effective and safe virtual reality.

[1]  C. Schor,et al.  Disparity vergence dynamics and fixation disparity. , 1986, American journal of optometry and physiological optics.

[2]  H. Minamitani,et al.  Image analysis of quick phase eye movements in nystagmus with high-speed video system , 2006, Medical and Biological Engineering and Computing.

[3]  J Semmlow,et al.  Dynamic contributions of the components of binocular vergence. , 1979, Journal of the Optical Society of America.

[4]  J. T. Enright,et al.  Art and the Oculomotor System: Perspective Illustrations Evoke Vergence Changes , 1987, Perception.

[5]  T. Bando,et al.  Vergence eye movement and lens accommodation: cortical processing and neuronal pathway , 2000 .

[6]  James S Wolffsohn,et al.  The relationship between CA/C ratio and individual differences in dynamic accommodative responses while viewing stereoscopic images. , 2009, Journal of vision.

[7]  R. Hetherington.  The Perception of the Visual World , 1952 .

[8]  Amy A. Rezec,et al.  Attention enhances adaptability: evidence from motion adaptation experiments , 2004, Vision Research.

[9]  D S Zee,et al.  Neurological aspects of vergence eye movements. , 1989, Revue neurologique.

[10]  R. Hertle,et al.  Relationships between versional and vergent quick phases of the involuntary version-vergence nystagmus. , 2008, Journal of vision.

[11]  C. Busettini,et al.  Radial optic flow induces vergence eye movements with ultra-short latencies , 1997, Nature.

[12]  Ian P. Howard,et al.  Seeing in Depth , 2008 .

[13]  F. A. Miles,et al.  Perception can influence the vergence responses associated with open-loop gaze shifts in 3D. , 2003, Journal of vision.

[14]  C. J. Erkelens,et al.  Depth cues, rather than perceived depth, govern vergence , 2007, Experimental Brain Research.

[15]  Effect of the Background on the Disparity-Induced Ramp Vergence Response in Humans , 2006, Ophthalmologica.

[16]  J. T. Enright.  Perspective vergence: Oculomotor responses to line drawings , 1987, Vision Research.

[17]  G K Hung,et al.  Quantitative assessment of disparity vergence components. , 1986, Investigative ophthalmology & visual science.

[18]  Dario L. Ringach,et al.  Binocular eye movements caused by the perception of three-Dimensional structure from motion , 1996, Vision Research.

[19]  M. Lappe.  Neuronal processing of optic flow , 2000 .

[20]  K. N. Ogle.  On the limits of stereoscopic vision. , 1952, Journal of experimental psychology.

[21]  V. V. Krishnan,et al.  Frequency analysis of accommodation, accommodative vergence and disparity vergence. , 1973, Vision research.

[22]  Kenji Kawano,et al.  Ocular tracking: behavior and neurophysiology , 1999, Current Opinion in Neurobiology.

[23]  Nuo Li,et al.  Updating Visual Space during Motion in Depth , 2005, Neuron.

[24]  Richard H. Y. So,et al.  Scene movement: an important cause of cybersickness , 2002 .

[25]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[26]  Ian P Howard,et al.  Vergence modulation as a cue to movement in depth. , 2008, Spatial vision.

[27]  Bernhard J. M. Hess,et al.  Self-motion-induced eye movements: effects on visual acuity and navigation , 2005, Nature Reviews Neuroscience.

[28]  Irene Gottlob,et al.  Physiology and pathology of eye–head coordination , 2007, Progress in Retinal and Eye Research.

[29]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[30]  Daniel J. Hannon,et al.  Direction of self-motion is perceived from optical flow , 1988, Nature.

[31]  Y. Miyashita,et al.  Callosal window between prefrontal cortices: cognitive interaction to retrieve long-term memory. , 1998, Science.