Knowing what the brain is seeing in three dimensions: A novel, noninvasive, sensitive, accurate, and low-noise technique for measuring ocular torsion.

Torsional eye movements are rotations of the eye around the line of sight. Measuring torsion is essential to understanding how the brain controls eye position and how it creates a veridical perception of object orientation in three dimensions. Torsion is also important for diagnosis of many vestibular, neurological, and ophthalmological disorders. Currently, there are multiple devices and methods that produce reliable measurements of horizontal and vertical eye movements. Measuring torsion, however, noninvasively and reliably has been a longstanding challenge, with previous methods lacking real-time capabilities or suffering from intrusive artifacts. We propose a novel method for measuring eye movements in three dimensions using modern computer vision software (OpenCV) and concepts of iris recognition. To measure torsion, we use template matching of the entire iris and automatically account for occlusion of the iris and pupil by the eyelids. The current setup operates binocularly at 100 Hz with noise <0.1° and is accurate within 20° of gaze to the left, to the right, and up and 10° of gaze down. This new method can be widely applicable and fill a gap in many scientific and clinical disciplines.

[1]  D. Zee,et al.  Validity of Listing's law during fixations, saccades, smooth pursuit eye movements, and blinks , 1996, Experimental Brain Research.

[2]  Measurement of subjective and objective cyclodeviation in oblique eye muscle disorders. , 1995, Strabismus.

[3]  D. Guyton.  Clinical Assessment of Ocular Torsion , 1983 .

[4]  G Freyss,et al.  3-D eye movement measurements on four Comex's divers using video CCD cameras, during high pressure diving. , 1995, Acta oto-laryngologica. Supplementum.

[5]  Oliver Ehrt,et al.  Scanning laser ophthalmoscope fundus cyclometry in near-natural viewing conditions , 2001, Graefe's Archive for Clinical and Experimental Ophthalmology.

[6]  H. Collewijn,et al.  Instability of ocular torsion during fixation: Cyclovergence is more stable than cycloversion , 1994, Vision Research.

[7]  Kwang Suk Park,et al.  Robust measurement of ocular torsion using iterative Lucas-Kanade , 2007, Comput. Methods Programs Biomed..

[8]  A M Bronstein,et al.  Dissociation of visual and haptic vertical in two patients with vestibular nuclear lesions , 2003, Neurology.

[9]  R.L. Westra,et al.  A torsional eye movement calculation algorithm for low contrast images in video-oculography , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[10]  Amir Kheradmand,et al.  Transcranial magnetic stimulation (TMS) of the supramarginal gyrus: a window to perception of upright. , 2015, Cerebral cortex.

[11]  David E. Newman-Toker,et al.  Blind spot heterotopia by automated static perimetry to assess static ocular torsion: centro-cecal axis rotation in normals , 2010, Journal of Neurology.

[12]  Clifton M Schor,et al.  Adaptation of torsional eye alignment in relation to head roll , 1999, Vision Research.

[13]  A. H. Clarke,et al.  Using high frame rate CMOS sensors for three-dimensional eye tracking , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[14]  Stefano Ramat,et al.  Influence of orientation of exiting wire of search coil annulus on torsion after saccades. , 2004, Investigative ophthalmology & visual science.

[15]  H D Crane,et al.  Accurate two-dimensional eye tracker using first and fourth Purkinje images. , 1973, Journal of the Optical Society of America.

[16]  L. Granjon,et al.  Analyzing head roll and eye torsion by means of offline image processing , 2007, Behavior research methods.

[17]  Thomas Haslwanter,et al.  Measuring torsional eye movements by tracking stable iris features , 2010, Journal of Neuroscience Methods.

[18]  Ian P. Howard.  Cycloversion, cyclovergence and perceived slant , 1994 .

[19]  J. A. Gisbergen,et al.  A three-dimensional analysis of vergence movements at various levels of elevation , 1994, Experimental Brain Research.

[20]  S T Moore,et al.  Robust pupil center detection using a curvature algorithm. , 1999, Computer methods and programs in biomedicine.

[21]  H. Helmholtz.  Handbuch der physiologischen Optik , 2015 .

[22]  Agnes M F Wong,et al.  Listing's law: clinical significance and implications for neural control. , 2004, Survey of ophthalmology.

[23]  E. Paliulis.  Determination of Eye Torsion by Videooculography Including Cornea Optics , 2006 .

[24]  Theodore Raphan,et al.  Robust and real-time torsional eye position calculation using a template-matching technique , 2004, Comput. Methods Programs Biomed..

[25]  R. Kekunnaya,et al.  Pattern strabismus and torsion needs special surgical attention , 2015, Eye.

[26]  Heterotopia of the blind spot in ocular vertical muscle imbalance. , 1968, Transactions of the American Ophthalmological Society.

[27]  Scott J. Wood,et al.  Human otolith–ocular reflexes during off-vertical axis rotation: effect of frequency on tilt–translation ambiguity and motion sickness , 2002, Neuroscience Letters.

[28]  I. Curthoys,et al.  The Effect of Ocular Torsional Position on Perception of the Roll-tilt of Visual Stimuli , 1997, Vision Research.

[29]  T. Haslwanter,et al.  A theoretical analysis of three-dimensional eye position measurement using polar cross-correlation , 1995, IEEE Transactions on Biomedical Engineering.

[30]  G. Brecher.  Die optokinetische Auslösung von Augenrollung und rotatorischem Nystagmus , 1934, Pflüger's Archiv für die gesamte Physiologie des Menschen und der Tiere.

[31]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[32]  T. Brandt,et al.  Diagnosis of vestibular imbalance in the blink of an eye , 2004, Neurology.

[33]  M. Sujatha,et al.  Recognition of Human Iris Patterns for Biometric Identification , 2015 .

[34]  J. Kanzaki,et al.  Measurement of ocular countertorsion reflex with fundoscopic camera in normal subjects and in patients with inner ear lesions , 1978, Archives of oto-rhino-laryngology.

[35]  I. Howard,et al.  THE MEASUREMENT OF EYE TORSION. , 1963, Vision research.

[36]  Deok Won Kim,et al.  A new method for accurate and fast measurement of 3D eye movements. , 2006, Medical engineering & physics.

[37]  Supan Tungjitkusolmun,et al.  Dual‐camera acquisition for accurate measurement of three‐dimensional eye movements , 2013 .

[38]  D. Straumann,et al.  Torsional vestibulo-ocular reflex during whole-body oscillation in the upright and the supine position. , 2000, Experimental Brain Research.

[39]  H. Kingma,et al.  Real time binocular detection of horizontal vertical and torsional eye movements by an infra red video-eye tracker. , 1995, Acta oto-laryngologica. Supplementum.

[40]  J.E. Bos,et al.  Ocular torsion quantification with video images , 1994, IEEE Transactions on Biomedical Engineering.

[41]  D. Zee,et al.  Rotation of Listing's plane with convergence: independence from eye position. , 2000, Investigative ophthalmology & visual science.

[42]  H. Collewijn,et al.  Human ocular counterroll: assessment of static and dynamic properties from electromagnetic scleral coil recordings , 2004, Experimental Brain Research.

[43]  H. B. Barlow,et al.  Slippage of Contact Lenses and other Artefacts in Relation to Fading and Regeneration of Supposedly Stable Retinal Images , 1963 .

[44]  Yooyoung Lee,et al.  VASIR: An Open-Source Research Platform for Advanced Iris Recognition Technologies , 2013, Journal of research of the National Institute of Standards and Technology.

[45]  Erich Schneider,et al.  Low-latency video tracking of horizontal, vertical, and torsional eye movements as a basis for 3dof realtime motion control of a head-mounted camera , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[46]  Mehdi Hatamian,et al.  Design Considerations for a Real-Time Ocular Counterroll Instrument , 1983, IEEE Transactions on Biomedical Engineering.

[47]  Hamish G. MacDougall,et al.  Changes in ocular torsion position produced by a single visual line rotating around the line of sight––visual “entrainment” of ocular torsion , 2004, Vision Research.

[48]  I. Curthoys,et al.  Human ocular torsional position before and after unilateral vestibular neurectomy , 2004, Experimental Brain Research.

[49]  H. Mittelstaedt.  The subjective vertical as a function of visual and extraretinal cues. , 1986, Acta psychologica.

[50]  E. Groen,et al.  Determination of ocular torsion by means of automatic pattern recognition , 1996, IEEE Transactions on Biomedical Engineering.

[51]  M. Gresty,et al.  A New Device to Quantify Ocular Counterroll Using Retinal Afterimages , 2011, Audiology and Neurotology.

[52]  T. Viéville,et al.  Ocular Counter-rolling during Active Head Tilting in Humans. , 1987, Acta oto-laryngologica.

[53]  John Porrill,et al.  Deformable model of the human iris for measuring ocular torsion from video images , 1998 .

[54]  N. Shimizu.  [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[55]  L. Riggs,et al.  Involuntary motions of the eye during monocular fixation. , 1950, Journal of experimental psychology.

[56]  Hamish G MacDougall,et al.  Functional Assessment of Head–Eye Coordination During Vehicle Operation , 2005, Optometry and vision science : official publication of the American Academy of Optometry.

[57]  I S Curthoys,et al.  VTM--an image-processing system for measuring ocular torsion. , 1991, Computer methods and programs in biomedicine.

[58]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[59]  A H Clarke,et al.  Measuring three dimensions of eye movement in dynamic situations by means of videooculography. , 1991, Acta oto-laryngologica.

[60]  A. Bronstein,et al.  The awareness of body orientation modulates the perception of visual vertical , 2012, Neuropsychologia.

[61]  Alessandro Bianchi,et al.  A new device to assess static ocular torsion , 2011, Annals of the New York Academy of Sciences.

[62]  Rolf Eckmiller,et al.  Video-oculographic measurement of 3-dimensional eye rotations , 1990, Journal of Neuroscience Methods.