Three-dimensional binocular eye–hand coordination in normal vision and with simulated visual impairment

Sensorimotor coupling in healthy humans is demonstrated by the higher accuracy of visually tracking intrinsically—rather than extrinsically—generated hand movements in the fronto-parallel plane. It is unknown whether this coupling also facilitates vergence eye movements for tracking objects in depth, or can overcome symmetric or asymmetric binocular visual impairments. Human observers were therefore asked to track with their gaze a target moving horizontally or in depth. The movement of the target was either directly controlled by the observer’s hand or followed hand movements executed by the observer in a previous trial. Visual impairments were simulated by blurring stimuli independently in each eye. Accuracy was higher for self-generated movements in all conditions, demonstrating that motor signals are employed by the oculomotor system to improve the accuracy of vergence as well as horizontal eye movements. Asymmetric monocular blur affected horizontal tracking less than symmetric binocular blur, but impaired tracking in depth as much as binocular blur. There was a critical blur level up to which pursuit and vergence eye movements maintained tracking accuracy independent of blur level. Hand–eye coordination may therefore help compensate for functional deficits associated with eye disease and may be employed to augment visual impairment rehabilitation.

[1]  Kenneth W. Wright,et al.  Handbook of pediatric strabismus and amblyopia , 2006 .

[2]  R. Sireteanu,et al.  The time course of interocular suppression in normal and amblyopic subjects. , 1991, Investigative ophthalmology & visual science.

[3]  Lamarre,et al.  Self-moved target eye tracking in control and deafferented subjects: roles of arm motor command and proprioception in arm-eye coordination. , 1996, Journal of neurophysiology.

[4]  Casper J. Erkelens,et al.  Simultaneous hand tracking does not affect human vergence pursuit , 2004, Experimental Brain Research.

[5]  G. M. Gauthier,et al.  Oculo-manual coordination control: Ocular and manual tracking of visual targets with delayed visual feedback of the hand motion , 2004, Experimental Brain Research.

[6]  R. Hess,et al.  A Game Platform for Treatment of Amblyopia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Janette Atkinson,et al.  Development of contrast sensitivity over the first 3 months of life in the human infant , 1977, Vision Research.

[8]  Paul D. Gamlin Neural Mechanisms for the Control of Vergence Eye Movements , 2002, Annals of the New York Academy of Sciences.

[9]  S K Rushton,et al.  Developing visual systems and exposure to virtual reality and stereo displays: some concerns and speculations about the demands on accommodation and vergence. , 1999, Applied ergonomics.

[10]  A SORSBY,et al.  Vision, Visual Acuity, and Ocular Refraction of Young Men , 1960, British medical journal.

[11]  Jing Chen,et al.  LRP predicts smooth pursuit eye movement onset during the ocular tracking of self-generated movements. , 2016, Journal of neurophysiology.

[12]  Carolyn Jeane Perry,et al.  An Eye in the Palm of Your Hand: Alterations in Visual Processing Near the Hand, a Mini-Review , 2016, Front. Comput. Neurosci..

[13]  Steven C. Dakin,et al.  Spatial-frequency dependent binocular imbalance in amblyopia , 2015, Scientific Reports.

[14]  G. K. Noorden,et al.  Pursuit movements of normal and amblyopic eyes. An electro-ophthalmographic study. II. Pursuit movements in amblyopic patients. , 1962, American journal of ophthalmology.

[15]  Karl R Gegenfurtner,et al.  Effects of contrast on smooth pursuit eye movements. , 2005, Journal of vision.

[16]  Jefferson D. Grubb,et al.  Hands up: attentional prioritization of space near the hand. , 2006, Journal of experimental psychology. Human perception and performance.

[17]  Mazyar Fallah,et al.  Hand placement near the visual stimulus improves orientation selectivity in V2 neurons. , 2015, Journal of neurophysiology.

[18]  Daniela Balslev,et al.  Spatially valid proprioceptive cues improve the detection of a visual stimulus , 2010, Experimental Brain Research.

[19]  G. M. Gauthier,et al.  Oculo-manual tracking of visual targets: control learning, coordination control and coordination model , 2004, Experimental Brain Research.

[20]  Paul D. Gamlin,et al.  The role of cerebro-ponto-cerebellar pathways in the control of vergence eye movements , 1996, Eye.

[21]  E. Birch,et al.  The functional significance of stereopsis. , 2010, Investigative ophthalmology & visual science.

[22]  Lynn C. Robertson,et al.  Reaching Out to See: Arm Position Can Attenuate Human Visual Loss , 2004, Journal of Cognitive Neuroscience.

[23]  Stephen G Lisberger,et al.  Visual Guidance of Smooth Pursuit Eye Movements. , 2015, Annual review of vision science.

[24]  D. Lam,et al.  Myopia progression among preschool Chinese children in Hong Kong. , 2004, Annals of the Academy of Medicine, Singapore.

[25]  Simon Grant,et al.  Age- and stereovision-dependent eye-hand coordination deficits in children with amblyopia and abnormal binocularity. , 2014, Investigative ophthalmology & visual science.

[26]  John A Greenwood,et al.  Binocular versus standard occlusion or blurring treatment for unilateral amblyopia in children aged three to eight years. , 2022, The Cochrane database of systematic reviews.

[27]  Christopher M. Harris,et al.  Characteristics of saccades in human infants , 1984, Vision Research.

[28]  S. Judge,et al.  Neurons in the monkey midbrain with activity related to vergence eye movement and accommodation. , 1986, Journal of neurophysiology.

[29]  J. Vercher,et al.  Oculo-manual coordination control: respective role of visual and non-visual information in ocular tracking of self-moved targets , 2004, Experimental Brain Research.

[30]  R F Hess,et al.  A new binocular approach to the treatment of amblyopia in adults well beyond the critical period of visual development. , 2010, Restorative neurology and neuroscience.

[31]  Francesca Frassinetti,et al.  Direct evidence from parietal extinction of enhancement of visual attention near a visible hand , 2000, Current Biology.

[32]  Ewa Niechwiej-Szwedo,et al.  The effects of monocular viewing on hand-eye coordination during sequential grasping and placing movements , 2016, Vision Research.

[33]  David R Williams,et al.  Neural compensation for the eye's optical aberrations. , 2004, Journal of vision.

[34]  Li Li,et al.  Manual tracking enhances smooth pursuit eye movements. , 2015, Journal of vision.

[35]  Manuela Chessa,et al.  Simulated disparity and peripheral blur interact during binocular fusion. , 2014, Journal of vision.

[36]  Kikuro Fukushima,et al.  Visual and vergence eye movement-related responses of pursuit neurons in the caudal frontal eye fields to motion-in-depth stimuli , 2005, Experimental Brain Research.

[37]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[38]  M J Steinbach,et al.  Eye Tracking of Observer-Generated Target Movements , 1968, Science.

[39]  John J. Sloper,et al.  Impaired development of eye–hand coordination in children with strabismus and amblyopia , 2011 .

[40]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[41]  Elke U. Weber,et al.  Nonveridical visual direction produced by monocular viewing , 1981 .

[42]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[43]  G. Westheimer,et al.  Functional organization of primate oculomotor system revealed by cerebellectomy , 2004, Experimental Brain Research.

[44]  Hiroshi Imamizu,et al.  Activation of the cerebellum in co-ordinated eye and hand tracking movements: an fMRI study , 2000, Experimental Brain Research.

[45]  Karl R Gegenfurtner,et al.  Temporal contrast sensitivity during smooth pursuit eye movements. , 2007, Journal of vision.

[46]  A R Fielder,et al.  Refractive adaptation in amblyopia: quantification of effect and implications for practice , 2004, British Journal of Ophthalmology.

[47]  P. J. Knox,et al.  An exploratory study: prolonged periods of binocular stimulation can provide an effective treatment for childhood amblyopia. , 2012, Investigative ophthalmology & visual science.

[48]  Kenjiro Suzuki,et al.  Vortical structure and heat transfer enhancement in the wake behind a wing-type vortex generator in drag-reducing surfactant flow , 2002 .

[49]  Wolfgang Stuerzlinger,et al.  The performance of un-instrumented in-air pointing , 2014, Graphics Interface.

[50]  Kikuro Fukushima,et al.  Coding of smooth eye movements in three-dimensional space by frontal cortex , 2002, Nature.

[51]  Hiroshi Uozato,et al.  Effects of Dominant and Nondominant Eyes in Binocular Rivalry , 2004, Optometry and vision science : official publication of the American Academy of Optometry.

[52]  M S Banks,et al.  Acuity and contrast sensitivity in 1-, 2-, and 3-month-old human infants. , 1978, Investigative ophthalmology & visual science.

[53]  Steven C Dakin,et al.  Binocular Therapy for Childhood Amblyopia Improves Vision Without Breaking Interocular Suppression. , 2017, Investigative ophthalmology & visual science.

[54]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[55]  D. Sindayihebura,et al.  2. Instability of an annular sheet liquid flow, bubble regime , 2001 .

[56]  P. Bex,et al.  Spatial frequency, phase, and the contrast of natural images. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[57]  Peter Thier,et al.  The neural basis of smooth pursuit eye movements in the rhesus monkey brain , 2008, Brain and Cognition.

[58]  E. Kretzmer Statistics of television signals , 1952 .

[59]  Otmar Bock,et al.  Coordination of arm and eye movements in tracking of sinusoidally moving targets , 1987, Behavioural Brain Research.

[60]  D. Melmoth,et al.  The functional consequences of glaucoma for eye-hand coordination. , 2009, Investigative ophthalmology & visual science.

[61]  E F FINCHAM,et al.  The reciprocal actions of accommodation and convergence , 1957, The Journal of physiology.

[62]  Paul D. Gamlin,et al.  An area for vergence eye movement in primate frontal cortex , 2000, Nature.

[63]  A. Roucoux,et al.  Development of fixation and pursuit eye movements in human infants , 1983, Behavioural Brain Research.

[64]  Qing Yang,et al.  The latency of saccades, vergence, and combined eye movements in children and in adults. , 2002, Investigative ophthalmology & visual science.

[65]  Melvyn A. Goodale,et al.  A hand in blindsight: Hand placement near target improves size perception in the blind visual field , 2008, Neuropsychologia.

[66]  R. Fisher FREQUENCY DISTRIBUTION OF THE VALUES OF THE CORRELATION COEFFIENTS IN SAMPLES FROM AN INDEFINITELY LARGE POPU;ATION , 1915 .

[67]  Robert J. Moorhead,et al.  Visualization of fluid flows in virtual environments , 2004, J. Vis..

[68]  G. Rizzolatti,et al.  Action for perception: a motor-visual attentional effect. , 1999, Journal of experimental psychology. Human perception and performance.

[69]  C. Schor,et al.  Binocular sensory fusion is limited by spatial resolution , 1984, Vision Research.

[70]  Peter J. Bex,et al.  Vergence driven accommodation with simulated disparity in myopia and emmetropia , 2018, Experimental eye research.

[71]  J. Vercher,et al.  The oculomanual coordination control center takes into account the mechanical properties of the arm , 1999, Experimental Brain Research.

[72]  Mark S. Bolding,et al.  Mapping the Macaque Superior Temporal Sulcus: Functional Delineation of Vergence and Version Eye-Movement-Related Activity , 2015, The Journal of Neuroscience.

[73]  Bernard D. Adelstein,et al.  Factors influencing operator interaction with virtual objects viewed via head-mounted see-through displays: viewing conditions and rendering latency , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[74]  J R Lackner,et al.  Visual Tracking of Active and Passive Movements of the Hand , 1980, The Quarterly journal of experimental psychology.

[75]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[76]  C Busettini,et al.  Short-term saccadic adaptation in the macaque monkey: a binocular mechanism. , 2013, Journal of neurophysiology.

[77]  Jean-Louis Vercher,et al.  Manuo-ocular coordination in target tracking. I. A model simulating human performance , 1997, Biological Cybernetics.

[78]  Olivier A Coubard,et al.  Saccade and vergence eye movements: a review of motor and premotor commands , 2013, The European journal of neuroscience.

[79]  Joze Guna,et al.  An Analysis of the Precision and Reliability of the Leap Motion Sensor and Its Suitability for Static and Dynamic Tracking , 2014, Sensors.

[80]  S. Hyams,et al.  Prevalence of refractive errors in adults over 40: a survey of 8102 eyes. , 1977, The British journal of ophthalmology.

[81]  Robert F. Hess,et al.  Dichoptic training enables the adult amblyopic brain to learn , 2013, Current Biology.

[82]  Preeti Verghese,et al.  Depth Perception and Grasp in Central Field Loss , 2016, Investigative Ophthalmology and Visual Science.

[83]  Daphne Bavelier,et al.  Recovering stereo vision by squashing virtual bugs in a virtual reality environment , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[84]  Louise Hainline,et al.  Binocular alignment and vergence in early infancy , 1995, Vision Research.

[85]  Anna C Nobre,et al.  Tracking the changing feature of a moving object. , 2016, Journal of vision.

[86]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[87]  R. Miall,et al.  The cerebellum coordinates eye and hand tracking movements , 2001, Nature Neuroscience.

[88]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[89]  S. Judge,et al.  How is binocularity maintained during convergence and divergence? , 1996, Eye.

[90]  John A Greenwood,et al.  Childhood amblyopia: current management and new trends. , 2016, British medical bulletin.

[91]  Serge Resnikoff,et al.  Global magnitude of visual impairment caused by uncorrected refractive errors in 2004. , 2008, Bulletin of the World Health Organization.

[92]  J. E. Albano,et al.  Binocular interactions in rapid saccadic adaptation , 1995, Vision Research.

[93]  G. K. Noorden,et al.  Pursuit movements of normal and amblyopic eyes. An electro-ophthalmographic study. 1. Physiology of pursuit movements. , 1962, American journal of ophthalmology.

[94]  Peter J. Bex,et al.  Monocular and Binocular Contributions to Oculomotor Plasticity , 2016, Scientific Reports.

[95]  Robert J. Teather,et al.  Effects of tracking technology, latency, and spatial jitter on object movement , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[96]  G Smith,et al.  Angular Diameter of Defocus Blur Discs , 1982, American journal of optometry and physiological optics.

[97]  Casper J. Erkelens,et al.  Influences of hand movements on eye movements in tracking tasks in man , 2004, Experimental Brain Research.

[98]  J A Movshon,et al.  Effects of early unilateral blur on the macaque's visual system. I. Behavioral observations , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[99]  M. Fahle Binocular rivalry: Suppression depends on orientation and spatial frequency , 1982, Vision Research.

[100]  Tara L. Alvarez,et al.  Evidence for separate control of slow version and vergence eye movements: support for Hering's Law , 1998, Vision Research.

[101]  M. Moseley,et al.  Does stereopsis matter in humans? , 1996, Eye.

[102]  D. Melmoth,et al.  Eye-hand coordination skills in children with and without amblyopia. , 2011, Investigative ophthalmology & visual science.

[103]  A K Lam,et al.  Effect of naturally occurring visual acuity differences between two eyes in stereoacuity. , 1996, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[104]  Peter J. Bex,et al.  3 Dimensional Binocular Eye and Hand Coordination in Normal Vision and with Simulated Visual Impairments , 2016 .

[105]  J. R. Lackner,et al.  The influence of efferent, proprioceptive, and timing factors on the accuracy of eye-hand tracking , 2004, Experimental Brain Research.

[106]  Ching-Jen Chen,et al.  Numerical simulation of flow in a screw-type blood pump , 2005, J. Vis..

[107]  P. Bex,et al.  Perceived Blur in Naturally Contoured Images Depends on Phase , 2010, Front. Psychology.