Gaze-contingent simulation of retinopathy: Some potential pitfalls and remedies

Many important results in visual neuroscience rely on the use of gaze-contingent retinal stabilization techniques. Our work focuses on the important fraction of these studies that is concerned with the retinal stabilization of visual filters that degrade some specific portions of the visual field. For instance, macular scotomas, often induced by age related macular degeneration, can be simulated by continuously displaying a gaze-contingent mask in the center of the visual field. The gaze-contingent rules used in most of these studies imply only a very minimal processing of ocular data. By analyzing the relationship between gaze and scotoma locations for different oculo-motor patterns, we show that such a minimal processing might have adverse perceptual and oculomotor consequences due mainly to two potential problems: (a) a transient blink-induced motion of the scotoma while gaze is static, and (b) the intrusion of post-saccadic slow eye movements. We have developed new gaze-contingent rules to solve these two problems. We have also suggested simple ways of tackling two unrecognized problems that are a potential source of mismatch between gaze and scotoma locations. Overall, the present work should help design, describe and test the paradigms used to simulate retinopathy with gaze-contingent displays.

[1]  Benjamin Rappaz,et al.  Simulation of artificial vision, III: do the spatial or temporal characteristics of stimulus pixelization really matter? , 2005, Investigative ophthalmology & visual science.

[2]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[3]  Lester C. Loschky,et al.  How late can you update gaze-contingent multiresolutional displays without detection? , 2007, TOMCCAP.

[4]  G. Legge,et al.  Functional and cortical adaptations to central vision loss , 2005, Visual Neuroscience.

[5]  H. Collewijn,et al.  Human eye movements associated with blinks and prolonged eyelid closure. , 1985, Journal of neurophysiology.

[6]  M. Crossland,et al.  FIXATION STABILITY MEASUREMENT USING THE MP1 MICROPERIMETER , 2009, Retina.

[7]  Reinhold Kliegl,et al.  Binocular coordination in microsaccades , 2003 .

[8]  G. Underwood.  Eye guidance in reading and scene perception , 1998 .

[9]  W. B. Cushman,et al.  Characteristics of smooth eye movements with stabilized targets , 1984, Vision Research.

[10]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[11]  Lester C. Loschky,et al.  Investigating spatial vision and dynamic attentional selection using a gaze-contingent multiresolutional display. , 2002, Journal of experimental psychology. Applied.

[12]  Jeffrey S. Perry,et al.  Visual search: the role of peripheral information measured using gaze-contingent displays. , 2006, Journal of vision.

[13]  D. Burr,et al.  Changes in visual perception at the time of saccades , 2001, Trends in Neurosciences.

[14]  J. Henderson,et al.  Object identification without foveal vision: Evidence from an artificial scotoma paradigm , 1997, Perception & psychophysics.

[15]  M. Rolfs.  Microsaccades: Small steps on a long way , 2009, Vision Research.

[16]  Laura Chamberlain.  Eye Tracking Methodology; Theory and Practice , 2007 .

[17]  B. Rappaz,et al.  Simulation of artificial vision: II. Eccentric reading of full-page text and the learning of this task , 2004, Vision Research.

[18]  Wayne J. Ryan,et al.  Adapting Starburst for Elliptical Iris Segmentation , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[19]  Michael D Crossland,et al.  Fixation stability and reading speed in patients with newly developed macular disease * , 2004, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[20]  U. Ilg.  Slow eye movements , 1997, Progress in Neurobiology.

[21]  S. Heywood,et al.  Eye movements and the afterimage. I. Tracking the afterimage. , 1971, Vision research.

[22]  John M. Foley,et al.  Psychophysics of Reading in Normal and Low Vision , 2008 .

[23]  G. Barnes,et al.  Cognitive processes involved in smooth pursuit eye movements , 2008, Brain and Cognition.

[24]  K Rayner,et al.  Reading without a fovea. , 1979, Science.

[25]  Angélica Pérez Fornos,et al.  Simulation of artificial vision: IV. Visual information required to achieve simple pointing and manipulation tasks , 2008, Vision Research.

[26]  Keith D. White,et al.  Contrast sensitivity during saccadic eye movements , 1978, Vision Research.

[27]  J. H. Bertera.  The effect of simulated scotomas on visual search in normal subjects. , 1988, Investigative ophthalmology & visual science.

[28]  S. Heywood,et al.  Voluntary Control of Smooth Eye Movements and their Velocity , 1972, Nature.

[29]  Michele Rucci,et al.  EyeRIS: A general-purpose system for eye-movement-contingent display control , 2007, Behavior research methods.

[30]  Todd S Horowitz,et al.  Distinguishing between parallel and serial accounts of multiple object tracking. , 2010, Journal of vision.

[31]  Qi Tian,et al.  Content-adaptive digital music watermarking based on music structure analysis , 2007, TOMCCAP.

[32]  Lester C. Loschky,et al.  Perception onset time during fixations in free viewing , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[33]  Lester C. Loschky,et al.  Gaze-Contingent Multiresolutional Displays: An Integrative Review , 2003, Hum. Factors.

[34]  M. Crossland,et al.  Task-specific fixation behavior in macular disease. , 2011, Investigative ophthalmology & visual science.

[35]  J. Henderson,et al.  Initial scene representations facilitate eye movement guidance in visual search. , 2007, Journal of experimental psychology. Human perception and performance.

[36]  Géry d'Ydewalle,et al.  Functional Division of the Visual Field , 1998 .

[37]  P M van Diepen,et al.  Brief foveal masking during scene perception. , 1999, Acta psychologica.

[38]  Jonathan Westley Peirce,et al.  Neuroinformatics Original Research Article Generating Stimuli for Neuroscience Using Psychopy , 2022 .

[39]  A. Safran,et al.  Development of a viewing strategy during adaptation to an artificial central scotoma , 2004, Vision Research.

[40]  E. Castet,et al.  ‘Saccadic suppression’ – no need for an active extra-retinal mechanism , 2001, Trends in Neurosciences.

[41]  Andrew D. Straw,et al.  Vision Egg: an Open-Source Library for Realtime Visual Stimulus Generation , 2008, Frontiers Neuroinformatics.

[42]  Gary S Rubin,et al.  Reading with central field loss: number of letters masked is more important than the size of the mask in degrees , 1999, Vision Research.

[43]  Eric Castet,et al.  Page mode reading with simulated scotomas: Oculo-motor patterns , 2008, Vision Research.

[44]  Jean-Baptiste Bernard,et al.  Page mode reading with simulated scotomas: A modest effect of interline spacing on reading speed , 2007, Vision Research.

[45]  Wilson S. Geisler,et al.  Gaze-contingent real-time simulation of arbitrary visual fields , 2002, IS&T/SPIE Electronic Imaging.

[46]  Dennis R. Proffitt,et al.  Within striking distance: Task efficacy influences perceived size and distance , 2010 .

[47]  Guillaume S. Masson,et al.  Motion perception during saccadic eye movements , 2000, Nature Neuroscience.

[48]  Andrew T. Duchowski,et al.  Gaze-Contingent Displays: A Review , 2004, Cyberpsychology Behav. Soc. Netw..

[49]  Peter E Pidcoe,et al.  Oculomotor tracking strategy in normal subjects with and without simulated scotoma. , 2006, Investigative ophthalmology & visual science.

[50]  Han Collewijn,et al.  Voluntary smooth eye movements with foveally stabilized targets , 2004, Experimental Brain Research.

[51]  U. Leonards,et al.  Simulation of artificial vision: I. Eccentric reading of isolated words, and perceptual learning , 2003, Vision Research.

[52]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[53]  Frans W Cornelissen,et al.  The Influence of Artificial Scotomas on Eye Movements during Visual Search , 2005, Optometry and vision science : official publication of the American Academy of Optometry.

[54]  E M Fine,et al.  Effects of cataract and scotoma on visual acuity: a simulation study. , 1999, Optometry and vision science : official publication of the American Academy of Optometry.

[55]  Eric Castet,et al.  Motion perception of saccade-induced retinal translation , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[56]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[57]  E Peli,et al.  Smooth eye-movement control with secondary visual feedback. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[58]  John M Henderson,et al.  The time course of initial scene processing for eye movement guidance in natural scene search. , 2010, Journal of vision.

[59]  L A Riggs,et al.  Blink-related eye movements. , 1987, Investigative ophthalmology & visual science.

[60]  Terry C. Lansdown,et al.  The mind's eye: cognitive and applied aspects of eye movement research , 2005 .

[61]  Andrew T. Duchowski,et al.  A Gaze-Contingent Display Compensating for Scotomata , 2009, Eurographics.