Interactions Between Perception and Smooth Pursuit Eye Movements

When we see a moving object in our environment, our visual system analyzes and interprets this object’s trajectory. This motion analysis is very often then used to generate a smooth pursuit eye movement that tracks the object in order to stabilize its image on the retina. Smooth pursuit generation therefore requires visual motion signals. However, by stabilizing the retinal image of a moving object, smooth pursuit necessarily causes motion of the retinal images of stationary objects. Since such induced retinal motion does not dramatically affect pursuit – and more importantly, does not cause stationary objects to be perceived as moving – it is clear that depending on the context, similar sensory inputs can either dramatically influence both perception and pursuit or not at all. Recent research has suggested that such interaction between motion processing and smooth pursuit constitutes the core of a more general interaction between high-level perceptual integration and eye movements. Specifically, drive signals that move the eyes need not be purely retinal in nature, but can also be integrated based on disparate retinal motion directions. Moreover, ongoing motor commands themselves are used not only to cancel motion percepts of stable objects, but also to perceptually disambiguate spatial relationships between sensory features of visual objects. These results suggest that bidirectional interactions between perception and action allow maximum flexibility in generating coherent percepts of our environment – and associated actions on this environment.

[1]  Ziad M Hafed,et al.  Goal Representations Dominate Superior Colliculus Activity during Extrafoveal Tracking , 2008, The Journal of Neuroscience.

[2]  Andrew Hollingworth,et al.  Global Transsaccadic Change Blindness During Scene Perception , 2003, Psychological science.

[3]  V. Ramachandran,et al.  Perceptual Organization in Multistable Apparent Motion , 1985, Perception.

[4]  C L Colby,et al.  Visual, saccade-related, and cognitive activation of single neurons in monkey extrastriate area V3A. , 2000, Journal of neurophysiology.

[5]  T. Albright,et al.  Motion mechanisms in macaque MT. , 2005, Journal of neurophysiology.

[6]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[7]  Harold E Bedell,et al.  Suppression of motion-produced smear during smooth pursuit eye movements , 1996, Current Biology.

[8]  E. J. Morris,et al.  Visual motion processing and sensory-motor integration for smooth pursuit eye movements. , 1987, Annual review of neuroscience.

[9]  Carlos R. Ponce,et al.  Temporal evolution of 2-dimensional direction signals used to guide eye movements. , 2005, Journal of neurophysiology.

[10]  S. Zeki A vision of the brain , 1993 .

[11]  H. Collewijn,et al.  A comparison of oculomotor pursuit of a target in circular real, beta or sigma motion , 1983, Vision Research.

[12]  T D Albright,et al.  Visual motion perception. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[13]  F A Miles,et al.  Release of fixation for pursuit and saccades in humans: evidence for shared inputs acting on different neural substrates. , 1996, Journal of neurophysiology.

[14]  J P Reulen,et al.  Latency of visually evoked saccadic eye movements , 1984, Biological Cybernetics.

[15]  Hugh R. Wilson,et al.  Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity , 1992, Vision Research.

[16]  F. Hamker The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. , 2005, Cerebral cortex.

[17]  D. Robinson The mechanics of human smooth pursuit eye movement. , 1965, The Journal of physiology.

[18]  G. Westheimer Eye movement responses to a horizontally moving visual stimulus. , 1954, A.M.A. archives of ophthalmology.

[19]  P. Cavanagh,et al.  Position displacement, not velocity, is the cue to motion detection of second-order stimuli , 1998, Vision Research.

[20]  Ziad M Hafed,et al.  Ongoing eye movements constrain visual perception , 2006, Nature Neuroscience.

[21]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[22]  R. Krauzlis The Control of Voluntary Eye Movements: New Perspectives , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[23]  M. Goodale,et al.  The visual brain in action , 1995 .

[24]  R. Krauzlis,et al.  Tracking with the mind’s eye , 1999, Trends in Neurosciences.

[25]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[26]  Ziad M Hafed,et al.  Superior Colliculus Inactivation Causes Stable Offsets in Eye Position during Tracking , 2008, The Journal of Neuroscience.

[27]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[28]  D. Burr,et al.  Changes in visual perception at the time of saccades , 2001, Trends in Neurosciences.

[29]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  M. Goldberg,et al.  Saccades, salience and attention: the role of the lateral intraparietal area in visual behavior. , 2006, Progress in brain research.

[32]  P C Knox The effect of the gap paradigm on the latency of human smooth pursuit of eye movement , 1996, Neuroreport.

[33]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[34]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  Christopher D. Carello,et al.  Manipulating Intent Evidence for a Causal Role of the Superior Colliculus in Target Selection , 2004, Neuron.

[36]  Ravi S. Menon,et al.  Interaction of Retinal Image and Eye Velocity in Motion Perception , 2003, Neuron.

[37]  W. J. Tam,et al.  Fixation disengagement and eye-movement latency , 1994, Perception & psychophysics.

[38]  G. Rizzolatti,et al.  Orienting of attention and eye movements , 2004, Experimental Brain Research.

[39]  Etienne Olivier,et al.  A Deficit in Covert Attention after Parietal Cortex Inactivation in the Monkey , 2004, Neuron.

[40]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. III. Interaction with full-field visual stimulation. , 1988, Journal of neurophysiology.

[41]  M. Scotto Smooth Periodic Eye Movements Can Entrain Perceptual Alternation , 1991, Perceptual and motor skills.

[42]  M. Biscaldi,et al.  The initiation of smooth pursuit eye movements and saccades in normal subjects and in “express-saccade makers” , 2002, Experimental Brain Research.

[43]  Harry J. Wyatt,et al.  Smooth pursuit eye movements with imaginary targets defined by extrafoveal cues , 1994, Vision Research.

[44]  R. Carpenter,et al.  “Express” smooth pursuit , 1995, Vision Research.

[45]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[46]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[47]  Robert M. McPeek,et al.  What neural pathways mediate express saccades? , 1993, Behavioral and Brain Sciences.

[48]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[49]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[50]  Richard J Krauzlis,et al.  Neuronal Activity in the Rostral Superior Colliculus Related to the Initiation of Pursuit and Saccadic Eye Movements , 2003, The Journal of Neuroscience.

[51]  Ken Nakayama,et al.  Biological image motion processing: A review , 1985, Vision Research.

[52]  G. Rizzolatti,et al.  Effects of spatial attention on directional manual and ocular responses , 1997, Experimental Brain Research.

[53]  M. Saslow Effects of components of displacement-step stimuli upon latency for saccadic eye movement. , 1967, Journal of the Optical Society of America.

[54]  J H Maunsell,et al.  The Brain's Visual World: Representation of Visual Targets in Cerebral Cortex , 1995, Science.

[55]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[56]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[57]  Jean Lorenceau,et al.  Form constraints in motion binding , 2001, Nature Neuroscience.

[58]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[59]  F. Gosselin,et al.  Sigma smooth pursuit eye tracking: constant k values revisited , 2002, Experimental Brain Research.

[60]  Peter W Dicke,et al.  Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention , 2004, Nature Neuroscience.

[61]  F. A. Miles,et al.  Decreases in the Latency of Smooth Pursuit and Saccadic Eye Movements Produced by the “Gap Paradigm” in the Monkey , 1996, Vision Research.

[62]  Maggie Shiffrar,et al.  The influence of terminators on motion integration across space , 1992, Vision Research.

[63]  L S Stone,et al.  Motion coherence affects human perception and pursuit similarly , 2000, Visual Neuroscience.

[64]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[65]  P. Reuter-Lorenz,et al.  The reduction of saccadic latency by prior offset of the fixation point: An analysis of the gap effect , 1991, Perception & psychophysics.

[66]  Christopher D. Carello,et al.  Target selection and the superior colliculus: goals, choices and hypotheses , 2004, Vision Research.

[67]  P. Thier,et al.  Eye movements of rhesus monkeys directed towards imaginary targets , 1999, Vision Research.

[68]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. , 1988, Journal of neurophysiology.

[69]  Richard J Krauzlis,et al.  Pursuit of the ineffable: perceptual and motor reversals during the tracking of apparent motion. , 2003, Journal of Vision.

[70]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[71]  H. Hughes,et al.  Smooth pursuit of nonvisual motion. , 2006, Journal of neurophysiology.

[72]  R. Andersen,et al.  Intentional maps in posterior parietal cortex. , 2002, Annual review of neuroscience.

[73]  R. Wurtz,et al.  A Pathway in Primate Brain for Internal Monitoring of Movements , 2002, Science.

[74]  David J. Heeger,et al.  Neuronal correlates of perception in early visual cortex , 2003, Nature Neuroscience.

[75]  R. Remington Attention and saccadic eye movements. , 1980, Journal of experimental psychology. Human perception and performance.

[76]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[77]  Beatriz Luna,et al.  Eye movements in neurodevelopmental disorders , 2004, Current opinion in neurology.

[78]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[79]  C. Rashbass,et al.  The relationship between saccadic and smooth tracking eye movements , 1961, The Journal of physiology.

[80]  R. Krauzlis,et al.  Shared motion signals for human perceptual decisions and oculomotor actions. , 2003, Journal of vision.

[81]  R. Guillery,et al.  The thalamus as a monitor of motor outputs. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[82]  James R Müller,et al.  Microstimulation of the superior colliculus focuses attention without moving the eyes. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[83]  D. Gitelman,et al.  Covert Visual Spatial Orienting and Saccades: Overlapping Neural Systems , 2000, NeuroImage.

[84]  James J. Clark,et al.  Microsaccades as an overt measure of covert attention shifts , 2002, Vision Research.

[85]  S G Lisberger,et al.  Vector Averaging for Smooth Pursuit Eye Movements Initiated by Two Moving Targets in Monkeys , 1997, The Journal of Neuroscience.

[86]  Uwe J. Ilg,et al.  Cancellation of self-induced retinal image motion during smooth pursuit eye movements , 2001, Vision Research.

[87]  Harold E. Bedell,et al.  Attenuation of perceived motion smear during vergence and pursuit tracking , 2004, Vision Research.

[88]  B. Bridgeman,et al.  Immediate post-saccadic information mediates space constancy , 1998, Vision Research.

[89]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[90]  U. Ilg Slow eye movements , 1997, Progress in Neurobiology.

[91]  N. Logothetis,et al.  Activity changes in early visual cortex reflect monkeys' percepts during binocular rivalry , 1996, Nature.

[92]  Martha J. Farah,et al.  The Cognitive Neuroscience of Vision , 2000 .

[93]  David E. Irwin,et al.  The role of the saccade target object in the perception of a visually stable world , 2000, Perception & psychophysics.

[94]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. , 1988, Journal of neurophysiology.

[95]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[96]  Laurence R. Harris,et al.  Vision and Attention , 2001 .

[97]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[98]  Stephen G Lisberger,et al.  Directional Cuing of Target Choice in Human Smooth Pursuit Eye Movements , 2006, The Journal of Neuroscience.

[99]  Jacques Droulez,et al.  Self-motion and the perception of stationary objects , 2001, Nature.

[100]  Jenny J. Naji,et al.  Perceiving depth order during pursuit eye movement , 2004, Vision Research.

[101]  K. Nakayama,et al.  Two Distinct Visual Motion Mechanisms for Smooth Pursuit: Evidence from Individual Differences , 2007, Neuron.

[102]  Robert H. Wurtz,et al.  Subcortical Modulation of Attention Counters Change Blindness , 2004, The Journal of Neuroscience.

[103]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[104]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[105]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[106]  Anna Ma-Wyatt,et al.  Saccades actively maintain perceptual continuity , 2004, Nature Neuroscience.

[107]  Laurence R. Harris,et al.  Computational Vision in Neural and Machine Systems , 2007 .

[108]  John M. Findlay,et al.  Visual Attention: The Active Vision Perspective , 2001 .

[109]  Mark W Greenlee,et al.  Coherent motion pops out during smooth pursuit , 2002, Neuroreport.

[110]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[111]  Richard J Krauzlis,et al.  Primacy of spatial information in guiding target selection for pursuit and saccades. , 2002, Journal of vision.

[112]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[113]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[114]  S. Treue Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[115]  Martin J. Steinbach,et al.  Pursuing the perceptual rather than the retinal stimulus , 1976, Vision Research.

[116]  B. Fischer,et al.  Human express saccade makers are impaired at suppressing visually evoked saccades. , 1996, Journal of neurophysiology.

[117]  D. Burr,et al.  Saccadic suppression precedes visual motion analysis , 1999, Current Biology.

[118]  Activity in the Primate Rostral Superior Colliculus during the “Gap Effect” for Pursuit and Saccades , 2002, Annals of the New York Academy of Sciences.

[119]  M. Shiffrar,et al.  Different motion sensitive units are involved in recovering the direction of moving lines , 1993, Vision Research.

[120]  M. Goldberg,et al.  Spatial processing in the monkey frontal eye field. I. Predictive visual responses. , 1997, Journal of neurophysiology.

[121]  N. Logothetis,et al.  Multistable phenomena: changing views in perception , 1999, Trends in Cognitive Sciences.