Shared Sensory Estimates for Human Motion Perception and Pursuit Eye Movements

Are sensory estimates formed centrally in the brain and then shared between perceptual and motor pathways or is centrally represented sensory activity decoded independently to drive awareness and action? Questions about the brain's information flow pose a challenge because systems-level estimates of environmental signals are only accessible indirectly as behavior. Assessing whether sensory estimates are shared between perceptual and motor circuits requires comparing perceptual reports with motor behavior arising from the same sensory activity. Extrastriate visual cortex both mediates the perception of visual motion and provides the visual inputs for behaviors such as smooth pursuit eye movements. Pursuit has been a valuable testing ground for theories of sensory information processing because the neural circuits and physiological response properties of motion-responsive cortical areas are well studied, sensory estimates of visual motion signals are formed quickly, and the initiation of pursuit is closely coupled to sensory estimates of target motion. Here, we analyzed variability in visually driven smooth pursuit and perceptual reports of target direction and speed in human subjects while we manipulated the signal-to-noise level of motion estimates. Comparable levels of variability throughout viewing time and across conditions provide evidence for shared noise sources in the perception and action pathways arising from a common sensory estimate. We found that conditions that create poor, low-gain pursuit create a discrepancy between the precision of perception and that of pursuit. Differences in pursuit gain arising from differences in optic flow strength in the stimulus reconcile much of the controversy on this topic.

[1]  C. Rashbass,et al.  The relationship between saccadic and smooth tracking eye movements , 1961, The Journal of physiology.

[2]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[3]  Harris R. Lieberman,et al.  Computation of psychophysical thresholds using the probit technique , 1983 .

[4]  S. McKee,et al.  The detection of motion in the peripheral visual field , 1984, Vision Research.

[5]  Robert Sekuler,et al.  Coherent global motion percepts from stochastic local motions , 1984, Vision Research.

[6]  W. Newsome,et al.  Deficits in visual motion processing following ibotenic acid lesions of the middle temporal visual area of the macaque monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  S. McKee,et al.  Statistical properties of forced-choice psychometric functions: Implications of probit analysis , 1985, Perception & psychophysics.

[8]  S. Lisberger,et al.  Properties of visual inputs that initiate horizontal smooth pursuit eye movements in monkeys , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  S G Lisberger,et al.  Visual motion processing for the initiation of smooth-pursuit eye movements in humans. , 1986, Journal of neurophysiology.

[10]  Eileen Kowler,et al.  Sensitivity of smooth eye movement to small differences in target velocity , 1987, Vision Research.

[11]  E. J. Morris,et al.  Visual motion processing and sensory-motor integration for smooth pursuit eye movements. , 1987, Annual review of neuroscience.

[12]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. , 1988, Journal of neurophysiology.

[13]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. , 1988, Journal of neurophysiology.

[14]  G. Orban,et al.  Human velocity and direction discrimination measured with random dot patterns , 1988, Vision Research.

[15]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Scott N. J. Watamaniuk,et al.  Direction Perception in Complex Dynamic Displays: the Integration of Dir~~tion Information , 1988 .

[17]  H. Komatsu,et al.  Modulation of pursuit eye movements by stimulation of cortical areas MT and MST. , 1989, Journal of neurophysiology.

[18]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[19]  Andrew P. Duchon,et al.  The human visual system averages speed information , 1992, Vision Research.

[20]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[21]  S G Lisberger,et al.  Temporal properties of visual motion signals for the initiation of smooth pursuit eye movements in monkeys. , 1994, Journal of neurophysiology.

[22]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[23]  M. Goodale,et al.  The visual brain in action , 1995 .

[24]  L F Abbott,et al.  Transfer of coded information from sensory to motor networks , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[27]  W T Newsome,et al.  How Is a Sensory Map Read Out? Effects of Microstimulation in Visual Area MT on Saccades and Smooth Pursuit Eye Movements , 1997, The Journal of Neuroscience.

[28]  S. Watamaniuk,et al.  Spatial integration in human smooth pursuit , 1998, Vision Research.

[29]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[30]  Stephen J Heinen,et al.  Human smooth pursuit direction discrimination , 1999, Vision Research.

[31]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[32]  Maninder K. Kahlon,et al.  Visual Motion Analysis for Pursuit Eye Movements in Area MT of Macaque Monkeys , 1999, The Journal of Neuroscience.

[33]  Paul R. Schrater,et al.  Mechanisms of visual motion detection , 2000, Nature Neuroscience.

[34]  R. Born,et al.  Segregation of Object and Background Motion in Visual Area MT Effects of Microstimulation on Eye Movements , 2000, Neuron.

[35]  S G Lisberger,et al.  Shifts in the Population Response in the Middle Temporal Visual Area Parallel Perceptual and Motor Illusions Produced by Apparent Motion , 2001, The Journal of Neuroscience.

[36]  Prrmon Pms LIii,et al.  FACTORS INFLUENCING VELOCITY CODING IN THE HUMAN VISUAL SYSTEM , 2002 .

[37]  Emad N Eskandar,et al.  Parietal activity and the perceived direction of ambiguous apparent motion , 2003, Nature Neuroscience.

[38]  Brian H Scott,et al.  A comparison of pursuit eye movement and perceptual performance in speed discrimination. , 2003, Journal of vision.

[39]  Jing Liu,et al.  Functional organization of speed tuned neurons in visual area MT. , 2003, Journal of neurophysiology.

[40]  R. Krauzlis,et al.  Shared motion signals for human perceptual decisions and oculomotor actions. , 2003, Journal of vision.

[41]  Nicholas J. Priebe,et al.  The Neural Representation of Speed in Macaque Area MT/V5 , 2003, The Journal of Neuroscience.

[42]  W. Bialek,et al.  Time Course of Information about Motion Direction in Visual Area MT of Macaque Monkeys , 2004, The Journal of Neuroscience.

[43]  R. Krauzlis Recasting the smooth pursuit eye movement system. , 2004, Journal of neurophysiology.

[44]  G. DeAngelis,et al.  A Logarithmic, Scale-Invariant Representation of Speed in Macaque Middle Temporal Area Accounts for Speed Discrimination Performance , 2005, The Journal of Neuroscience.

[45]  Leland S. Stone,et al.  Expansion of Direction Space around the Cardinal Axes Revealed by Smooth Pursuit Eye Movements , 2005, Neuron.

[46]  W. Newsome,et al.  Correlation between Speed Perception and Neural Activity in the Middle Temporal Visual Area , 2005, The Journal of Neuroscience.

[47]  W. Bialek,et al.  A sensory source for motor variation , 2005, Nature.

[48]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[49]  S. Lisberger,et al.  Variation, Signal, and Noise in Cerebellar Sensory–Motor Processing for Smooth-Pursuit Eye Movements , 2007, The Journal of Neuroscience.

[50]  R. J. van Beers,et al.  The Sources of Variability in Saccadic Eye Movements , 2007, The Journal of Neuroscience.

[51]  William Bialek,et al.  Time Course of Precision in Smooth-Pursuit Eye Movements of Monkeys , 2007, The Journal of Neuroscience.

[52]  P. Thier,et al.  The neural basis of smooth pursuit eye movements in the rhesus monkey brain , 2008, Brain and Cognition.

[53]  W. Bialek,et al.  The Neural Basis for Combinatorial Coding in a Cortical Population Response , 2008, The Journal of Neuroscience.

[54]  L. Stone,et al.  Effects of Prior Information and Reward on Oculomotor and Perceptual Choices , 2008, The Journal of Neuroscience.

[55]  Y. Nakayama,et al.  The history of JOV of 10 years , 2008, J. Vis..

[56]  Karl R. Gegenfurtner,et al.  Precision of speed discrimination and smooth pursuit eye movements , 2009, Vision Research.

[57]  M. Mustari,et al.  Signal Processing and Distribution in Cortical‐Brainstem Pathways for Smooth Pursuit Eye Movements , 2009, Annals of the New York Academy of Sciences.

[58]  Stephen G Lisberger,et al.  Spatial and temporal integration of visual motion signals for smooth pursuit eye movements in monkeys. , 2009, Journal of neurophysiology.

[59]  Xin Huang,et al.  Noise correlations in cortical area MT and their potential impact on trial-by-trial variation in the direction and speed of smooth-pursuit eye movements. , 2009, Journal of neurophysiology.

[60]  Erik Blaser,et al.  Object-based cross-attribute attentional effects in bivectorial motion , 2010 .

[61]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[62]  Jennifer L. Raymond,et al.  Motor Learning Reduces Eye Movement Variability through Reweighting of Sensory Inputs , 2010, The Journal of Neuroscience.

[63]  Visual pop-out in infancy: Effects of set-size on the latency of their eye movements , 2010 .

[64]  Stephen G Lisberger,et al.  Visual Guidance of Smooth-Pursuit Eye Movements: Sensation, Action, and What Happens in Between , 2010, Neuron.

[65]  Leslie C Osborne,et al.  Computation and physiology of sensory-motor processing in eye movements , 2011, Current Opinion in Neurobiology.

[66]  Alexander C. Schütz,et al.  Eye movements and perception: a selective review. , 2011, Journal of vision.

[67]  William Bialek,et al.  Searching for simplicity in the analysis of neurons and behavior , 2010, Proceedings of the National Academy of Sciences.

[68]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[69]  M. Goodale,et al.  Converging evidence for diverging pathways: Neuropsychology and psychophysics tell the same story , 2011, Vision Research.

[70]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[71]  K. Gegenfurtner,et al.  Recent advances in perception and action , 2011, Vision Research.

[72]  Timothy Ledgeway,et al.  Neural Computations Governing Spatiotemporal Pooling of Visual Motion Signals in Humans , 2011, The Journal of Neuroscience.

[73]  A. Montagnini,et al.  Do we track what we see? Common versus independent processing for motion perception and smooth pursuit eye movements: A review , 2011, Vision Research.

[74]  R. McPeek,et al.  The eye dominates in guiding attention during simultaneous eye and hand movements. , 2011, Journal of vision.

[75]  Guillaume S Masson,et al.  Motion clouds: model-based stimulus synthesis of natural-like random textures for the study of motion perception. , 2012, Journal of neurophysiology.

[76]  Stephen G Lisberger,et al.  Role of the Lateral Intraparietal Area in Modulation of the Strength of Sensory-Motor Transmission for Visually Guided Movements , 2012, The Journal of Neuroscience.

[77]  Naoshige Uchida,et al.  Odor Representations in Olfactory Cortex: Distributed Rate Coding and Decorrelated Population Activity , 2012, Neuron.

[78]  Pascal Mamassian,et al.  More is not always better: adaptive gain control explains dissociation between perception and action , 2012, Nature Neuroscience.

[79]  Stephen G. Lisberger,et al.  Sensory Population Decoding for Visually Guided Movements , 2013, Neuron.

[80]  Stephen G Lisberger,et al.  A framework for using signal, noise, and variation to determine whether the brain controls movement synergies or single muscles. , 2014, Journal of neurophysiology.