Summation of Visual Motion across Eye Movements Reflects a Nonspatial Decision Mechanism

Human vision remains perceptually stable even though retinal inputs change rapidly with each eye movement. Although the neural basis of visual stability remains unknown, a recent psychophysical study pointed to the existence of visual feature-representations anchored in environmental rather than retinal coordinates (e.g., “spatiotopic” receptive fields; Melcher and Morrone, 2003). In that study, sensitivity to a moving stimulus presented after a saccadic eye movement was enhanced when preceded by another moving stimulus at the same spatial location before the saccade. The finding is consistent with spatiotopic sensory integration, but it could also have arisen from a probabilistic improvement in performance due to the presence of more than one motion signal for the perceptual decision. Here we show that this statistical advantage accounts completely for summation effects in this task. We first demonstrate that measurements of summation are confounded by noise related to an observer's uncertainty about motion onset times. When this uncertainty is minimized, comparable summation is observed regardless of whether two motion signals occupy the same or different locations in space, and whether they contain the same or opposite directions of motion. These results are incompatible with the tuning properties of motion-sensitive sensory neurons and provide no evidence for a spatiotopic representation of visual motion. Instead, summation in this context reflects a decision mechanism that uses abstract representations of sensory events to optimize choice behavior.

[1]  P. P. Battaglini,et al.  Parietal neurons encoding spatial locations in craniotopic coordinates , 2004, Experimental Brain Research.

[2]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[3]  C. Tyler,et al.  Signal detection theory in the 2AFC paradigm: attention, channel uncertainty and probability summation , 2000, Vision Research.

[4]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[5]  T. Albright Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[6]  T. Cohn,et al.  Detectability of a luminance increment: effect of spatial uncertainty. , 1974, Journal of the Optical Society of America.

[7]  P. Fraisse Perception and estimation of time. , 1984, Annual review of psychology.

[8]  David Melcher,et al.  Subthreshold features of visual objects: Unseen but not unbound , 2006, Vision Research.

[9]  Bradley J Wolfgang,et al.  Spatial uncertainty explains exogenous and endogenous attentional cuing effects in visual signal detection. , 2007, Journal of vision.

[10]  J. Douglas Crawford,et al.  Visual memory capacity in transsaccadic integration , 2007, Experimental Brain Research.

[11]  G. McConkie,et al.  Is visual information integrated across successive fixations in reading? , 1979, Perception & psychophysics.

[12]  J. O'Regan,et al.  Integrating visual information from successive fixations:Does trans-saccadic fusion exist? , 1983, Vision Research.

[13]  David E. Irwin,et al.  Visual masking and visual integration across saccadic eye movements. , 1988, Journal of experimental psychology. General.

[14]  D. Melcher,et al.  Implicit Attentional Selection of Bound Visual Features , 2005, Neuron.

[15]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[16]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  R. M. Siegel,et al.  Maps of Visual Space in Human Occipital Cortex Are Retinotopic, Not Spatiotopic , 2008, The Journal of Neuroscience.

[18]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[19]  Jeff Miller The sampling distribution ofd′ , 1996 .

[20]  S J Luck,et al.  Mechanisms of visual-spatial attention: resource allocation or uncertainty reduction? , 1996, Journal of experimental psychology. Human perception and performance.

[21]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[22]  A. Watson Probability summation over time , 1979, Vision Research.

[23]  David Alais,et al.  No direction-specific bimodal facilitation for audiovisual motion detection. , 2004, Brain research. Cognitive brain research.

[24]  David Melcher,et al.  The role of attention in central and peripheral motion integration , 2004, Vision Research.

[25]  T. Meese,et al.  Broad direction bandwidths for complex motion mechanisms , 2001, Vision Research.

[26]  C. W. G Clifford,et al.  Fundamental mechanisms of visual motion detection: models, cells and functions , 2002, Progress in Neurobiology.

[27]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[28]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[29]  B. Bridgeman,et al.  Failure to integrate visual information from successive fixations , 1983 .

[30]  D. Burr,et al.  Spatiotopic selectivity of BOLD responses to visual motion in human area MT , 2007, Nature Neuroscience.

[31]  D. Melcher Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[32]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[33]  J. Crawford,et al.  Transsaccadic integration of visual features in a line intersection task , 2006, Experimental Brain Research.

[34]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[35]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[36]  Frank Bremmer,et al.  Neural Correlates of Visual Localization and Perisaccadic Mislocalization , 2003, Neuron.

[37]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[38]  D. Burr,et al.  Two stages of visual processing for radial and circular motion , 1995, Nature.

[39]  J. Miller,et al.  The sampling distribution of d'. , 1996, Perception & psychophysics.

[40]  William Prinzmetal,et al.  The Phenomenology of Attention , 1997, Consciousness and Cognition.

[41]  S. Luck,et al.  What variety of attention is automatically captured by peripheral cues? , 1999, Perception & psychophysics.

[42]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[43]  D. Burr,et al.  Temporal integration of optic flow, measured by contrast and coherence thresholds , 2001, Vision Research.

[44]  C. Genovese,et al.  Spatial Updating in Human Parietal Cortex , 2003, Neuron.

[45]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[46]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[47]  M. Shadlen,et al.  Representation of Time by Neurons in the Posterior Parietal Cortex of the Macaque , 2003, Neuron.

[48]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[49]  T. Meese,et al.  Probability summation for multiple patches of luminance modulation , 2000, Vision Research.

[50]  J Carpenter,et al.  Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. , 2000, Statistics in medicine.

[51]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[52]  T Cohn,et al.  Detection of a luminance increment: effect of temporal uncertainty. , 1981, Journal of the Optical Society of America.

[53]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[54]  H. Pashler,et al.  Negligible Effect of Spatial Precuing on Identification of Single Digits , 1994 .