Constructing Stable Spatial Maps of the Word

To interact rapidly and effectively with our environment, our brain needs access to a neural representation—or map—of the spatial layout of the external world. However, the construction of such a map poses major challenges to the visual system, given that the images on our retinae depend on where the eyes are looking, and shift each time we move our eyes, head, and body to explore the world. Much research has been devoted to how the stability is achieved, with the debate often polarized between the utility of spatiotopic maps (that remain solid in external coordinates), as opposed to transiently updated retinotopic maps. Our research suggests that the visual system uses both strategies to maintain stability. f MRI, motion-adaptation, and saccade-adaptation studies demonstrate and characterize spatiotopic neural maps within the dorsal visual stream that remain solid in external rather than retinal coordinates. However, the construction of these maps takes time (up to 500 ms) and attentional resources. To solve the immediate problems created by individual saccades, we postulate the existence of a separate system to bridge each saccade with neural units that are ‘transiently craniotopic’. These units prepare for the effects of saccades with a shift of their receptive fields before the saccade starts, then relaxing back into their standard position during the saccade, compensating for its action. Psychophysical studies investigating localization of stimuli flashed briefly around the time of saccades provide strong support for these neural mechanisms, and show quantitatively how they integrate information across saccades. This transient system cooperates with the spatiotopic mechanism to provide a useful map to guide interactions with our environment: one rapid and transitory, bringing into play the high-resolution visual areas; the other slow, long-lasting, and low-resolution, useful for interacting with the world.

[1]  R. M. Siegel,et al.  Maps of Visual Space in Human Occipital Cortex Are Retinotopic, Not Spatiotopic , 2008, The Journal of Neuroscience.

[2]  P. Wenderoth,et al.  Retinotopic encoding of the direction aftereffect , 2008, Vision Research.

[3]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[4]  R. Krauzlis The Control of Voluntary Eye Movements: New Perspectives , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[5]  R. Sperry Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[6]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[7]  Alexander C. Schütz,et al.  Dynamic integration of information about salience and value for saccadic eye movements , 2012, Proceedings of the National Academy of Sciences.

[8]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[9]  Maria Concetta Morrone,et al.  Spatiotemporal dynamics of perisaccadic remapping in humans revealed by classification images. , 2012, Journal of vision.

[10]  P. Cavanagh,et al.  Looking ahead: the perceived direction of gaze shifts before the eyes move. , 2009, Journal of vision.

[11]  Thomas Wachtler,et al.  Perceptual evidence for saccadic updating of color stimuli. , 2008, Journal of vision.

[12]  E. Zohary,et al.  Rapid Formation of Spatiotopic Representations As Revealed by Inhibition of Return , 2010, The Journal of Neuroscience.

[13]  D. Burr,et al.  A Visual Sense of Number , 2007, Current Biology.

[14]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[15]  B. Bridgeman,et al.  Immediate post-saccadic information mediates space constancy , 1998, Vision Research.

[16]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[17]  D. Levi,et al.  Receptive versus perceptive fields from the reverse-correlation viewpoint , 2006, Vision Research.

[18]  David Burr,et al.  Time Perception: Space–Time in the Brain , 2006, Current Biology.

[19]  I. Donaldson,et al.  The functions of the proprioceptors of the eye muscles. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  Patrick Cavanagh,et al.  The reference frame of the motion aftereffect is retinotopic. , 2009, Journal of vision.

[21]  C. Sherrington OBSERVATIONS ON THE SENSUAL RÔLE OF THE PROPRIOCEPTIVE NERVE-SUPPLY OF THE EXTRINSIC OCULAR MUSCLES , 1918 .

[22]  K. Verfaillie,et al.  Parametric integration of visual form across saccades , 2010, Vision Research.

[23]  Raymond Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[24]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[25]  D. Burr,et al.  Saccades compress space, time and number , 2010, Trends in Cognitive Sciences.

[26]  Avishai Henik,et al.  Attending to the thalamus: inhibition of return and nasal‐temporal asymmetry in the pulvinar , 2002, Neuroreport.

[27]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[28]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[29]  Donald M. MacKay,et al.  Visual Stability and Voluntary Eye Movements , 1973 .

[30]  Derek H. Arnold,et al.  Spatially Localized Distortions of Event Time , 2006, Current Biology.

[31]  P Thompson,et al.  Motion psychophysics. , 1993, Reviews of oculomotor research.

[32]  J. Bisley,et al.  Psychophysical evidence for spatiotopic processing in area MT in a short-term memory for motion task. , 2009, Journal of neurophysiology.

[33]  Markus Lappe,et al.  Eye Position Effects in Oculomotor Plasticity and Visual Localization , 2011, The Journal of Neuroscience.

[34]  I. Howard Alhazen's Neglected Discoveries of Visual Phenomena , 1996, Perception.

[35]  P. P. Battaglini,et al.  Parietal neurons encoding spatial locations in craniotopic coordinates , 2004, Experimental Brain Research.

[36]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[37]  Maria Concetta Morrone,et al.  Spatiotopic coding and remapping in humans , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  Vincent Walsh A theory of magnitude: common cortical metrics of time, space and quantity , 2003, Trends in Cognitive Sciences.

[39]  Maria Concetta Morrone,et al.  Spatiotopic Visual Maps Revealed by Saccadic Adaptation in Humans , 2011, Current Biology.

[40]  Guido Marco Cicchini,et al.  Spatiotemporal Distortions of Visual Perception at the Time of Saccades , 2009, The Journal of Neuroscience.

[41]  Maria Concetta Morrone,et al.  "Non-retinotopic processing" in Ternus motion displays modeled by spatiotemporal filters. , 2012, Journal of vision.

[42]  M Concetta Morrone,et al.  Neural mechanisms for timing visual events are spatially selective in real-world coordinates , 2007, Nature Neuroscience.

[43]  Mingsha Zhang,et al.  The proprioceptive representation of eye position in monkey primary somatosensory cortex , 2007, Nature Neuroscience.

[44]  Joseph Krummenacher,et al.  A (fascinating) litmus test for human retino- vs. non-retinotopic processing. , 2009, Journal of vision.

[45]  John Ross,et al.  Visual processing of motion , 1986, Trends in Neurosciences.

[46]  A Pooresmaeili,et al.  'Non-retinotopic processing' in Ternus motion displays modelled by spatiotemporal filters , 2010 .

[47]  L E Mays,et al.  Saccades are spatially, not retinocentrically, coded. , 1980, Science.

[48]  Markus Lappe,et al.  Effect of saccadic adaptation on localization of visual targets. , 2005, Journal of neurophysiology.

[49]  Trafton Drew,et al.  Remapping attention in multiple object tracking , 2011, Vision Research.

[50]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[51]  Miguel P Eckstein,et al.  Classification images: a tool to analyze visual strategies. , 2002, Journal of vision.

[52]  Martin S Banks,et al.  Limits of stereopsis explained by local cross-correlation. , 2009, Journal of vision.

[53]  R. Snowden,et al.  Shifts in perceived position following adaptation to visual motion , 1998, Current Biology.

[54]  D. Burr,et al.  Spatiotopic selectivity of BOLD responses to visual motion in human area MT , 2007, Nature Neuroscience.

[55]  Ehud Zohary,et al.  Multiple Reference Frames for Saccadic Planning in the Human Parietal Cortex , 2011, The Journal of Neuroscience.

[56]  David C. Burr,et al.  Spatiotopic Coding of BOLD Signal in Human Visual Cortex Depends on Spatial Attention , 2011, PloS one.

[57]  J. Wagemans Towards a new kind of experimental psycho-aesthetics? Reflections on the Parallellepipeda project , 2011, i-Perception.

[58]  Roberto Arrighi,et al.  Spatiotopic selectivity of adaptation-based compression of event duration. , 2011, Journal of vision.

[59]  M. Lappe,et al.  Eye position effects in saccadic adaptation in macaque monkeys. , 2012, Journal of neurophysiology.

[60]  R. Wurtz,et al.  A Pathway in Primate Brain for Internal Monitoring of Movements , 2002, Science.

[61]  Shin'ya Nishida,et al.  Influence of motion signals on the perceived position of spatial pattern , 1999, Nature.

[62]  H. Honda Perceptual localization of visual stimuli flashed during saccades , 1989, Perception & psychophysics.

[63]  David C. Burr,et al.  Compression of visual space before saccades , 1997, Nature.

[64]  Julie D. Golomb,et al.  The Native Coordinate System of Spatial Attention Is Retinotopic , 2008, The Journal of Neuroscience.

[65]  D. Burr,et al.  Seeing objects in motion , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[66]  David Burr,et al.  Spatiotopic perceptual maps in humans: evidence from motion adaptation , 2012, Proceedings of the Royal Society B: Biological Sciences.

[67]  M. Lappe,et al.  Motor signals in visual localization. , 2010, Journal of vision.

[68]  Michael F Land,et al.  The Operation of the Visual System in Relation to Action , 2012, Current Biology.

[69]  R. Addams LI. An account of a peculiar optical phænomenon seen after having looked at a moving body , 1834 .

[70]  Simona Celebrini,et al.  Privileged Processing of the Straight-Ahead Direction in Primate Area V1 , 2010, Neuron.

[71]  D. Burr,et al.  Motion psychophysics: 1985–2010 , 2011, Vision Research.

[72]  H. Barlow,et al.  The mechanical mind. , 1990, Annual review of neuroscience.

[73]  Reza Shadmehr,et al.  Changes in Control of Saccades during Gain Adaptation , 2008, The Journal of Neuroscience.