Temporally flexible feedback signal to foveal cortex for peripheral object recognition

Significance When subjects were asked to discriminate objects in the periphery, foveal visual noise presented at precise time windows following the peripheral object onset disrupted their performance. Further, this effect of foveal noise depends on task demand and stimulus features and primarily occurs for object tasks that involve spatial details. The time window, during which the noise is effective, can be shifted based on the amount of preprocessing of the peripheral objects, revealing the operation of temporally flexible feedback processing in the foveal cortex for peripheral object recognition. Recent studies have shown that information from peripherally presented images is present in the human foveal retinotopic cortex, presumably because of feedback signals. We investigated this potential feedback signal by presenting noise in fovea at different object–noise stimulus onset asynchronies (SOAs), whereas subjects performed a discrimination task on peripheral objects. Results revealed a selective impairment of performance when foveal noise was presented at 250-ms SOA, but only for tasks that required comparing objects’ spatial details, suggesting a task- and stimulus-dependent foveal processing mechanism. Critically, the temporal window of foveal processing was shifted when mental rotation was required for the peripheral objects, indicating that the foveal retinotopic processing is not automatically engaged at a fixed time following peripheral stimulation; rather, it occurs at a stage when detailed information is required. Moreover, fMRI measurements using multivoxel pattern analysis showed that both image and object category-relevant information of peripheral objects was represented in the foveal cortex. Taken together, our results support the hypothesis of a temporally flexible feedback signal to the foveal retinotopic cortex when discriminating objects in the visual periphery.

[1]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[2]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[3]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[4]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[5]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[6]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[7]  R Klein,et al.  Covert visual orienting: hemifield-activation can be mimicked by zoom lens and midlocation placement strategies. , 1989, Acta psychologica.

[8]  R. Shepard,et al.  The time required to prepare for a rotated stimulus , 1973, Memory & cognition.

[9]  I. M. Harris,et al.  Selective right parietal lobe activation during mental rotation: a parametric PET study. , 2000, Brain : a journal of neurology.

[10]  J. Hochberg,et al.  The effect of landmark features on mental rotation times , 1977, Memory & cognition.

[11]  Peter Andersen,et al.  Mental Rotation Studied by Functional Magnetic Resonance Imaging at High Field (4 Tesla): Performance and Cortical Activation , 1997, Journal of Cognitive Neuroscience.

[12]  Robert O. Duncan,et al.  Cortical Magnification within Human Primary Visual Cortex Correlates with Acuity Thresholds , 2003, Neuron.

[13]  Carlo Miniussi,et al.  Parietal Lobe Contribution to Mental Rotation Demonstrated with rTMS , 2003, Journal of Cognitive Neuroscience.

[14]  S. Hochstein,et al.  Reverse hierarchies and sensory learning , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  D. Melcher Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[16]  Won Mok Shim,et al.  Modulating foveal representation can influence visual discrimination in the periphery. , 2016, Journal of vision.

[17]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[18]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Ha Hong,et al.  Explicit information for category-orthogonal object properties increases along the ventral stream , 2016, Nature Neuroscience.

[20]  N. Kanwisher,et al.  Feedback of pVisual Object Information to Foveal Retinotopic Cortex , 2008, Nature Neuroscience.

[21]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[22]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[23]  R. L. Valois,et al.  Temporal dynamics of chromatic tuning in macaque primary visual cortex , 1998, Nature.

[24]  Anina N. Rich,et al.  Disruption of Foveal Space Impairs Discrimination of Peripheral Objects , 2016, Front. Psychol..

[25]  S. Hochstein,et al.  The reverse hierarchy theory of visual perceptual learning , 2004, Trends in Cognitive Sciences.

[26]  Nilli Lavie,et al.  Look here but ignore what you see: effects of distractors at fixation. , 2005, Journal of experimental psychology. Human perception and performance.

[27]  L. Cooper Mental rotation of random two-dimensional shapes , 1975, Cognitive Psychology.

[28]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[29]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[30]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[31]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[32]  S. Hillyard,et al.  Involvement of striate and extrastriate visual cortical areas in spatial attention , 1999, Nature Neuroscience.

[33]  Christopher D. Chambers,et al.  Is delayed foveal feedback critical for extra-foveal perception? , 2013, Cortex.