Invariant Temporal Dynamics Underlie Perceptual Stability in Human Visual Cortex

An inherent limitation of human visual system research stems from its reliance on highly controlled laboratory conditions. Visual processing in the real world differs substantially from such controlled conditions. In particular, during natural vision, we continuously sample the dynamic environment by variable eye movements that lead to inherent instability of the optical image. The neuronal mechanism by which human perception remains stable under these natural conditions remains unknown. Here, we examined a neural mechanism that may contribute to such stability, i.e., the extent to which neuronal responses remain invariant to oculomotor parameters and viewing conditions. To this end, we introduce an experimental paradigm in which intracranial brain activity, a video of the real-life visual scene, and free oculomotor behavior were simultaneously recorded in human patients. Our results reveal, in high-order visual areas, a remarkable level of neural invariance to the length of eye fixations and lack of evidence for a saccade-related neuronal signature. Thus, neuronal responses, while showing high selectivity to the category of visual images, manifested stable "iconic" dynamics. This property of invariance to fixation onset and duration emerged only in high-order visual representations. In early visual cortex, the fixation onset was accompanied with suppressive neural signal, and duration of neuronal responses was largely determined by the fixation times. These results uncover unique neuronal dynamics in high-order ventral stream visual areas that could play an important role in achieving perceptual stability, despite the drastic changes introduced by oculomotor behavior in real life.

[1]  Philippe Kahane,et al.  Functional selectivity in the human occipitotemporal cortex during natural vision: Evidence from combined intracranial EEG and eye-tracking , 2014, NeuroImage.

[2]  Mohammad Dastjerdi,et al.  Numerical processing in the human parietal cortex during experimental and natural conditions , 2013, Nature Communications.

[3]  R. Shapley,et al.  LFP power spectra in V1 cortex: the graded effect of stimulus contrast. , 2005, Journal of neurophysiology.

[4]  Adrian G Bondy,et al.  Saccadic modulation of stimulus processing in primary visual cortex , 2015, Nature Communications.

[5]  I. Fried,et al.  Neural “Ignition”: Enhanced Activation Linked to Perceptual Awareness in Human Ventral Stream Visual Cortex , 2009, Neuron.

[6]  Doris Y. Tsao,et al.  Faces and objects in macaque cerebral cortex , 2003, Nature Neuroscience.

[7]  David A. Leopold,et al.  Functional MRI mapping of dynamic visual features during natural viewing in the macaque , 2015, NeuroImage.

[8]  Sean P. MacEvoy,et al.  Macaque V1 activity during natural vision: effects of natural scenes and saccades. , 2008, Journal of neurophysiology.

[9]  I. Fried,et al.  Coupling between Neuronal Firing Rate, Gamma LFP, and BOLD fMRI Is Related to Interneuronal Correlations , 2007, Current Biology.

[10]  C. E. Schroeder,et al.  Ignition’s glow: Ultra-fast spread of global cortical activity accompanying local “ignitions” in visual cortex during conscious visual perception , 2015, Consciousness and Cognition.

[11]  Mariano Sigman,et al.  Looking for a face in the crowd: Fixation-related potentials in an eye-movement visual search task , 2014, NeuroImage.

[12]  R. Quiroga,et al.  Human single-neuron responses at the threshold of conscious recognition , 2008, Proceedings of the National Academy of Sciences.

[13]  Rafael Malach,et al.  Spontaneous Fluctuations and Non-linear Ignitions: Two Dynamic Faces of Cortical Recurrent Loops , 2015, Neuron.

[14]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[15]  Biyu J. He Spontaneous and Task-Evoked Brain Activity Negatively Interact , 2013, The Journal of Neuroscience.

[16]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[17]  D Hermes,et al.  Stimulus Dependence of Gamma Oscillations in Human Visual Cortex. , 2015, Cerebral cortex.

[18]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[19]  E. Niebur,et al.  Neural Correlates of High-Gamma Oscillations (60–200 Hz) in Macaque Local Field Potentials and Their Potential Implications in Electrocorticography , 2008, The Journal of Neuroscience.

[20]  J. Haxby,et al.  Neural systems for recognition of familiar faces , 2007, Neuropsychologia.

[21]  Roel M. Willems,et al.  Cerebral lateralization of face-selective and body-selective visual areas depends on handedness. , 2010, Cerebral cortex.

[22]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[23]  Katsumi Aoki,et al.  Flying characteristics of the new official rubber baseball , 2009, J. Vis..

[24]  P. Bex,et al.  Peri-Saccadic Natural Vision , 2013, The Journal of Neuroscience.

[25]  C. Genovese,et al.  Remapping in human visual cortex. , 2007, Journal of neurophysiology.

[26]  David M. Groppe,et al.  Exemplar selectivity reflects perceptual similarities in the human fusiform cortex. , 2014, Cerebral cortex.

[27]  D. Mackay Visual stability. , 1972, Investigative ophthalmology.

[28]  G. Karmos,et al.  Transient cortical excitation at the onset of visual fixation. , 2008, Cerebral cortex.

[29]  V. Rangarajan,et al.  Functional asymmetry between the left and right human fusiform gyrus explored through electrical brain stimulation , 2016, Neuropsychologia.

[30]  Michael A Paradiso,et al.  Macaque V1 representations in natural and reduced visual contexts: spatial and temporal properties and influence of saccadic eye movements. , 2012, Journal of neurophysiology.

[31]  T. Hendler,et al.  Contrast sensitivity in human visual areas and its relationship to object recognition. , 2002, Journal of neurophysiology.

[32]  T. Gawne,et al.  Responses of primate visual cortical neurons to stimuli presented by flash, saccade, blink, and external darkening. , 2002, Journal of neurophysiology.

[33]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[34]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[35]  Brian E. Russ,et al.  Single-Unit Activity during Natural Vision: Diversity, Consistency, and Spatial Sensitivity among AF Face Patch Neurons , 2015, The Journal of Neuroscience.

[36]  Philippe Kahane,et al.  Efficient “Pop-Out” Visual Search Elicits Sustained Broadband Gamma Activity in the Dorsal Attention Network , 2012, The Journal of Neuroscience.

[37]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[38]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[39]  Mariano Sigman,et al.  Fixation-related potentials in visual search: a combined EEG and eye tracking study. , 2012, Journal of vision.

[40]  D. Snodderly,et al.  Response Variability of Neurons in Primary Visual Cortex (V1) of Alert Monkeys , 1997, The Journal of Neuroscience.