Alpha-frequency feedback to early visual cortex orchestrates coherent natural vision

For coherent visual experience to emerge, the brain needs to spatially integrate the complex and dynamic information it receives from the environment. To meet this challenge, the visual system uses contextual information from one part of the visual field to create feedback signals that guide analysis in other parts of the visual field. Here, we set out to characterize the nature of this feedback across brain rhythms and cortical regions. In EEG and fMRI experiments, we experimentally recreated the spatially distributed nature of visual inputs by presenting natural videos at different visual field locations. Critically, we manipulated the spatiotemporal congruency of the videos, so that they did or did not demand integration into a coherent percept. Decoding stimulus information from frequency-specific EEG patterns revealed a shift from representations in feedforward-related gamma activity for spatiotemporally inconsistent videos to representations in feedback-related alpha activity for spatiotemporally consistent videos. Our fMRI data suggest high-level scene-selective areas as the putative source of this feedback. Combining the EEG data with spatially resolved fMRI recordings, we demonstrate that alpha-frequency feedback is directly associated with representations in early visual cortex. Together this demonstrates how the human brain orchestrates coherent visual experience across space: it uses feedback to integrate information from high-level to early visual cortex through a dedicated rhythmic code in the alpha frequency range.

[1]  Qing Yu,et al.  Spatiotemporal dynamics of self-generated imagery reveal a reverse cortical hierarchy from cue-induced imagery , 2023, bioRxiv.

[2]  P. Roelfsema,et al.  Contextual drive of neuronal responses in mouse V1 in the absence of feedforward input , 2023, Science advances.

[3]  John A. Pyles,et al.  Improving the accuracy of single-trial fMRI response estimates using GLMsingle , 2022, eLife.

[4]  Radoslaw Martin Cichy,et al.  Parts and Wholes in Scene Processing , 2021, Journal of Cognitive Neuroscience.

[5]  Radoslaw Martin Cichy,et al.  Semantic scene-object consistency modulates N300/400 EEG components, but does not automatically facilitate object representations , 2021 .

[6]  A. Lingnau,et al.  Decoding category and familiarity information during visual imagery , 2021, NeuroImage.

[7]  Grace W. Lindsay Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future , 2020, Journal of Cognitive Neuroscience.

[8]  Aude Oliva,et al.  A M/EEG-fMRI Fusion Primer: Resolving Human Brain Responses in Space and Time , 2020, Neuron.

[9]  Matthew A. Bennett,et al.  Decoding Natural Sounds in Early “Visual” Cortex of Congenitally Blind Individuals , 2020, Current Biology.

[10]  Radoslaw Martin Cichy,et al.  Visual Imagery and Perception Share Neural Representations in the Alpha Frequency Band , 2020, Current Biology.

[11]  Morgane M. Roth,et al.  Feedback Generates a Second Receptive Field in Neurons of Visual Cortex , 2020, Nature.

[12]  Gabriel Kreiman,et al.  Beyond the feedforward sweep: feedback computations in the visual cortex , 2020, Annals of the New York Academy of Sciences.

[13]  Ayan S. Waite,et al.  Layer and rhythm specificity for predictive routing , 2020, Proceedings of the National Academy of Sciences.

[14]  Rainer Goebel,et al.  A Probabilistic Functional Atlas of Human Occipito-Temporal Visual Cortex , 2020, bioRxiv.

[15]  Christian N. L. Olivers,et al.  Oscillatory Control over Representational States in Working Memory , 2019, Trends in Cognitive Sciences.

[16]  Russell A. Epstein,et al.  Scene Perception in the Human Brain. , 2019, Annual review of vision science.

[17]  Merim Bilalić,et al.  Parsing rooms: the role of the PPA and RSC in perceiving object relations and spatial layout , 2019, Brain Structure and Function.

[18]  Radoslaw Martin Cichy,et al.  Cortical sensitivity to natural scene structure , 2019, bioRxiv.

[19]  Nick Yeung,et al.  The many characters of visual alpha oscillations , 2018, The European journal of neuroscience.

[20]  Juan R. Vidal,et al.  Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex , 2018, Communications Biology.

[21]  Tim C Kietzmann,et al.  Deep Neural Networks in Computational Neuroscience , 2018, bioRxiv.

[22]  A. Zeman,et al.  The neural correlates of visual imagery: A co-ordinate-based meta-analysis , 2018, Cortex.

[23]  James V. Haxby,et al.  CoSMoMVPA: Multi-Modal Multivariate Pattern Analysis of Neuroimaging Data in Matlab/GNU Octave , 2016, bioRxiv.

[24]  H. Kennedy,et al.  Alpha-Beta and Gamma Rhythms Subserve Feedback and Feedforward Influences among Human Visual Cortical Areas , 2016, Neuron.

[25]  Lucy S. Petro,et al.  Contextual Feedback to Superficial Layers of V1 , 2015, Current Biology.

[26]  P. Fries Rhythms for Cognition: Communication through Coherence , 2015, Neuron.

[27]  J. Haynes A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives , 2015, Neuron.

[28]  N. Yeung,et al.  The roles of cortical oscillations in sustained attention , 2015, Trends in Cognitive Sciences.

[29]  H. Kennedy,et al.  Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels , 2014, Neuron.

[30]  P. Roelfsema,et al.  Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex , 2014, Proceedings of the National Academy of Sciences.

[31]  Damien J. Mannion,et al.  Regions of Mid-level Human Visual Cortex Sensitive to the Global Coherence of Local Image Patches , 2014, Journal of Cognitive Neuroscience.

[32]  Lars Muckli,et al.  Decoding Sound and Imagery Content in Early Visual Cortex , 2014, Current Biology.

[33]  John J. Foxe,et al.  Throwing out the rules: anticipatory alpha‐band oscillatory attention mechanisms during task‐set reconfigurations , 2014, The European journal of neuroscience.

[34]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[35]  Henry Kennedy,et al.  Cortical High-Density Counterstream Architectures , 2013, Science.

[36]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[37]  Lars Muckli,et al.  Network interactions: non-geniculate input to V1 , 2013, Current Opinion in Neurobiology.

[38]  Daniel D. Dilks,et al.  The Occipital Place Area Is Causally and Selectively Involved in Scene Perception , 2013, The Journal of Neuroscience.

[39]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[40]  Nancy Kanwisher,et al.  An algorithmic method for functionally defining regions of interest in the ventral visual pathway , 2012, NeuroImage.

[41]  R. Romo,et al.  α-Oscillations in the monkey sensorimotor network influence discrimination performance by rhythmical inhibition of neuronal spiking , 2011, Proceedings of the National Academy of Sciences.

[42]  Fraser W. Smith,et al.  Decoding natural sounds in early visual cortex , 2011 .

[43]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[44]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[45]  Fraser W. Smith,et al.  Nonstimulated early visual areas carry information about surrounding context , 2010, Proceedings of the National Academy of Sciences.

[46]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[47]  N. Kanwisher,et al.  Feedback of pVisual Object Information to Foveal Retinotopic Cortex , 2008, Nature Neuroscience.

[48]  Á. Pascual-Leone,et al.  Spontaneous fluctuations in posterior alpha-band EEG activity reflect variability in excitability of human visual areas. , 2008, Cerebral cortex.

[49]  Rufin VanRullen,et al.  The power of the feed-forward sweep , 2008, Advances in cognitive psychology.

[50]  N. Block Consciousness, accessibility, and the mesh between psychology and neuroscience , 2007, Behavioral and Brain Sciences.

[51]  S. Dehaene,et al.  Cultural Recycling of Cortical Maps , 2007, Neuron.

[52]  David D. Cox,et al.  Untangling invariant object recognition , 2007, Trends in Cognitive Sciences.

[53]  O. Jensen,et al.  Modulation of Gamma and Alpha Activity during a Working Memory Task Engaging the Dorsal or Ventral Stream , 2007, The Journal of Neuroscience.

[54]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[55]  Henry Kennedy,et al.  Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness , 2004, Cognitive, affective & behavioral neuroscience.

[56]  K. Grill-Spector The neural basis of object perception , 2003, Current Opinion in Neurobiology.

[57]  Robert Turner,et al.  Image Distortion Correction in fMRI: A Quantitative Evaluation , 2002, NeuroImage.

[58]  E. Maguire The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings. , 2001, Scandinavian journal of psychology.

[59]  S Zeki,et al.  Localization and globalization in conscious vision. , 2001, Annual review of neuroscience.

[60]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[61]  Russell A. Epstein,et al.  The Parahippocampal Place Area Recognition, Navigation, or Encoding? , 1999, Neuron.

[62]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[63]  Victor A. F. Lamme,et al.  Feedforward, horizontal, and feedback processing in the visual cortex , 1998, Current Opinion in Neurobiology.

[64]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[65]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[66]  G. Pfurtscheller,et al.  Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a review. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[67]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.