Two distinct feedback codes in V1 for ‘real’ and ‘imaginary’ internal experiences

Visual illusions and visual imagery are conscious sensory events that lack a corresponding physical input. But while everyday mental imagery feels distinct from incoming stimulus input, visual illusions, like hallucinations, are under limited volitional control and appear indistinguishable from physical reality. Illusions are thought to arise from lower-level processes within sensory cortices. In contrast, imagery involves a wide network of brain areas that recruit early visual cortices for the sensory representation of the imagined stimulus. Here, we combine laminar fMRI brain imaging with psychophysical methods and multivariate pattern analysis to investigate in human participants how seemingly ‘real’ and imaginary non-physical experiences are processed in primary visual cortex (V1). We find that the content of mental imagery is only decodable in deep layers, whereas illusory content is only decodable at superficial depths. This suggests that feedback to the different layers may serve distinct functions: low-level feedback to superficial layers might be responsible for shaping perception-like experiences, while deep-layer feedback might serve the formation of a more malleable ‘inner’ world, separate from ongoing perception.

[1]  Takeo Watanabe,et al.  The primary visual cortex fills in color , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Henry Kennedy,et al.  The importance of being hierarchical , 2013, Current Opinion in Neurobiology.

[3]  Benjamin de Haas,et al.  How to Enhance the Power to Detect Brain-Behavior Correlations With Limited Resources. , 2018 .

[4]  Pieter R. Roelfsema,et al.  Figure-ground perception in the awake mouse and neuronal activity elicited by figure-ground stimuli in primary visual cortex , 2018, Scientific Reports.

[5]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[6]  David R Williams,et al.  Visual hallucinations in the diagnosis of idiopathic Parkinson's disease: a retrospective autopsy study , 2005, The Lancet Neurology.

[7]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[8]  B. Wandell,et al.  Visual Field Maps in Human Cortex , 2007, Neuron.

[9]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[10]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[11]  N. Logothetis,et al.  Visual competition , 2002, Nature Reviews Neuroscience.

[12]  Y Kamitani,et al.  Afterimage of Perceptually Filled-in Surface , 2001, Science.

[13]  Essa Yacoub,et al.  High resolution data analysis strategies for mesoscale human functional MRI at 7 and 9.4 T , 2018, NeuroImage.

[14]  F. D. Lange,et al.  Selective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback , 2016, Current Biology.

[15]  Joel Pearson,et al.  The sensory strength of voluntary visual imagery predicts visual working memory capacity. , 2014, Journal of vision.

[16]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[17]  Sander Erik Bosch,et al.  Shared Neural Mechanisms of Visual Perception and Imagery , 2019, Trends in Cognitive Sciences.

[18]  M. Larkum A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex , 2013, Trends in Neurosciences.

[19]  F. Galton Inquiries into Human Faculty and Its Development , 1883 .

[20]  Frank Tong,et al.  The Functional Impact of Mental Imagery on Conscious Perception , 2008, Current Biology.

[21]  Moshe Bar,et al.  Predictive Feedback and Conscious Visual Experience , 2012, Front. Psychology.

[22]  Luigi Landini,et al.  Advanced Image Processing in Magnetic Resonance Imaging , 2005 .

[23]  Stefan Skare,et al.  How to correct susceptibility distortions in spin-echo echo-planar images: application to diffusion tensor imaging , 2003, NeuroImage.

[24]  Bart Ferguson,et al.  Detailed T1-Weighted Profiles from the Human Cortex Measured in Vivo at 3 Tesla MRI , 2018, Neuroinformatics.

[25]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[26]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[27]  R. Goebel,et al.  Cortical Depth Dependent Functional Responses in Humans at 7T: Improved Specificity with 3D GRASE , 2013, PloS one.

[28]  Floris P de Lange,et al.  Time-compressed preplay of anticipated events in human primary visual cortex , 2017, Nature Communications.

[29]  Giulio Tononi,et al.  Local and Widespread Slow Waves in Stable NREM Sleep: Evidence for Distinct Regulation Mechanisms , 2018, Front. Hum. Neurosci..

[30]  D. Samuel Schwarzkopf,et al.  Effective Connectivity within Human Primary Visual Cortex Predicts Interindividual Diversity in Illusory Perception , 2013, The Journal of Neuroscience.

[31]  R. Blake A Neural Theory of Binocular Rivalry , 1989 .

[32]  Jian Wang,et al.  SOAPnuke: a MapReduce acceleration-supported software for integrated quality control and preprocessing of high-throughput sequencing data , 2017, GigaScience.

[33]  Natalia Petridou,et al.  Lines of Baillarger in vivo and ex vivo: Myelin contrast across lamina at 7T MRI and histology , 2016, NeuroImage.

[34]  Lucy S. Petro,et al.  Contextual Feedback to Superficial Layers of V1 , 2015, Current Biology.

[35]  A. Bhardwaj,et al.  In situ click chemistry generation of cyclooxygenase-2 inhibitors , 2017, Nature Communications.

[36]  Dov Sagi,et al.  Motion-induced blindness in normal observers , 2001, Nature.

[37]  D. Sagi,et al.  Common mechanisms of visual imagery and perception. , 1995, Science.

[38]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[39]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[40]  Geraint Rees,et al.  Neural Correlates of Motion-induced Blindness in the Human Brain , 2010, Journal of Cognitive Neuroscience.

[41]  F. Galton Inquiries into human faculty and its development, 1883. , 1948 .

[42]  Wolf Singer,et al.  Smaller Primary Visual Cortex Is Associated with Stronger, but Less Precise Mental Imagery. , 2016, Cerebral cortex.

[43]  Julia M. Huntenburg,et al.  Nighres: processing tools for high-resolution neuroimaging , 2018, GigaScience.

[44]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[45]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[46]  G. Kanizsa Margini Quasi-percettivi in Campi con Stimolazione Omogenea , 1955 .

[47]  Lawrence L. Wald,et al.  Laminar analysis of 7T BOLD using an imposed spatial activation pattern in human V1 , 2010, NeuroImage.

[48]  Joel Pearson,et al.  Mental Imagery and Visual Working Memory , 2011, PloS one.

[49]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[50]  M. Vukicevic,et al.  Butterflies and black lacy patterns: the prevalence and characteristics of Charles Bonnet hallucinations in an Australian population , 2008, Clinical & experimental ophthalmology.

[51]  Pieter R. Roelfsema,et al.  Distinct Roles of the Cortical Layers of Area V1 in Figure-Ground Segregation , 2013, Current Biology.

[52]  Dariusz M Plewczynski,et al.  Three-dimensional Epigenome Statistical Model: Genome-wide Chromatin Looping Prediction , 2018, Scientific Reports.

[53]  Stewart Shipp,et al.  Neural Elements for Predictive Coding , 2016, Front. Psychol..

[54]  Frank Tong,et al.  Evaluating the Mind's Eye: the Metacognition of Visual Imagery , 2022 .

[55]  D. Hubel,et al.  Uniformity of monkey striate cortex: A parallel relationship between field size, scatter, and magnification factor , 1974, The Journal of comparative neurology.

[56]  Henry Kennedy,et al.  Cortical High-Density Counterstream Architectures , 2013, Science.

[57]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[58]  Karen R Dobkins,et al.  The face inversion effect in infants is driven by high, and not low, spatial frequencies. , 2014, Journal of vision.

[59]  R. Goebel,et al.  Local Discriminability Determines the Strength of Holistic Processing for Faces in the Fusiform Face Area , 2013, Front. Psychology.

[60]  D. Samuel Schwarzkopf,et al.  The surface area of human V1 predicts the subjective experience of object size , 2010, Nature Neuroscience.