Feedback Decoding of Spatially Structured Population Activity in Cortical Maps

A mechanism is proposed by which feedback pathways model spatial patterns of feedforward activity in cortical maps. The mechanism can be viewed equivalently as readout of a content-addressable memory or as decoding of a population code. The model is based on the evidence that cortical receptive fields can often be described as a separable product of functions along several dimensions, each represented in a spatially ordered map. Given this, it is shown that for an N-dimensional map, accurate modeling and decoding of xN feedforward activity patterns can be done with Nx fibers, N of which must be active at any one time. The proposed mechanism explains several known properties of the cortex and pyramidal neurons: (1) the integration of signals by dendrites with a narrow tangential distribution, that is, apical dendrites; (2) the presence of fast-conducting feedback projections with broad tangential distributions; (3) the multiplicative effects of attention on receptive field profiles; and (4) the existence of multiplicative interactions between subthreshold feedforward inputs to basal dendrites and inputs to apical dendrites.

[1]  Nicholas V. Swindale,et al.  Coverage and the design of striate cortex , 1991, Biological Cybernetics.

[2]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  Keiji Tanaka,et al.  Divergent backward projections from the anterior part of the inferotemporal cortex (area TE) in the macaque , 2000, The Journal of comparative neurology.

[4]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[5]  G Westheimer,et al.  Temporal uncertainty effects on orientation discrimination and stereoscopic thresholds. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[7]  K. Rockland,et al.  Feedback connections from area MT of the squirrel monkey to areas V1 and V2 , 2000, The Journal of comparative neurology.

[8]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[9]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[10]  Karl J. Friston,et al.  The physiological basis of attentional modulation in extrastriate visual areas , 1999, Nature Neuroscience.

[11]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[12]  I. Ohzawa,et al.  Receptive-field dynamics in the central visual pathways , 1995, Trends in Neurosciences.

[13]  J. Venn,et al.  . On the diagrammatic and mechanical representation of propositions and reasonings , 2022 .

[14]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[15]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[16]  B. Sakmann,et al.  A new cellular mechanism for coupling inputs arriving at different cortical layers , 1999, Nature.

[17]  N. Swindale,et al.  How many maps are there in visual cortex? , 2000, Cerebral cortex.

[18]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[19]  Tiande Shou,et al.  Spatial frequency-dependent feedback of visual cortical area 21a modulating functional orientation column maps in areas 17 and 18 of the cat , 2004, Brain Research.

[20]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[21]  P Girard,et al.  Feedback connections act on the early part of the responses in monkey visual cortex. , 2001, Journal of neurophysiology.

[22]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[23]  D. Fitzpatrick,et al.  A systematic map of direction preference in primary visual cortex , 1996, Nature.

[24]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[25]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[26]  Leonard E. White,et al.  Mapping multiple features in the population response of visual cortex , 2003, Nature.

[27]  Amiram Grinvald,et al.  Visual cortex maps are optimized for uniform coverage , 2000, Nature Neuroscience.

[28]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[29]  Á. Pascual-Leone,et al.  Fast Backprojections from the Motion to the Primary Visual Area Necessary for Visual Awareness , 2001, Science.

[30]  Tanya I. Baker,et al.  Cortical maps of separable tuning properties predict population responses to complex visual stimuli. , 2005, Journal of neurophysiology.

[31]  S. Ullman,et al.  Retinotopic Axis Specificity and Selective Clustering of Feedback Projections from V2 to V1 in the Owl Monkey , 2005, The Journal of Neuroscience.

[32]  G Westheimer,et al.  Uncertainty effects in orientation discrimination of foveally seen lines in human observers. , 1992, The Journal of physiology.

[33]  R. Goebel,et al.  The role of feedback in shaping neural representations in cat visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[35]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[36]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[37]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[38]  W. Senn,et al.  Top-down dendritic input increases the gain of layer 5 pyramidal neurons. , 2004, Cerebral cortex.

[39]  W. Burke,et al.  Modulatory influence of feedback projections from area 21a on neuronal activities in striate cortex of the cat. , 2000, Cerebral cortex.

[40]  T. Cohn,et al.  Detectability of a luminance increment: effect of spatial uncertainty. , 1974, Journal of the Optical Society of America.

[41]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[42]  M. Häusser,et al.  Dendritic coincidence detection of EPSPs and action potentials , 2001, Nature Neuroscience.

[43]  D. Chklovskii,et al.  Maps in the brain: what can we learn from them? , 2004, Annual review of neuroscience.

[44]  A. Grinvald,et al.  Spatial Relationships among Three Columnar Systems in Cat Area 17 , 1997, The Journal of Neuroscience.

[45]  Jack A. Tuszynski,et al.  Neural cytoskeleton capabilities for learning and memory , 2009, Journal of biological physics.

[46]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[47]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[48]  Richard Durbin,et al.  A dimension reduction framework for understanding cortical maps , 1990, Nature.

[49]  Keiji Tanaka,et al.  Functional architecture in monkey inferotemporal cortex revealed by in vivo optical imaging , 1998, Neuroscience Research.

[50]  J. Bullier,et al.  Feedforward and feedback connections between areas V1 and V2 of the monkey have similar rapid conduction velocities. , 2001, Journal of neurophysiology.

[51]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[52]  S. Treue,et al.  Feature-Based Attention Increases the Selectivity of Population Responses in Primate Visual Cortex , 2004, Current Biology.

[53]  Dezhe Z. Jin,et al.  The Coordinated Mapping of Visual Space and Response Features in Visual Cortex , 2005, Neuron.

[54]  A. Grinvald,et al.  Functional Organization for Direction of Motion and Its Relationship to Orientation Maps in Cat Area 18 , 1996, The Journal of Neuroscience.

[55]  K. Rockland,et al.  Terminal arbors of individual “Feedback” axons projecting from area V2 to V1 in the macaque monkey: A study using immunohistochemistry of anterogradely transported Phaseolus vulgaris‐leucoagglutinin , 1989, The Journal of comparative neurology.

[56]  M. Carandini,et al.  Mapping of stimulus energy in primary visual cortex. , 2005, Journal of neurophysiology.

[57]  N. Swindale,et al.  How different feature spaces may be represented in cortical maps , 2004, Network.

[58]  R. Watt Scanning from coarse to fine spatial scales in the human visual system after the onset of a stimulus. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[59]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.