A theory of cortical responses

This article concerns the nature of evoked brain responses and the principles underlying their generation. We start with the premise that the sensory brain has evolved to represent or infer the causes of changes in its sensory inputs. The problem of inference is well formulated in statistical terms. The statistical fundaments of inference may therefore afford important constraints on neuronal implementation. By formulating the original ideas of Helmholtz on perception, in terms of modern-day statistical theories, one arrives at a model of perceptual inference and learning that can explain a remarkable range of neurobiological facts. It turns out that the problems of inferring the causes of sensory input (perceptual inference) and learning the relationship between input and cause (perceptual learning) can be resolved using exactly the same principle. Specifically, both inference and learning rest on minimizing the brain's free energy, as defined in statistical physics. Furthermore, inference and learning can proceed in a biologically plausible fashion. Cortical responses can be seen as the brain’s attempt to minimize the free energy induced by a stimulus and thereby encode the most likely cause of that stimulus. Similarly, learning emerges from changes in synaptic efficacy that minimize the free energy, averaged over all stimuli encountered. The underlying scheme rests on empirical Bayes and hierarchical models of how sensory input is caused. The use of hierarchical models enables the brain to construct prior expectations in a dynamic and context-sensitive fashion. This scheme provides a principled way to understand many aspects of cortical organization and responses. The aim of this article is to encompass many apparently unrelated anatomical, physiological and psychophysical attributes of the brain within a single theoretical perspective. In terms of cortical architectures, the theoretical treatment predicts that sensory cortex should be arranged hierarchically, that connections should be reciprocal and that forward and backward connections should show a functional asymmetry (forward connections are driving, whereas backward connections are both driving and modulatory). In terms of synaptic physiology, it predicts associative plasticity and, for dynamic models, spike-timing-dependent plasticity. In terms of electrophysiology, it accounts for classical and extra classical receptive field effects and long-latency or endogenous components of evoked cortical responses. It predicts the attenuation of responses encoding prediction error with perceptual learning and explains many phenomena such as repetition suppression, mismatch negativity (MMN) and the P300 in electroencephalography. In psychophysical terms, it accounts for the behavioural correlates of these physiological phenomena, for example, priming and global precedence. The final focus of this article is on perceptual learning as measured with the MMN and the implications for empirical studies of coupling among cortical areas using evoked sensory responses.

[1]  J. Locke An Essay concerning Human Understanding , 1924, Nature.

[2]  G. Jefferson Localization of function in the cerebral cortex. , 1950, British medical bulletin.

[3]  D. Mackay The Epistemological Problem for Automata , 1956 .

[4]  B. Efron,et al.  Stein's Estimation Rule and Its Competitors- An Empirical Bayes Approach , 1973 .

[5]  P. Nidditch,et al.  The Clarendon Edition of the Works of John Locke: An Essay Concerning Human Understanding , 1975 .

[6]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[7]  K. Rockland,et al.  Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey , 1979, Brain Research.

[8]  P. Schiller,et al.  Effect of cooling area 18 on striate cortex cells in the squirrel monkey. , 1982, Journal of neurophysiology.

[9]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[10]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  C. G. Phillips,et al.  Localization of function in the cerebral cortex. Past, present and future. , 1984, Brain : a journal of neurology.

[12]  K. Brodmann Vergleichende Lokalisationslehre der Großhirnrinde : in ihren Prinzipien dargestellt auf Grund des Zellenbaues , 1985 .

[13]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[14]  E Harth,et al.  The inversion of sensory processing by feedback pathways: a model of visual cognitive functions. , 1987, Science.

[15]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.

[16]  H. Spitzer,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. I. Response characteristics. , 1987, Journal of neurophysiology.

[17]  P. C. Murphy,et al.  Corticofugal feedback influences the generation of length tuning in the visual pathway , 1987, Nature.

[18]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[19]  Erkki Oja,et al.  Neural Networks, Principal Components, and Subspaces , 1989, Int. J. Neural Syst..

[20]  R. Kass,et al.  Approximate Bayesian Inference in Conditionally Independent Hierarchical Models (Parametric Empirical Bayes Models) , 1989 .

[21]  J. Bullier,et al.  Visual activity in area V2 during reversible inactivation of area 17 in the macaque monkey. , 1989, Journal of neurophysiology.

[22]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[23]  R Linsker,et al.  Perceptual neural organization: some approaches based on network models and information theory. , 1990, Annual review of neuroscience.

[24]  S. Zeki Vision: The motion pathways of the visual cortex , 1991 .

[25]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[27]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[28]  Mitsuo Kawato,et al.  A forward-inverse optics model of reciprocal connections between visual cortical areas , 1993 .

[29]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[30]  E. Marg A VISION OF THE BRAIN , 1994 .

[31]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[33]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[34]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[35]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[36]  R. Desimone,et al.  Neural mechanisms for visual memory and their role in attention. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[37]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[38]  W. Singer,et al.  In search of common foundations for cortical computation , 1997, Behavioral and Brain Sciences.

[39]  A. Clark,et al.  Trading spaces: Computation, representation, and the limits of uninformed learning , 1997, Behavioral and Brain Sciences.

[40]  Jim Kay,et al.  Activation Functions, Computational Goals, and Learning Rules for Local Processors with Contextual Guidance , 1997, Neural Computation.

[41]  C. Büchel,et al.  Modulation of connectivity in visual pathways by attention: cortical interactions evaluated with structural equation modelling and fMRI. , 1997, Cerebral cortex.

[42]  U. Frey,et al.  Synaptic tagging and long-term potentiation , 1997, Nature.

[43]  C. Koch,et al.  Constraints on cortical and thalamic projections: the no-strong-loops hypothesis , 1998, Nature.

[44]  D. Buonomano,et al.  Cortical plasticity: from synapses to maps. , 1998, Annual review of neuroscience.

[45]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[46]  R. Guillery,et al.  On the actions that one nerve cell can have on another: distinguishing "drivers" from "modulators". , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Karl J. Friston The disconnection hypothesis , 1998, Schizophrenia Research.

[48]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[49]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[50]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[51]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[52]  E. Miller,et al.  Prospective Coding for Objects in Primate Prefrontal Cortex , 1999, The Journal of Neuroscience.

[53]  D A Pollen,et al.  On the neural correlates of visual perception. , 1999, Cerebral cortex.

[54]  M P Young,et al.  Hierarchical organization of macaque and cat cortical sensory systems explored with a novel network processor. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[55]  D. Javitt,et al.  Ketamine-induced deficits in auditory and visual context-dependent processing in healthy volunteers: implications for models of cognitive deficits in schizophrenia. , 2000, Archives of general psychiatry.

[56]  S. J. Martin,et al.  Synaptic plasticity and memory: an evaluation of the hypothesis. , 2000, Annual review of neuroscience.

[57]  Karl J. Friston,et al.  The labile brain. III. Transients and spatio-temporal receptive fields. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[58]  T. Shallice,et al.  Neuroimaging evidence for dissociable forms of repetition priming. , 2000, Science.

[59]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[60]  M. Mehta Neuronal Dynamics of Predictive Coding , 2001, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[61]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[62]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[63]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[64]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[65]  J. B. Levitt,et al.  Anatomical origins of the classical receptive field and modulatory surround field of single neurons in macaque visual cortical area V1. , 2002, Progress in brain research.

[66]  Jesper Tegnér,et al.  Spike-timing-dependent plasticity: common themes and divergent vistas , 2002, Biological Cybernetics.

[67]  Karl J. Friston Functional integration and inference in the brain , 2002, Progress in Neurobiology.

[68]  Henry Markram,et al.  Coding of temporal information by activity-dependent synapses. , 2002, Journal of neurophysiology.

[69]  Paul Schrater,et al.  Shape perception reduces activity in human primary visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[70]  T. Baldeweg,et al.  Impairment in frontal but not temporal components of mismatch negativity in schizophrenia. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[71]  L. Martinez,et al.  Completing the Corticofugal Loop: A Visual Role for the Corticogeniculate Type 1 Metabotropic Glutamate Receptor , 2002, The Journal of Neuroscience.

[72]  R. Näätänen Mismatch negativity: clinical research and possible applications. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[73]  Karl J. Friston,et al.  A neural mass model for MEG/EEG: coupling and neuronal dynamics , 2003, NeuroImage.

[74]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[75]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[76]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[77]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[78]  Shihui Han,et al.  Modulation of neural activities by enhanced local selection in the processing of compound stimuli , 2003, Human brain mapping.

[79]  A. Dale,et al.  Human posterior auditory cortex gates novel sounds to consciousness. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[80]  Ben H. Jansen,et al.  Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns , 1995, Biological Cybernetics.

[81]  R. Näätänen,et al.  The mismatch negativity (MMN): towards the optimal paradigm , 2004, Clinical Neurophysiology.

[82]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[83]  T. Baldeweg,et al.  Mismatch negativity potentials and cognitive impairment in schizophrenia , 2004, Schizophrenia Research.

[84]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[85]  P. Földiák,et al.  Forming sparse representations by local anti-Hebbian learning , 1990, Biological Cybernetics.

[86]  Egon Wanke,et al.  Mapping brains without coordinates , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[87]  Karl J. Friston,et al.  Dynamic causal modeling of evoked responses in EEG and MEG , 2006, NeuroImage.

[88]  Karl J. Friston,et al.  Extra-classical receptive field effects measured in striate cortex with fMRI , 2007, NeuroImage.