Latency-Based Probabilistic Information Processing in Recurrent Neural Hierarchies

In this article, we present an original neural space/latency code, integrated in a multi-layered neural hierarchy, that offers a new perspective on probabilistic inference operations. Our work is based on the dynamic neural field paradigm that leads to the emergence of activity bumps, based on recurrent lateral interactions, thus providing a spatial coding of information. We propose that lateral connections represent a data model, i.e., the conditional probability of a “true” stimulus given a noisy input. We propose furthermore that the resulting attractor state encodes the most likely ”true” stimulus given the data model, and that its latency expresses the confidence in this interpretation. Thus, the main feature of this network is its ability to represent, transmit and integrate probabilistic information at multiple levels so that to take near-optimal decisions when inputs are contradictory, noisy or missing. We illustrate these properties on a three-layered neural hierarchy receiving inputs from a simplified robotic object recognition task. We also compare the network dynamics to an explicit probabilistic model of the task, to verify that it indeed reproduces all relevant properties of probabilistic processing.

[1]  M W Oram,et al.  The temporal resolution of neural codes: does response latency have a unique role? , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[3]  Paul Cisek,et al.  Response competition in the primary motor cortex: corticospinal excitability reflects response replacement during simple decisions. , 2010, Journal of neurophysiology.

[4]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[5]  Shun-ichi Amari,et al.  Mathematical foundations of neurocomputing , 1990, Proc. IEEE.

[6]  R. Oostenveld,et al.  Theta and Gamma Oscillations Predict Encoding and Retrieval of Declarative Memory , 2006, The Journal of Neuroscience.

[7]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[8]  Keiji Tanaka,et al.  Differences in onset latency of macaque inferotemporal neural responses to primate and non-primate faces. , 2005, Journal of neurophysiology.

[9]  Raymond H. Cuijpers,et al.  Implementing Bayes' Rule with Neural Fields , 2008, ICANN.

[10]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[11]  A. Yuille,et al.  Bayesian decision theory and psychophysics , 1996 .

[12]  Christian Faubel,et al.  Learning to recognize objects on the fly: A neurally based dynamic field approach , 2008, Neural Networks.

[13]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[14]  G. Schöner,et al.  Dynamic Field Theory of Movement Preparation , 2022 .

[15]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[16]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[17]  Nicolas P. Rougier,et al.  Emergence of attention within a neural population , 2006, Neural Networks.

[18]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[19]  Gregor Schöner,et al.  The time course of saccadic decision making: Dynamic field theory , 2006, Neural Networks.

[20]  Alexander Gepperth Processing and Transmission of Confidence in Recurrent Neural Hierarchies , 2013, Neural Processing Letters.

[21]  Jeffrey S. Johnson,et al.  Moving to higher ground: The dynamic field theory and the dynamics of visual cognition. , 2008, New ideas in psychology.

[22]  F. Mechler,et al.  Temporal coding of contrast in primary visual cortex: when, what, and why. , 2001, Journal of neurophysiology.

[23]  Kazuyuki Aihara,et al.  Analyzing Global Dynamics of a Neural Field Model , 2004, Neural Processing Letters.

[24]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[25]  J. E.,et al.  Semantic Ambiguity Effects in Word Identification , 1996 .

[26]  R. Poldrack,et al.  Neural Activation During Response Competition , 2000, Journal of Cognitive Neuroscience.

[27]  P. Cisek Integrated Neural Processes for Defining Potential Actions and Deciding between Them: A Computational Model , 2006, The Journal of Neuroscience.