Cortical free-association dynamics: distinct phases of a latching network.

A Potts associative memory network has been proposed as a simplified model of macroscopic cortical dynamics, in which each Potts unit stands for a patch of cortex, which can be activated in one of S local attractor states. The internal neuronal dynamics of the patch is not described by the model, rather it is subsumed into an effective description in terms of graded Potts units, with adaptation effects both specific to each attractor state and generic to the patch. If each unit, or patch, receives effective (tensor) connections from C other units, the network has been shown to be able to store a large number p of global patterns, or network attractors, each with a fraction a of the units active, where the critical load p_{c} scales roughly like p_{c}≈CS^{2}/aln(1/a) (if the patterns are randomly correlated). Interestingly, after retrieving an externally cued attractor, the network can continue jumping, or latching, from attractor to attractor, driven by adaptation effects. The occurrence and duration of latching dynamics is found through simulations to depend critically on the strength of local attractor states, expressed in the Potts model by a parameter w. Here we describe with simulations and then analytically the boundaries between distinct phases of no latching, of transient and sustained latching, deriving a phase diagram in the plane w-T, where T parametrizes thermal noise effects. Implications for real cortical dynamics are briefly reviewed in the conclusions.

[1]  G. Tamás,et al.  Identified Sources and Targets of Slow Inhibition in the Neocortex , 2003, Science.

[2]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[3]  Yoram Ben-Shaul,et al.  Temporally precise cortical firing patterns are associated with distinct action segments. , 2006, Journal of neurophysiology.

[4]  A. Treves,et al.  Converging Neuronal Activity in Inferior Temporal Cortex during the Classification of Morphed Stimuli , 2008, Cerebral cortex.

[5]  S Dehaene,et al.  A neuronal model of a global workspace in effortful cognitive tasks. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Susan J. Hespos,et al.  Conceptual precursors to language , 2004, Nature.

[7]  Russell A. Epstein,et al.  The Neural-Cognitive Basis of the Jamesian Stream of Thought , 2000, Consciousness and Cognition.

[8]  Tim Shallice,et al.  On the emergence of modern humans , 2007, Cognition.

[9]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[10]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[11]  T. Bonhoeffer,et al.  Current opinion in neurobiology , 1997, Current Opinion in Neurobiology.

[12]  Hendrik B. Geyer,et al.  Journal of Physics A - Mathematical and General, Special Issue. SI Aug 11 2006 ?? Preface , 2006 .

[13]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[14]  H. Kalmus Biological Cybernetics , 1972, Nature.

[15]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[16]  Xiaochuan Pan,et al.  Advances in Cognitive Neurodynamics (II) , 2011 .

[17]  Ramón Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001 .

[18]  E. Koechlin,et al.  Motivation and cognitive control in the human prefrontal cortex , 2009, Nature Neuroscience.

[19]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002 .

[20]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[21]  R Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001, Physical review letters.

[22]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[23]  Ichiro Tsuda,et al.  Dynamic link of memory--Chaotic memory map in nonequilibrium neural networks , 1992, Neural Networks.

[24]  B. McNaughton,et al.  Independent Codes for Spatial and Episodic Memory in Hippocampal Neuronal Ensembles , 2005, Science.

[25]  Ronald Cools,et al.  Mean-field theory for the Q-state Potts-glass neural network with biased patterns , 1993 .

[26]  Diana Deutsch,et al.  Music perception. , 2007, Frontiers in Bioscience.

[27]  P. Morse Annals of Physics , 1957, Nature.

[28]  Mariano Sigman,et al.  Parsing a Perceptual Decision into a Sequence of Moments of Thought , 2011, Front. Integr. Neurosci..

[29]  Alessandro Treves,et al.  Free association transitions in models of cortical latching dynamics , 2008 .

[30]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[31]  R. K. Simpson Nature Neuroscience , 2022 .

[32]  Günther Palm,et al.  Cell assemblies in the cerebral cortex , 2014, Biological Cybernetics.

[33]  Paul Miller,et al.  Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles , 2007, Proceedings of the National Academy of Sciences.

[34]  D. Chalmers Consciousness and Cognition , 1990 .

[35]  Physical Review , 1965, Nature.

[36]  Alessandro Treves,et al.  Disappearance of spurious states in analog associative memories. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Moshe Abeles,et al.  The point of no return in planar hand movements: an indication of the existence of high level motion primitives , 2007, Cognitive Neurodynamics.

[39]  Alessandro Treves,et al.  Frontal latching networks: a possible neural basis for infinite recursion , 2005, Cognitive neuropsychology.

[40]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[41]  D. Dhar,et al.  Continuum percolation with discs having a distribution of radii , 1984 .

[42]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[43]  O. Paulsen,et al.  The roles of GABAB receptors in cortical network activity. , 2010, Advances in pharmacology.

[44]  Marius Usher,et al.  A neural model of the dynamic activation of memory , 1993, Biological Cybernetics.

[45]  Yoko Yamaguchi,et al.  Advances in Cognitive Neurodynamics (III) , 2013, Springer Netherlands.

[46]  王丹,et al.  Plos Computational Biology主编关于论文获得发表的10条简单法则的评析 , 2009 .

[47]  Ray Jackendoff,et al.  Parallels and Nonparallels between Language and Music , 2009 .

[48]  S. Redner,et al.  Introduction To Percolation Theory , 2018 .

[49]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[50]  Alessandro Treves,et al.  The storage capacity of Potts models for semantic memory retrieval , 2005 .

[51]  S. Dehaene,et al.  Brain Dynamics Underlying the Nonlinear Threshold for Access to Consciousness , 2007, PLoS biology.

[52]  Alessandro Treves,et al.  An Uncouth Approach to Language Recursivity , 2011, Biolinguistics.

[53]  Daniel Durstewitz,et al.  Attracting Dynamics of Frontal Cortex Ensembles during Memory-Guided Decision-Making , 2011, PLoS Comput. Biol..

[54]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.

[55]  Claudius Gros,et al.  Neural networks with transient state dynamics , 2007, 0705.0078.

[56]  Kanter Potts-glass models of neural networks. , 1988, Physical review. A, General physics.

[57]  Shimon Marom,et al.  Neural timescales or lack thereof , 2010, Progress in Neurobiology.

[58]  Daniel J. Amit,et al.  Paradigmatic Working Memory (Attractor) Cell in IT Cortex , 1997, Neural Computation.

[59]  P W Burgess,et al.  Confabulation and the control of recollection. , 1996, Memory.

[60]  I Kanter,et al.  Generation of unpredictable time series by a neural network. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[61]  H. Adam ADVANCES IN PHARMACOLOGY , 1951 .

[62]  M. Timme,et al.  Prevalence of unstable attractors in networks of pulse-coupled oscillators. , 2002, Physical review letters.

[63]  T. M. Mayhew,et al.  Anatomy of the Cortex: Statistics and Geometry. , 1991 .

[64]  J. Kaas,et al.  The evolution of the neocortex in mammals: how is phenotypic diversity generated? , 2005, Current Opinion in Neurobiology.

[65]  J S Andrade,et al.  Periodic neural activity induced by network complexity. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[66]  Mariano Sigman,et al.  Scale-Invariant Transition Probabilities in Free Word Association Trajectories , 2009, Front. Integr. Neurosci..

[67]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[68]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[69]  Pieter R. Roelfsema,et al.  The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain , 2010, PLoS Comput. Biol..

[70]  A. Treves,et al.  Theta-paced flickering between place-cell maps in the hippocampus , 2011, Nature.

[71]  Max Coltheart,et al.  Cognitive Neuropsychology , 2014, Scholarpedia.

[72]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[73]  Abdolhossein Abbassian,et al.  Optimal region of latching activity in an adaptive Potts model for networks of neurons , 2012 .

[74]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[75]  Amir Amedi,et al.  A Putative Model of Multisensory Object Representation , 2009, Brain Topography.

[76]  October I Physical Review Letters , 2022 .

[77]  Athena Akrami,et al.  Lateral thinking, from the Hopfield model to cortical dynamics , 2012, Brain Research.

[78]  Kanter,et al.  Temporal association in asymmetric neural networks. , 1986, Physical review letters.

[79]  Horn,et al.  Neural networks with dynamical thresholds. , 1989, Physical review. A, General physics.

[80]  Z. Nadasdy,et al.  Neurons of the cerebral cortex exhibit precise interspike timing in correspondence to behavior. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[81]  Alessandro Treves,et al.  Short- and long-range connections in autoassociative memory , 1992 .

[82]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.