Chunking sequence information by mutually predicting recurrent neural networks

Interpretation and execution of complex sequences is crucial for various cognitive tasks such as language processing and motor control. The brain solves this problem arguably by dividing a sequence into discrete chunks of contiguous items. While chunking has been accounted for by predictive uncertainty, alternative mechanisms have also been suggested, and the mechanism underlying chunking is poorly understood. Here, we propose a class of unsupervised neural networks for learning and identifying repeated patterns in sequence input with various degrees of complexity. In this model, a pair of reservoir computing modules, each of which comprises a recurrent neural network and readout units, supervise each other to consistently predict others’ responses to frequently recurring segments. Interestingly, this system generates neural responses similar to those formed in the basal ganglia during habit formation. Our model extends reservoir computing to higher cognitive function and demonstrates its resemblance to sequence processing by cortico-basal ganglia loops.

[1]  Dare A. Baldwin,et al.  Segmenting dynamic human action via statistical structure , 2008, Cognition.

[2]  Nick Chater,et al.  The Now-or-Never bottleneck: A fundamental constraint on language , 2015, Behavioral and Brain Sciences.

[3]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[4]  Maneesh Sahani,et al.  A dynamical systems view of motor preparation: implications for neural prosthetic system design. , 2011, Progress in brain research.

[5]  A. Graybiel.  The Basal Ganglia and Chunking of Action Repertoires , 1998, Neurobiology of Learning and Memory.

[6]  Xin Jin,et al.  Start/stop signals emerge in nigrostriatal circuits during sequence learning , 2010, Nature.

[7]  Florent Meyniel,et al.  The Neural Representation of Sequences: From Transition Probabilities to Algebraic Patterns and Linguistic Trees , 2015, Neuron.

[8]  A. Graybiel,et al.  Representation of Action Sequence Boundaries by Macaque Prefrontal Cortical Neurons , 2003, Science.

[9]  L. F. Abbott,et al.  Building functional networks of spiking model neurons , 2016, Nature Neuroscience.

[10]  R. Näätänen.  Mismatch negativity: clinical research and possible applications. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Wei Wang,et al.  Hierarchical Chunking of Sequential Memory on Neuromorphic Architecture with Reduced Synaptic Plasticity , 2016, Front. Comput. Neurosci..

[12]  G. McCarthy,et al.  Perceiving patterns in random series: dynamic processing of sequence in prefrontal cortex , 2002, Nature Neuroscience.

[13]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[14]  Xin Jin,et al.  Basal Ganglia Subcircuits Distinctively Encode the Parsing and Concatenation of Action Sequences , 2014, Nature Neuroscience.

[15]  Karl J. Friston,et al.  Recognizing Sequences of Sequences , 2009, PLoS Comput. Biol..

[16]  Karl J. Friston,et al.  The mismatch negativity: A review of underlying mechanisms , 2009, Clinical Neurophysiology.

[17]  Christopher M. Bishop,et al.  Current address: Microsoft Research, , 2022 .

[18]  M. Botvinick,et al.  Neural representations of events arise from temporal community structure , 2013, Nature Neuroscience.

[19]  Pablo Varona,et al.  Chunking dynamics: heteroclinics in mind , 2014, Front. Comput. Neurosci..

[20]  Julia L. Evans,et al.  Can Infants Map Meaning to Newly Segmented Words? , 2007, Psychological science.

[21]  S. Dehaene,et al.  A Hierarchy of Responses to Auditory Regularities in the Macaque Brain , 2014, The Journal of Neuroscience.

[22]  Jeffrey M. Zacks,et al.  Prediction Error Associated with the Perceptual Segmentation of Naturalistic Events , 2011, Journal of Cognitive Neuroscience.

[23]  Jenny R. Saffran,et al.  Expectancy Learning from Probabilistic Input by Infants , 2013, Front. Psychology.

[24]  Timothy Q. Gentner,et al.  Recursive syntactic pattern learning by songbirds , 2006, Nature.

[25]  Mikhail Rabinovich,et al.  Learning of Chunking Sequences in Cognition and Behavior , 2015, PLoS Comput. Biol..

[26]  Catherine Stamoulis,et al.  Advance cueing produces enhanced action-boundary patterns of spike activity in the sensorimotor striatum. , 2011, Journal of neurophysiology.

[27]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[28]  Marco Buiatti,et al.  Investigating the neural correlates of continuous speech computation with frequency-tagged neuroelectric responses , 2009, NeuroImage.

[29]  J. Changeux,et al.  A Neuronal Model of Predictive Coding Accounting for the Mismatch Negativity , 2012, The Journal of Neuroscience.

[30]  N. Parga,et al.  Dynamic Control of Response Criterion in Premotor Cortex during Perceptual Detection under Temporal Uncertainty , 2015, Neuron.

[31]  David McAlpine,et al.  Cortical responses to changes in acoustic regularity are differentially modulated by attentional load , 2012, NeuroImage.

[32]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[33]  Willem B Verwey,et al.  Distinct modes of executing movement sequences: reacting, associating, and chunking. , 2012, Acta psychologica.

[34]  J. Duncan,et al.  Encoding Strategies Dissociate Prefrontal Activity from Working Memory Demand , 2003, Neuron.

[35]  Matthew T. Kaufman,et al.  A neural network that finds a naturalistic solution for the production of muscle activity , 2015, Nature Neuroscience.

[36]  Alexander Rivkind,et al.  Local Dynamics in Trained Recurrent Neural Networks. , 2015, Physical review letters.

[37]  S. Dehaene,et al.  Neural signature of the conscious processing of auditory regularities , 2009, Proceedings of the National Academy of Sciences.

[38]  K A Ericcson,et al.  Acquisition of a memory skill. , 1980, Science.

[39]  G. Stefanics,et al.  Visual mismatch negativity (vMMN): A review and meta-analysis of studies in psychiatric and neurological disorders , 2016, Cortex.

[40]  Kae Nakamura,et al.  Emergence of rhythm during motor learning , 2004, Trends in Cognitive Sciences.

[41]  Wolfgang Maass,et al.  Emergence of complex computational structures from chaotic neural networks through reward-modulated Hebbian learning. , 2014, Cerebral cortex.

[42]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[43]  I. Winkler,et al.  Predictive Regularity Representations in Violation Detection and Auditory Stream Segregation: From Conceptual to Computational Models , 2014, Brain Topography.

[44]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[45]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[46]  Richard N Aslin,et al.  Bayesian learning of visual chunks by human observers , 2008, Proceedings of the National Academy of Sciences.

[47]  Jeffrey M. Zacks,et al.  A Computational Model of Event Segmentation From Perceptual Prediction , 2007, Cogn. Sci..

[48]  Kyle S. Smith,et al.  A Dual Operator View of Habitual Behavior Reflecting Cortical and Striatal Dynamics , 2013, Neuron.

[49]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[50]  Scott T. Grafton,et al.  The striatum: where skills and habits meet. , 2015, Cold Spring Harbor perspectives in biology.

[51]  L. Abbott,et al.  Beyond the edge of chaos: amplification and temporal integration by recurrent networks in the chaotic regime. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  Max Berniker,et al.  Chunking as the result of an efficiency computation trade-off , 2016, Nature Communications.

[53]  Scott T. Grafton,et al.  Differential Recruitment of the Sensorimotor Putamen and Frontoparietal Cortex during Motor Chunking in Humans , 2012, Neuron.