Recurrent Network Models of Sequence Generation and Memory

Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in which a principled mechanism is pre-wired into their connectivity. Here we demonstrate that, starting from random connectivity and modifying a small fraction of connections, a largely disordered recurrent network can produce sequences and implement working memory efficiently. We use this process, called Partial In-Network Training (PINning), to model and match cellular resolution imaging data from the posterior parietal cortex during a virtual memory-guided two-alternative forced-choice task. Analysis of the connectivity reveals that sequences propagate by the cooperation between recurrent synaptic interactions and external inputs, rather than through feedforward or asymmetric connections. Together our results suggest that neural sequences may emerge through learning from largely unstructured network architectures.

[1]  David Pfau,et al.  Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging Data , 2016, Neuron.

[2]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[3]  Asohan Amarasingham,et al.  Hippocampus Internally Generated Cell Assembly Sequences in the Rat , 2011 .

[4]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[5]  Dean V Buonomano,et al.  Timing of neural responses in cortical organotypic slices , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Nicolas Brunel,et al.  Learning internal representations in an attractor neural network with analogue neurons , 1995 .

[7]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[8]  E. Seidemann,et al.  Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[10]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[11]  David Sussillo,et al.  Neural circuits as computational dynamical systems , 2014, Current Opinion in Neurobiology.

[12]  L. Abbott,et al.  From fixed points to chaos: Three models of delayed discrimination , 2013, Progress in Neurobiology.

[13]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[14]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[15]  Haim Sompolinsky,et al.  Inferring Stimulus Selectivity from the Spatial Structure of Neural Network Dynamics , 2010, NIPS.

[16]  M M Merzenich,et al.  Temporal information transformed into a spatial code by a neural network with realistic properties , 1995, Science.

[17]  J. Taube,et al.  Where am I and how will I get there from here? A role for posterior parietal cortex in the integration of spatial information and route planning , 2009, Neurobiology of Learning and Memory.

[18]  D. Nitz Tracking Route Progression in the Posterior Parietal Cortex , 2006, Neuron.

[19]  Liam Paninski,et al.  Bayesian spike inference from calcium imaging data , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[20]  Rafael Yuste,et al.  Fast nonnegative deconvolution for spike train inference from population calcium imaging. , 2009, Journal of neurophysiology.

[21]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[22]  Ann M Graybiel,et al.  Neural representation of time in cortico-basal ganglia circuits , 2009, Proceedings of the National Academy of Sciences.

[23]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[24]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.

[25]  D. Hansel,et al.  Existence and stability of persistent states in large neuronal networks. , 2001, Physical review letters.

[26]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[27]  Sreekanth H. Chalasani,et al.  Imaging neural activity in worms, flies and mice with improved GCaMP calcium indicators , 2009, Nature Methods.

[28]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[29]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[30]  Haim Sompolinsky,et al.  Associative network models for central pattern generators , 1989 .

[31]  Bruno B Averbeck,et al.  Rapid Sequences of Population Activity Patterns Dynamically Encode Task-Critical Spatial Information in Parietal Cortex , 2010, The Journal of Neuroscience.

[32]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[33]  L. Abbott,et al.  Stimulus-dependent suppression of chaos in recurrent neural networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  József Fiser,et al.  Suppression of cortical neural variability is stimulus- and state-dependent. , 2012, Journal of neurophysiology.

[36]  J. Hertz,et al.  Learning short synfire chains by self-organization. , 1996, Network.

[37]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[38]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[39]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[40]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[41]  Isaac Meilijson,et al.  Distributed synchrony in a cell assembly of spiking neurons , 2001, Neural Networks.

[42]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[43]  F. Pulvermüller,et al.  Spatiotemporal Signatures of Large-Scale Synfire Chains for Speech Processing as Revealed by MEG , 2008, Cerebral cortex.

[44]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[45]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[46]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[47]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[48]  Bingni W. Brunton,et al.  Rats and Humans Can Optimally Accumulate Evidence for Decision-Making , 2013, Science.

[49]  Dean V Buonomano,et al.  A learning rule for the emergence of stable dynamics and timing in recurrent networks. , 2005, Journal of neurophysiology.

[50]  David J. Freedman,et al.  A proposed common neural mechanism for categorization and perceptual decisions , 2011, Nature Neuroscience.

[51]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[52]  Jonathan R. Whitlock,et al.  Navigating from hippocampus to parietal cortex , 2008, Proceedings of the National Academy of Sciences.

[53]  M. Wilson,et al.  Temporally Structured Replay of Awake Hippocampal Ensemble Activity during Rapid Eye Movement Sleep , 2001, Neuron.

[54]  Barak A. Pearlmutter Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.

[55]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[56]  E. J. Green,et al.  Cortical representation of motion during unrestrained spatial navigation in the rat. , 1994, Cerebral cortex.

[57]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[58]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[59]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[60]  M. Fee,et al.  Singing-related activity of identified HVC neurons in the zebra finch. , 2007, Journal of neurophysiology.

[61]  Bingni W. Brunton,et al.  Distinct relationships of parietal and prefrontal cortices to evidence accumulation , 2014, Nature.

[62]  D. R. Muir,et al.  Functional organization of excitatory synaptic strength in primary visual cortex , 2015, Nature.

[63]  Eduardo D. Sontag,et al.  Computational Aspects of Feedback in Neural Circuits , 2006, PLoS Comput. Biol..

[64]  John J. Hopfield,et al.  Understanding Emergent Dynamics: Using a Collective Activity Coordinate of a Neural Network to Recognize Time-Varying Patterns , 2015, Neural Computation.

[65]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[66]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[67]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[68]  Mark S. Goldman,et al.  A Modeling Framework for Deriving the Structural and Functional Architecture of a Short-Term Memory Microcircuit , 2013, Neuron.

[69]  A. Schwartz,et al.  Motor cortical activity during drawing movements: population representation during lemniscate tracing. , 1999, Journal of neurophysiology.

[70]  Schuster,et al.  Suppressing chaos in neural networks by noise. , 1992, Physical review letters.

[71]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[72]  R. Andersen,et al.  Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits , 2009, Neuron.

[73]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[74]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[75]  M. Goldberg,et al.  Attention, intention, and priority in the parietal lobe. , 2010, Annual review of neuroscience.