Consecutive and non-consecutive heteroclinic cycles in Hopfield networks

ABSTRACT We review and extend the previous work where a model was introduced for Hopfield-type neural networks, which allows for the existence of heteroclinic dynamics between steady patterns. This dynamics is a mathematical model of periodic or aperiodic switching between stored information items in the brain, in particular, in the context of sequential memory or cognitive tasks as observed in experiments. The basic question addressed in this work is whether, given a sequence of steady patterns, it is possible by applying classical learning rules to build a matrix of connections between neurons in the network, such that a heteroclinic dynamics links these patterns. It has been shown previously that the answer is positive in the case where the sequence is a so-called simple consecutive cycle. We show that on the contrary the answer is negative for a non-simple cycle: heteroclinic dynamics does still exist; however, it cannot follow the sequence of patterns from which the connectivity matrix was derived.

[1]  Chuan Zhang,et al.  Storing cycles in Hopfield-type networks with pseudoinverse learning rule: Admissibility and network topology , 2012, Neural Networks.

[2]  L. Personnaz,et al.  Collective computational properties of neural networks: New learning mechanisms. , 1986, Physical review. A, General physics.

[3]  Nicolas Brunel,et al.  Semantic Priming in a Cortical Network Model , 2009, Journal of Cognitive Neuroscience.

[4]  A. Selverston,et al.  Robust Microcircuit Synchronization by Inhibitory Connections , 2009, Neuron.

[5]  Pascal Chossat,et al.  Heteroclinic Cycles in Hopfield Networks , 2014, J. Nonlinear Sci..

[6]  A. Selverston,et al.  Dynamical principles in neuroscience , 2006 .

[7]  Tomoki Fukai,et al.  A Simple Neural Network Exhibiting Selective Activation of Neuronal Ensembles: From Winner-Take-All to Winners-Share-All , 1997, Neural Computation.

[8]  Christian Bick,et al.  Dynamical origin of the effective storage capacity in the brain's working memory. , 2009, Physical review letters.

[9]  G. Hartmann,et al.  Parallel Processing in Neural Systems and Computers , 1990 .

[10]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Vivien Kirk,et al.  Robust heteroclinic and switching dynamics , 2010 .

[12]  G. Dangelmayr,et al.  Storing Cycles in Hopfield-type Networks with Pseudoinverse Learning Rule - Retrievability and Bifurcation Analysis , 2013, 1308.5201.