Positive and negative circuits in discrete neural networks

We study the relationships between the positive and negative circuits of the connection graph and the fixed points of discrete neural networks (DNNs). As main results, we give necessary conditions and sufficient conditions for the existence of fixed points in a DNN. Moreover, we exhibit an upper bound for the number of fixed points in terms of the structure and number of positive circuits in the connection graph. This allows the determination of the maximum capacity for storing vectors in DNNs as fixed points, depending on the architecture of the network.

[1]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.

[2]  E. Álvarez-Buylla,et al.  Dynamics of the genetic regulatory network for Arabidopsis thaliana flower morphogenesis. , 1998, Journal of theoretical biology.

[3]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[4]  R. Thomas,et al.  Positive feedback loops and multistationarity , 1988, Discret. Appl. Math..

[5]  Eric Goles Ch.,et al.  Discrete State Neural Networks and Energies , 1997, Neural Networks.

[6]  M Kaufman,et al.  Positive feedback circuits and memory. , 2000, Comptes rendus de l'Academie des sciences. Serie III, Sciences de la vie.

[7]  R. Thomas,et al.  The role of feedback circuits: Positive feedback circuits are a necessary condition for positive real eigenvalues of the Jacobian matrix , 1994 .

[8]  Frank Harary,et al.  Graph Theory , 2016 .

[9]  Eric Goles,et al.  Neural and automata networks , 1990 .

[10]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[11]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[12]  C. Berge.  Graphes et hypergraphes , 1970 .

[13]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[14]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[15]  J. Demongeot,et al.  POSITIVE REGULATION CIRCUITS AND MEMORY , 1999 .

[16]  Teuvo Kohonen,et al.  An introduction to neural computing , 1988, Neural Networks.

[17]  L. B. Litinskii,et al.  Direct calculation of the stable points of a neural network , 1994 .

[18]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[19]  Eric Goles Ch.,et al.  Dynamical Properties of Min-Max Networks , 2000, Int. J. Neural Syst..

[20]  J. Demongeot,et al.  Positive and negative feedback: striking a balance between necessary antagonists. , 2002, Journal of theoretical biology.

[21]  El Houssine Snoussi.  Necessary Conditions for Multistationarity and Stable Periodicity , 1998 .