Compensation type algorithms for neural nets: stability and convergence

Plasticity of synaptic connections plays an important role in the temporal development of neural networks which are the basis of memory and behavior. The conditions for successful functional performance of these nerve nets have to be either guaranteed genetically or developed during ontogenesis. In the latter case, a general law of this development may be the successive compensation of disturbances. A compensation type algorithm is analyzed here that changes the connectivity of a given network such that deviations from each neuron's equilibrium state are reduced. The existence of compensated networks is proven, the convergence and stability of simulations are investigated, and implications for cognitive systems are discussed.

[1]  W Dames,et al.  Induction and maintenance of free postsynaptic membrane thickenings in the adult superior cervical ganglion , 1979, Journal of neurocytology.

[2]  Carme Torras I Genis.  Temporal-Pattern Learning in Neural Models , 1985 .

[3]  M. Todd.  The Computation of Fixed Points and Applications , 1976 .

[4]  E. Allgower,et al.  Simplicial and Continuation Methods for Approximating Fixed Points and Solutions to Systems of Equations , 1980 .

[5]  G. Wagner,et al.  Self-Organization in Synaptogenesis: Interaction Between the Formation of Excitatory and Inhibitory Synapses , 1983 .

[6]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[7]  J. Changeux,et al.  Selective stabilisation of developing synapses as a mechanism for the specification of neuronal networks , 1976, Nature.

[8]  C. Malsburg.  Nervous Structures with Dynamical Links , 1985 .

[9]  M. Jacobson,et al.  Development of specific neuronal connections. , 1969, Science.

[10]  G. Wagner,et al.  ON THE PROPERTIES OF RANDOMLY CONNECTED McCULLOCH-PITTS NETWORKS: DIFFERENCES BETWEEN INPUT-CONSTANT AND INPUT-VARIANT NETWORKS , 1984 .

[11]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[12]  W Dames,et al.  Effect of prolonged sodium bromide administration on the fine structure of dendrites in the superior cervical ganglion of adult rat. , 1979, Progress in brain research.

[13]  Werner Reichardt,et al.  Processing of optical information by the visual system of the fly , 1986, Vision Research.

[14]  J. W. Clark,et al.  Self-organization of neural networks , 1984 .