ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures

Abstract A model to implement parallel search of compressed or distributed pattern recognition codes in a neural network hierarchy is introduced. The search process functions well with either fast learning or slow learning, and can robustly cope with sequences of asynchronous input patterns in real-time. The search process emerges when computational properties of the chemical synapse, such as transmitter accumulation, release, inactivation, and modulation, are embedded within an Adaptive Resonance Theory architecture called ART 3. Formal analogs of ions such as Na− and Ca2− control nonlinear feedback interactions that enable presynaptic transmitter dynamics to model the postsynaptic short-term memory representation of a pattern recognition code. Reinforcement feedback can modulate the search process by altering the ART 3 vigilance parameter or directly engaging the search mechanism. The search process is a form of hypothesis testing capable of discovering appropriate representations of a nonstationary input environment.

[1]  R. A. Davidoff From Neuron to Brain , 1977, Neurology.

[2]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[3]  S. Grossberg Studies of mind and brain : neural principles of learning, perception, development, cognition, and motor control , 1982 .

[4]  GrossbergS. Adaptive pattern classification and universal recoding , 1976 .

[5]  S. Grossberg Neural Networks and Natural Intelligence , 1988 .

[6]  S. Grossberg Some Psychophysiological and Pharmacological Correlates of A Developmental, Cognitive, and Motivational Theory , 1987 .

[7]  B. L. Ginsborg From Neuron to Brain, 2nd edition. Edited by S. W. Kuffler, J. G. Nicholls and A. R. Martin. Pp. 651. (Blackwell Scientific Publications, 1984.) £14.80 Paperback , 1985 .

[8]  S. Grossberg,et al.  Search mechanisms for adaptive resonance theory (ART) architectures , 1989, International 1989 Joint Conference on Neural Networks.

[9]  伊藤 正男 The cerebellum and neural control , 1984 .

[10]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[11]  Stephen Grossberg,et al.  Speech Perception and Production by a Self-Organizing Neural Network. , 1987 .

[12]  Masao Ito The Cerebellum And Neural Control , 1984 .

[13]  S. Grossberg Processing of expected and unexpected events during conditioning and attention: a psychophysiological theory. , 1982, Psychological review.

[14]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[15]  J. Nicholls From neuron to brain , 1976 .

[16]  S. Grossberg,et al.  ART 2: self-organization of stable category recognition codes for analog input patterns. , 1987, Applied optics.

[17]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[18]  S. Grossberg Some Psychophysiological and Pharmacological Correlates of a Developmental, Cognitive and Motivational Theory a , 1984, Annals of the New York Academy of Sciences.

[19]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement. , 1987, Applied optics.