Self-Organizing Neural Networks for Supervised and Unsupervised Learning and Prediction

A neural network architecture for fast, stable, incremental learning of recognition categories and multidimensional maps is described. The architecture, called fuzzy ARTMAP, achieves a synthesis of fuzzy logic and Adaptive Resonance Theory (ART) neural networks. Fuzzy ARTMAP realizes a Minimax Learning Rule that conjointly minimizes predictive error and maximizes code compression. The system automatically learns a minimal number of recognition categories, or “hidden units”, to meet accuracy criteria, and the final code can include both fine and coarse categories. At each learning stage, system weights may be translated into a set of if-then rules that characterize the decision making process. Prediction is improved by training the system several times using different orderings of the input set, then voting on the outcomes. ART and ARTMAP networks are being applied to problems such as medical prediction, airplane design, electrocardiogram analysis, seismic recognition, adaptive software, and radar scene analysis.

[1]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[2]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[4]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[5]  S. Grossberg.  Studies of mind and brain : neural principles of learning, perception, development, cognition, and motor control , 1982 .

[6]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Bart Kosko,et al.  Fuzzy entropy and conditioning , 1986, Inf. Sci..

[9]  Stephen Grossberg,et al.  Neural dynamics of adaptive sensory-motor control : ballistic eye movements , 1986 .

[10]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[11]  S. Grossberg,et al.  Neural Dynamics of Category Learning and Recognition: Attention, Memory Consolidation, and Amnesia , 1987 .

[12]  S Grossberg,et al.  Masking fields: a massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. , 1987, Applied optics.

[13]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[14]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[15]  Stephen Grossberg,et al.  Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. , 1986, Human neurobiology.

[16]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[17]  S. Grossberg.  Neural Networks and Natural Intelligence , 1988 .

[18]  Geoffrey E. Hinton,et al.  Proceedings of the 1988 Connectionist Models Summer School , 1989 .

[19]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[20]  Steven L. Salzberg,et al.  Learning with Nested Generalized Exemplars , 1990 .

[21]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[22]  Robert O. Gjerdingen,et al.  Categorization of Musical Patterns by Self-Organizing Neuronlike Networks , 1990 .

[23]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[24]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[25]  Allen M. Waxman,et al.  Visual learning, adaptive expectations, and behavioral conditioning of the mobile robot MAVIN , 1991, Neural Networks.

[26]  S. Grossberg,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1991 .

[27]  S. Grossberg,et al.  Neural networks for vision and image processing , 1992 .

[28]  Allen M. Waxman,et al.  Learning and Recognizing 3D Objects from Multiple Views in a Neural System , 1992 .

[29]  S. Grossberg,et al.  A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. , 1992, Brain research. Cognitive brain research.

[30]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.