A Comparative Study of Self-organizing Clustering Algorithms Dignet and ART2

A comparative study of two self-organizing clustering neural network algorithms, Dignet and ART2, has been conducted. The differences in architecture and learning procedures between the two models are compared. Comparative computer simulations on data clustering and signal detection problems with Gaussian noise were used for investigating the performance of Dignet and "fast learning" ART2. The study shows that Dignet, with a simple architecture and straightforward dynamics, is more flexible with the choice of different metrics for the measure of similarity. The system parameters in Dignet can be analytically determined from a self-adjusting process; moreover, the initial threshold value used in Dignet is directly determined from a lower-bound of the desirable operational signal-to-noise ratio. Simulations show that Dignet generally exhibits faster learning and better clustering performance on statistical pattern recognition problems. A simplified ART2 model (SART2) is derived by adopting the structural concepts from Dignet. SART2 exhibits faster learning and eliminates a "false conviction" problem that exists in the "fast learning" ART2. The comparative study is benchmarked against statistical data clustering and signal detection problems. Copyright 1997 Elsevier Science Ltd.

[1]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[3]  Laura Ignizio Burke,et al.  Clustering characterization of adaptive resonance , 1991, Neural Networks.

[4]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[5]  James C. Bezdek,et al.  Generalized clustering networks and Kohonen's self-organizing scheme , 1993, IEEE Trans. Neural Networks.

[6]  Stelios C. A. Thomopoulos,et al.  Clustering with unsupervised neural networks with applications to data fusion , 1994, Other Conferences.

[7]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[8]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[9]  Stelios C. A. Thomopoulos,et al.  DIGNET: A self-organizing neural network for automatic pattern recognition and classification , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[10]  Stelios C. A. Thomopoulos,et al.  DIGNET: a self-organizing neural network for automatic pattern recognition, classification, and data fusion , 1992, Other Conferences.

[11]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[12]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[13]  Stelios C. A. Thomopoulos,et al.  Dignet: an unsupervised-learning clustering algorithm for clustering and data fusion , 1995 .

[14]  Stephen Grossberg,et al.  ART 2-A: An adaptive resonance algorithm for rapid category learning and recognition , 1991, Neural Networks.

[15]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[16]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[17]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[18]  Robert J. Schalkoff,et al.  Pattern recognition - statistical, structural and neural approaches , 1991 .

[19]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .