A new approach to clustering data with arbitrary shapes

In this paper we propose a clustering algorithm to cluster data with arbitrary shapes without knowing the number of clusters in advance. The proposed algorithm is a two-stage algorithm. In the first stage, a neural network incorporated with an ART-like training algorithm is used to cluster data into a set of multi-dimensional hyperellipsoids. At the second stage, a dendrogram is built to complement the neural network. We then use dendrograms and so-called tables of relative frequency counts to help analysts to pick some trustable clustering results from a lot of different clustering results. Several data sets were tested to demonstrate the performance of the proposed algorithm.

[1]  Mu-Chun Su,et al.  Application of neural networks in cluster analysis , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[2]  Mu-Chun Su,et al.  Application of neural networks using quadratic junctions in cluster analysis , 2001, Neurocomputing.

[3]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[4]  Chien-Hsing Chou,et al.  Short Papers , 2001 .

[5]  J. A. Rose.  Artifical Intelligence Through Prolog by Neils Rowe Prentice-Hall, Englewood Cliffs, New Jersey, U.S.A., 1988 (£15.95) , 1988, Robotica.

[6]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[8]  Jongwoo Kim,et al.  A note on the Gustafson-Kessel and adaptive fuzzy clustering algorithms , 1999, IEEE Trans. Fuzzy Syst..

[9]  James C. Bezdek,et al.  Fuzzy mathematics in pattern classification , 1973 .

[10]  Guszti Bartfai,et al.  An ART-based modular architecture for learning hierarchical clusterings , 1996, Neurocomputing.

[11]  Rajesh N. Dave,et al.  Use Of The Adaptive Fuzzy Clustering Algorithm To Detect Lines In Digital Images , 1990, Other Conferences.

[12]  G. Bartfai,et al.  Learning and optimisation of hierarchical clusterings with ART-based modular networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[13]  Isak Gath,et al.  Data induced metric and fuzzy clustering of non-convex patterns of arbitrary shape , 1997, Pattern Recognit. Lett..

[14]  G. Krishna,et al.  Agglomerative clustering using the concept of mutual nearest neighbourhood , 1978, Pattern Recognit..

[15]  Amir B. Geva,et al.  Hierarchical unsupervised fuzzy clustering , 1999, IEEE Trans. Fuzzy Syst..

[16]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[17]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  S. Grossberg,et al.  Fuzzy ART: an adaptive resonance algorithm for rapid, stable classification of analog patterns , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[19]  Roger White,et al.  Adaptive Resonance Theory-based Modular Networks for Incremental Learning of Hierarchical Clusterings , 1997, Connect. Sci..

[20]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[21]  Anil K. Jain,et al.  A self-organizing network for hyperellipsoidal clustering (HEC) , 1996, IEEE Trans. Neural Networks.

[22]  Yukihiro Matsubara,et al.  arboART: ART based hierarchical clustering and its application to questionnaire data analysis , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[23]  Anil K. Jain,et al.  A nonlinear projection method based on Kohonen's topology preserving maps , 1995, IEEE Trans. Neural Networks.

[24]  R. Davé.  FUZZY SHELL-CLUSTERING AND APPLICATIONS TO CIRCLE DETECTION IN DIGITAL IMAGES , 1990 .

[25]  F. Klawonn,et al.  Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition , 1999 .

[26]  Mu-Chun Su,et al.  A new model of self-organizing neural networks and its application in data projection , 2001, IEEE Trans. Neural Networks.

[27]  Chien-Hsing Chou,et al.  A Competitive Learning Algorithm Using Symmetry , 1999 .

[28]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[29]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[30]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[31]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[32]  Charles T. Zahn,et al.  Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters , 1971, IEEE Transactions on Computers.

[33]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[34]  Narendra Ahuja,et al.  Extraction of early perceptual structure in dot patterns: Integrating region, boundary, and component gestalt , 1989, Comput. Vis. Graph. Image Process..

[35]  Fionn Murtagh,et al.  Interpreting the Kohonen self-organizing feature map using contiguity-constrained clustering , 1995, Pattern Recognit. Lett..

[36]  Rui J. P. de Figueiredo,et al.  A new neural network for cluster-detection-and-labeling , 1998, IEEE Trans. Neural Networks.