A self-organizing network for hyperellipsoidal clustering (HEC)

We propose a self-organizing network (HEC) for hyper-ellipsoidal clustering. The HEC network performs a partitional clustering using the regularized Mahalanobis distance. This regularized Mahalanobis distance measure is proposed to deal with the problems in estimating the Mahalanobis distance when the number of patterns in a cluster is less than (ill-posed problem) or not considerably larger than (poorly-posed problem) the dimensionality of the feature space in clustering multidimensional data. This regularized distance also achieves a tradeoff between hyperspherical and hyperellipsoidal cluster shapes so as to prevent the HEC network from producing unusually large or unusually small clusters. The significance level of the Kolmogrov-Smirnov test on the distribution of the Mahalanobis distances of patterns in a cluster to the cluster center under the multivariate Gaussian assumption is used as a measure of cluster compactness. The HEC network has been tested on a number of artificial data sets and real data sets. Experiments show that the HEC network gives better clustering results compared to the well-known K-means algorithm with the Euclidean distance metric.<<ETX>>

[1]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[2]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[3]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[4]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[5]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[6]  J. Rubner,et al.  A Self-Organizing Network for Principal-Component Analysis , 1989 .

[7]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[8]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[9]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[10]  Anil K. Jain,et al.  Discriminant analysis neural networks , 1993, IEEE International Conference on Neural Networks.