Hierarchical FCM in a stepwise discovery of structure in data

This paper is concerned with a stepwise mode of objective function-based fuzzy clustering. A revealed structure in data becomes refined in a successive manner by starting with the most dominant relationships and proceeding with its more detailed characterization. Technically, the proposed process develops a so-called hierarchy of clusters. Given the underlying clustering mechanism of the fuzzy C means (FCM), the produced architecture is referred to as a hierarchical FCM or hierarchical FCM tree (HFCM tree). We discuss the design of the tree demonstrating how its growth is guided by a certain mapping criterion. It is also shown how a structure at the higher level is effectively used to build clusters at the consecutive level by making use of the conditional FCM. Detailed investigations of computational complexity contrast a stepwise development of clusters with a single-step clustering completed for the equivalent number of clusters occurring in total at all final nodes of the HFCM tree. The analysis quantifies a significant reduction of the stepwise refinement of the clusters. Experimental studies include synthetic data as well as those coming from the machine learning repository.

[1]  J. C. Peters,et al.  Fuzzy cluster analysis--a new method to predict future cardiac events in patients with positive stress tests. , 1998, Japanese circulation journal.

[2]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[3]  Lawrence O. Hall,et al.  Fast clustering with application to fuzzy rule generation , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[4]  Kenneth G. Manton,et al.  Fuzzy Cluster Analysis , 2005 .

[5]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[6]  Arnaud Devillez,et al.  A fuzzy hybrid hierarchical clustering method with a new criterion able to find the optimal partition , 2002, Fuzzy Sets Syst..

[7]  Antonio F. Gómez-Skarmeta,et al.  On the use of hierarchical clustering in fuzzy modeling , 1996, Int. J. Approx. Reason..

[8]  Gail A. Carpenter,et al.  S-TREE: self-organizing trees for data clustering and online vector quantization , 2001, Neural Networks.

[9]  Rita Cucchiara,et al.  Building the Topological Tree by recursive FCM color clustering , 2002, Object recognition supported by user interaction for service robots.

[10]  Hujun Yin,et al.  Adaptive topological tree structure for document organisation and visualisation , 2004, Neural Networks.

[11]  William Equitz,et al.  A new vector quantization clustering algorithm , 1989, IEEE Trans. Acoust. Speech Signal Process..

[12]  David G. Stork,et al.  Pattern Classification , 1973 .

[13]  Witold Pedrycz,et al.  Conditional fuzzy clustering in the design of radial basis function neural networks , 1998, IEEE Trans. Neural Networks.

[14]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[15]  Antonio F. Gómez-Skarmeta,et al.  About the use of fuzzy clustering techniques for fuzzy model identification , 1999, Fuzzy Sets Syst..

[16]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[17]  Frank Höppner Speeding up fuzzy c-means: using a hierarchical data organisation to control the precision of membership calculation , 2002, Fuzzy Sets Syst..