Unsupervised fuzzy clustering using weighted incremental neural networks

A new more efficient variant of a recently developed algorithm for unsupervised fuzzy clustering is introduced. A Weighted Incremental Neural Network (WINN) is introduced and used for this purpose. The new approach is called FC-WINN (Fuzzy Clustering using WINN). The WINN algorithm produces a net of nodes connected by edges, which reflects and preserves the topology of the input data set. Additional weights, which are proportional to the local densities in input space, are associated with the resulting nodes and edges to store useful information about the topological relations in the given input data set. A fuzziness factor, proportional to the connectedness of the net, is introduced in the system. A watershed-like procedure is used to cluster the resulting net. The number of the resulting clusters is determined by this procedure. Only two parameters must be chosen by the user for the FC-WINN algorithm to determine the resolution and the connectedness of the net. Other parameters that must be specified are those which are necessary for the used incremental neural network, which is a modified version of the Growing Neural Gas algorithm (GNG). The FC-WINN algorithm is computationally efficient when compared to other approaches for clustering large high-dimensional data sets.

[1]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[3]  John R. Rice,et al.  A neuro-fuzzy approach to agglomerative clustering , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[4]  Belur V. Dasarathy,et al.  Nearest neighbor (NN) norms: NN pattern classification techniques , 1991 .

[5]  A. Roli Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[6]  Andreas StafylopatisNational Real-coded Genetic Optimization of Fuzzy Clustering , 1996 .

[7]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[9]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[10]  Bernd Fritzke,et al.  Incremental neuro-fuzzy systems , 1997, Optics & Photonics.

[11]  M. Roubens Fuzzy clustering algorithms and their cluster validity , 1982 .

[12]  H. Muhammed,et al.  Feature vector based analysis of hyperspectral crop reflectance data for discrimination and quantification of fungal disease severity in wheat , 2003 .

[13]  Hamed Hamid Muhammed,et al.  Unsupervised fuzzy clustering and image segmentation using weighted neural networks , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[14]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition : methods that search for structures in data , 1992 .

[15]  Hamed Hamid Muhammed,et al.  Using Weighted Fixed Neural Networks for Unsupervised Fuzzy Clustering , 2002, Int. J. Neural Syst..

[16]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[17]  Bernd Fritzke Growing self-organizing networks - Why ? , 1996, ESANN.

[18]  Elias N. Houstis,et al.  On neurobiological, neuro-fuzzy, machine learning, and statistical pattern recognition techniques , 1997, IEEE Trans. Neural Networks.

[19]  Kenneth G. Manton,et al.  Fuzzy Cluster Analysis , 2005 .

[20]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[21]  Bernd Fritzke,et al.  A Self-Organizing Network that Can Follow Non-stationary Distributions , 1997, ICANN.

[22]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[23]  J. C. Peters,et al.  Fuzzy Cluster Analysis : A New Method to Predict Future Cardiac Events in Patients With Positive Stress Tests , 1998 .

[24]  Esa Alhoniemi,et al.  Clustering of the self-organizing map , 2000, IEEE Trans. Neural Networks Learn. Syst..