A Novel ANN-Fuzzy Formulation Towards Evolution of Efficient Clustering Algorithm

Unsupervised learning based clustering methods are gaining importance in the field of data analytics, owing to the features they possess, such as high accuracy, simple implementation and fast computation, when compared with conventional supervised learning methods. Among several types of clustering techniques, those implying optimization routines are found to be more efficient. However, explosion in number of decision variables is making these algorithms computationally intensive. The authors present an efficient two-stage optimization based fuzzy clustering formulation, which works through variable reduction approach. The membership values associated with each data point, forming the majority of decision variables, are estimated under an artificial neural networks framework. The reduction in decision variables allows the implementation of evolutionary optimization solvers to solve the single objective constrained optimization problem of fuzzy clustering increasing the chance of finding global optima. Additionally, this formulation estimates the optimal network topology and optimal number of clusters, which is not estimated rather assumed by other formulations. The proposed algorithm has been implemented on three different test data sets and the efficacy of the novel approach has been demonstrated by comparing the obtained clustering results with that of conventional fuzzy clustering approach.

[1]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[2]  Himansu Sekhar Behera,et al.  Fuzzy C-Means (FCM) Clustering Algorithm: A Decade Review from 2000 to 2014 , 2015 .

[3]  Palma Blonda,et al.  A survey of fuzzy clustering algorithms for pattern recognition. I , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Yingjie Wang FUZZY CLUSTERING ANALYSIS BY USING GENETIC ALGORITHM , 2008 .

[5]  Jiamin Li,et al.  Fuzzy Clustering Algorithms — Review of the Applications , 2016, 2016 IEEE International Conference on Smart Cloud (SmartCloud).

[6]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  S. Iniyan,et al.  Applications of fuzzy logic in renewable energy systems – A review , 2015 .

[8]  Babak Rezaee,et al.  A cluster validity index for fuzzy clustering , 2010, Fuzzy Sets Syst..

[9]  Michalis Vazirgiannis,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. On Clustering Validation Techniques , 2022 .

[10]  Singiresu S Rao Classical Optimization Techniques , 2009 .

[11]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[12]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[13]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[14]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[15]  Shokri Z. Selim,et al.  A global algorithm for the fuzzy clustering problem , 1993, Pattern Recognit..

[16]  Ching-Yi Chen,et al.  Particle swarm optimization algorithm and its application to clustering analysis , 2004, 2012 Proceedings of 17th Conference on Electrical Power Distribution.

[17]  Frank Klawonn,et al.  Fuzzy clustering with evolutionary algorithms , 1998, Int. J. Intell. Syst..

[18]  James C. Bezdek,et al.  On cluster validity for the fuzzy c-means model , 1995, IEEE Trans. Fuzzy Syst..

[19]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[20]  James C. Bezdek,et al.  Clustering with a genetically optimized approach , 1999, IEEE Trans. Evol. Comput..