A multi-clustering method based on evolutionary multiobjective optimization with grid decomposition

Abstract At present, it is a challenging task to determine the number of clusters (k), which has a great impact on the quality of major clustering methods. Multi-objective evolutionary algorithms (MOEAs), which determines k value adaptively, have been widely adopted for clustering. However, when the range of k becomes increasingly large, Pareto Front (PF) approximations obtained by an MOEA may not be uniformly distributed, leading to the difficulty of obtaining the optimal k value for clustering. For this reason, an MOEA base on constrained decomposition with grids (CCDG-K) is designed for clustering and better identify the optimal k value. CCDG-K adopts a grid system for decomposition. The grid system has an inherent property of reserving diversely populated solutions, which is very desirable for clustering. The experimental studies show that CCDG-K can deliver solutions of all k values which is of great help for obtaining the optimal k value. The experimental results also indicate that CCDG-K outperforms other algorithms in clustering.

[1]  Michael K. Ng,et al.  A fuzzy k-modes algorithm for clustering categorical data , 1999, IEEE Trans. Fuzzy Syst..

[2]  R. J. Sassi,et al.  Application of a neuro fuzzy network in prediction of absenteeism at work , 2012, 7th Iberian Conference on Information Systems and Technologies (CISTI 2012).

[3]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Clustering , 2015, ACM Comput. Surv..

[4]  D. Defays,et al.  An Efficient Algorithm for a Complete Link Method , 1977, Comput. J..

[5]  Daxin Tian,et al.  Fuzzy neural network structure identification based on soft competitive learning , 2007, Int. J. Hybrid Intell. Syst..

[6]  Qingfu Zhang,et al.  The Collaborative Local Search Based on Dynamic-Constrained Decomposition With Grids for Combinatorial Multiobjective Optimization , 2019, IEEE Transactions on Cybernetics.

[7]  Anil K. Jain Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[8]  Hisao Ishibuchi,et al.  Multi-clustering via evolutionary multi-objective optimization , 2018, Inf. Sci..

[9]  R. C. de Amorim,et al.  Constrained Intelligent K-Means: Improving Results with Limited Previous Knowledge. , 2008 .

[10]  Philip S. Yu,et al.  A General Model for Multiple View Unsupervised Learning , 2008, SDM.

[11]  Ponnuthurai N. Suganthan,et al.  Heterogeneous oblique random forest , 2020, Pattern Recognit..

[12]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[13]  Alex Alves Freitas,et al.  A hyper-heuristic evolutionary algorithm for automatically designing decision-tree algorithms , 2012, GECCO '12.

[14]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[15]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[16]  Eduardo Freire Nakamura,et al.  Feature subset selection for automatically classifying anuran calls using sensor networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[17]  Shahin Rostami,et al.  CMA-PAES: Pareto archived evolution strategy using covariance matrix adaptation for Multi-Objective Optimisation , 2012, 2012 12th UK Workshop on Computational Intelligence (UKCI).

[18]  Eckart Zitzler,et al.  Handling Uncertainty in Indicator-Based Multiobjective Optimization , 2006 .

[19]  Xinye Cai,et al.  A Decomposition-Based Many-Objective Evolutionary Algorithm With Two Types of Adjustments for Direction Vectors , 2018, IEEE Transactions on Cybernetics.

[20]  Evan J. Hughes,et al.  MSOPS-II: A general-purpose Many-Objective optimiser , 2007, 2007 IEEE Congress on Evolutionary Computation.

[21]  Qingfu Zhang,et al.  A Constrained Decomposition Approach With Grids for Evolutionary Multiobjective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[22]  Chih-Cheng Hung,et al.  Bi-MOCK: A Multi-objective Evolutionary Algorithm for Bi-clustering with Automatic Determination of the Number of Bi-clusters , 2017, ICONIP.

[23]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[24]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[25]  Joshua D. Knowles,et al.  An Evolutionary Approach to Multiobjective Clustering , 2007, IEEE Transactions on Evolutionary Computation.

[26]  Qingfu Zhang,et al.  Decomposition-Based-Sorting and Angle-Based-Selection for Evolutionary Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Cybernetics.

[27]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[28]  Shini Renjith,et al.  A personalized mobile travel recommender system using hybrid algorithm , 2014, 2014 First International Conference on Computational Systems and Communications (ICCSC).

[29]  Hae-Sang Park,et al.  A simple and fast algorithm for K-medoids clustering , 2009, Expert Syst. Appl..

[30]  Qingfu Zhang,et al.  An External Archive Guided Multiobjective Evolutionary Algorithm Based on Decomposition for Combinatorial Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[31]  Mitsuo Gen,et al.  Specification of Genetic Search Directions in Cellular Multi-objective Genetic Algorithms , 2001, EMO.

[32]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[33]  Xiaowei Yu,et al.  Finding Similar Time Series in Sales Transaction Data , 2015, IEA/AIE.

[34]  Qingfu Zhang,et al.  A Grid Weighted Sum Pareto Local Search for Combinatorial Multi and Many-Objective Optimization , 2019, IEEE Transactions on Cybernetics.

[35]  A. C. Lisboa,et al.  A Multi-Objective Evolutionary Algorithm Based on Decomposition for Optimal Design of Yagi-Uda Antennas , 2012, IEEE Transactions on Magnetics.

[36]  Francisco Luna,et al.  MOCell: A cellular genetic algorithm for multiobjective optimization , 2009 .

[37]  Enrique Alba,et al.  A comparative study of the effect of parameter scalability in multi-objective metaheuristics , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[38]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[39]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Clustering , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[40]  Bo Jiang,et al.  Evolutionary multi-objective optimization for multi-view clustering , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[41]  Yu Xue,et al.  Immune clonal algorithm based on directed evolution for multi-objective capacitated arc routing problem , 2016, Appl. Soft Comput..

[42]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[43]  J. David Schaffer,et al.  Multi-Objective Learning via Genetic Algorithms , 1985, IJCAI.

[44]  E. Hughes Multiple single objective Pareto sampling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[45]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[46]  Haoran Sun,et al.  A diversity indicator based on reference vectors for many-objective optimization , 2018, Inf. Sci..