Evolutionary Clustering Algorithm Using Criterion-Knowledge-Ranking for Multi-objective Optimization

There are variety of methods available to solve multi-objective optimization problems, very few utilizes criterion linkage between data objects in the searching phase, to improve final result. This article proposes an evolutionary clustering algorithm for multi-objective optimization. This paper aims to identify more relevant features based on criterion knowledge from the given data sets and also adopts neighborhood learning to improve the diversity and efficacy of the algorithm. This research is an extension of the previous work named neighborhood learning using k-means genetic algorithm (FS-NLMOGA) for multi-objective optimization which maximizes the compactness of the cluster and accuracy of the solution through constrained feature selection. The proposed objective finds the closest feature subset from the selected features of the data sets that also minimizes the cost while maintains the quality of the solution. The resultant cluster were analyzed and validated using cluster validity indexes. The proposed algorithm is tested with several UCI real-life data sets. The experimental results substantiates that the algorithm is efficient and robust .

[1]  Qiang Long,et al.  A constraint handling technique for constrained multi-objective genetic algorithm , 2014, Swarm Evol. Comput..

[2]  A. Mukhopadhyay,et al.  Clustering Ensemble: A Multiobjective Genetic Algorithm based Approach , 2013 .

[3]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[4]  Mário A. T. Figueiredo,et al.  Efficient feature selection filters for high-dimensional data , 2012, Pattern Recognit. Lett..

[5]  David Camacho,et al.  Evolutionary clustering algorithm for community detection using graph-based information , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[6]  Marco Laumanns,et al.  Computing Gap Free Pareto Front Approximations with Stochastic Search Algorithms , 2010, Evolutionary Computation.

[7]  Ujjwal Maulik,et al.  Priority based ∈ dominance: A new measure in multiobjective optimization , 2015, Inf. Sci..

[8]  Sanghamitra Bandyopadhyay,et al.  Simultaneous feature selection and symmetry based clustering using multiobjective framework , 2015, Appl. Soft Comput..

[9]  Yalan Zhou,et al.  Multiobjective optimization algorithm with objective-wise learning for continuous multiobjective problems , 2014, Journal of Ambient Intelligence and Humanized Computing.

[10]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Kalyanmoy Deb,et al.  Multi-objective Optimization , 2014 .

[12]  Jonathan E. Fieldsend,et al.  The Rolling Tide Evolutionary Algorithm: A Multiobjective Optimizer for Noisy Optimization Problems , 2015, IEEE Transactions on Evolutionary Computation.

[13]  Michael K. Ng,et al.  An Entropy Weighting k-Means Algorithm for Subspace Clustering of High-Dimensional Sparse Data , 2007, IEEE Transactions on Knowledge and Data Engineering.

[14]  Yimin Liu,et al.  Reporting and analyzing alternative clustering solutions by employing multi-objective genetic algorithm and conducting experiments on cancer data , 2014, Knowl. Based Syst..

[15]  Jian Zhuang,et al.  Novel soft subspace clustering with multi-objective evolutionary approach for high-dimensional data , 2013, Pattern Recognit..

[16]  Julio Ortega Lopera,et al.  Parallel alternatives for evolutionary multi-objective optimization in unsupervised feature selection , 2015, Expert Syst. Appl..

[17]  Kalyanmoy Deb,et al.  A dual-population paradigm for evolutionary multiobjective optimization , 2015, Inf. Sci..

[18]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[19]  Juhua Yang,et al.  Generic constraints handling techniques in constrained multi-criteria optimization and its application , 2015, Eur. J. Oper. Res..

[20]  Matthias Bernt,et al.  Refined ranking relations for selection of solutions in multi objective metaheuristics , 2015, Eur. J. Oper. Res..

[21]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Kyriakos C. Giannakoglou,et al.  Multilevel Optimization Algorithms Based on Metamodel- and Fitness Inheritance-Assisted Evolutionary Algorithms , 2010 .

[23]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[24]  Carlos A. Coello Coello,et al.  Multiobjective Evolutionary Algorithms in Aeronautical and Aerospace Engineering , 2012, IEEE Transactions on Evolutionary Computation.

[25]  Pierluigi Siano,et al.  Optimal allocation of wind turbines in microgrids by using genetic algorithm , 2013, J. Ambient Intell. Humaniz. Comput..

[26]  Hui-Huang Hsu,et al.  Hybrid feature selection by combining filters and wrappers , 2011, Expert Syst. Appl..

[27]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[28]  Mahantapas Kundu,et al.  A genetic algorithm based region sampling for selection of local features in handwritten digit recognition application , 2012, Appl. Soft Comput..

[29]  Jose Miguel Puerta,et al.  Fast wrapper feature subset selection in high-dimensional datasets by means of filter re-ranking , 2012, Knowl. Based Syst..

[30]  Carlos A. Coello Coello,et al.  Multi-objective Evolutionary Algorithms in Real-World Applications: Some Recent Results and Current Challenges , 2015 .

[31]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[32]  Hani Hamdan,et al.  Interval data clustering using self-organizing maps based on adaptive Mahalanobis distances , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[33]  Ujjwal Maulik,et al.  An Interactive Approach to Multiobjective Clustering of Gene Expression Patterns , 2013, IEEE Transactions on Biomedical Engineering.

[34]  Alvaro Garcia-Piquer,et al.  Large-Scale Experimental Evaluation of Cluster Representations for Multiobjective Evolutionary Clustering , 2014, IEEE Transactions on Evolutionary Computation.

[35]  Carlos A. Coello Coello,et al.  Including preferences into a multiobjective evolutionary algorithm to deal with many-objective engineering optimization problems , 2014, Inf. Sci..

[36]  Kalyanmoy Deb,et al.  Unwanted Feature Interactions Between the Problem and Search Operators in Evolutionary Multi-objective Optimization , 2015, EMO.

[37]  Camille Roth,et al.  Natural Scales in Geographical Patterns , 2017, Scientific Reports.

[38]  Xiangyu Wang,et al.  A genetic algorithm for unconstrained multi-objective optimization , 2015, Swarm Evol. Comput..

[39]  Peter J. Fleming,et al.  General framework for localised multi-objective evolutionary algorithms , 2014, Inf. Sci..

[40]  Nur Evin Özdemirel,et al.  An adaptive neighbourhood construction algorithm based on density and connectivity , 2015, Pattern Recognit. Lett..

[41]  Victor J. Rayward-Smith,et al.  A Novel Multi-Objective Genetic Algorithm for Clustering , 2011, IDEAL.

[42]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[44]  Wenhua Zeng,et al.  A New Local Search-Based Multiobjective Optimization Algorithm , 2015, IEEE Transactions on Evolutionary Computation.

[45]  Manoranjan Dash,et al.  Dimensionality reduction of unsupervised data , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[46]  Habibollah Haron,et al.  The review of multiple evolutionary searches and multi-objective evolutionary algorithms , 2013, Artificial Intelligence Review.

[47]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[48]  Yinzhen Li,et al.  An oriented spanning tree based genetic algorithm for multi-criteria shortest path problems , 2012, Appl. Soft Comput..

[49]  Emiliano Carreño Jara.  Multi-Objective Optimization by Using Evolutionary Algorithms: The $p$-Optimality Criteria , 2014, IEEE Trans. Evol. Comput..

[50]  Qingfu Zhang,et al.  Adaptive Operator Selection With Bandits for a Multiobjective Evolutionary Algorithm Based on Decomposition , 2014, IEEE Transactions on Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[52]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[53]  Kaisa Miettinen,et al.  An Interactive Evolutionary Multiobjective Optimization Method: Interactive WASF-GA , 2015, EMO.

[54]  M. Anusha,et al.  An enhanced K-means genetic algorithms for optimal clustering , 2014, 2014 IEEE International Conference on Computational Intelligence and Computing Research.

[55]  Ujjwal Maulik,et al.  Multiobjective Genetic Algorithms for Clustering - Applications in Data Mining and Bioinformatics , 2011 .

[56]  Ganapati Panda,et al.  A survey on nature inspired metaheuristic algorithms for partitional clustering , 2014, Swarm Evol. Comput..