Multiobjective Particle Swarm Optimization for Feature Selection With Fuzzy Cost

Feature selection (FS) is an important data processing technique in the field of machine learning. There have been various FS methods, but all assume that the cost associated with a feature is precise, which restricts their real applications. Focusing on the FS problem with fuzzy cost, a fuzzy multiobjective FS method with particle swarm optimization, called PSOMOFS, is studied in this article. The proposed method develops a fuzzy dominance relationship to compare the goodness of candidate particles and defines a fuzzy crowding distance measure to prune the elitist archive and determine the global leader of particles. Also, a tolerance coefficient is introduced into the proposed method to ensure that the Pareto-optimal solutions obtained satisfy decision makers’ preferences. The developed method is used to tackle a series of the UCI datasets and is compared with three fuzzy multiobjective evolutionary methods and three typical multiobjective FS methods. Experimental results show that the proposed method can achieve feature sets with superior performances in approximation, diversity, and feature cost.

[1]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[2]  B. Bose,et al.  Evaluation of membership functions for fuzzy logic controlled induction motor drive , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[3]  Yong Xia,et al.  A tribe competition-based genetic algorithm for feature selection in pattern classification , 2017, Appl. Soft Comput..

[4]  Mengjie Zhang,et al.  A New Representation in PSO for Discretisation-Based Feature Selection , 2017 .

[5]  Chong Wang,et al.  Hybrid reliability analysis and optimization for spacecraft structural system with random and fuzzy parameters , 2018 .

[6]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[7]  Hao Zhang,et al.  Cooperative Artificial Bee Colony Algorithm With Multiple Populations for Interval Multiobjective Optimization Problems , 2019, IEEE Transactions on Fuzzy Systems.

[8]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[9]  Sanjib Ganguly,et al.  Multi-objective particle swarm optimization based on fuzzy-Pareto-dominance for possibilistic planning of electrical distribution systems incorporating distributed generation , 2013, Fuzzy Sets Syst..

[10]  Taher Niknam,et al.  A novel Multi‐objective Fuzzy Adaptive Chaotic PSO algorithm for Optimal Operation Management of distribution network with regard to fuel cell power plants , 2011 .

[11]  Sanjib Ganguly,et al.  Fuzzy-Pareto-dominance driven possibilistic model based planning of electrical distribution systems using multi-objective particle swarm optimization , 2012, Expert Syst. Appl..

[12]  Hui Yin,et al.  Possibility-based robust design optimization for the structural-acoustic system with fuzzy parameters , 2018 .

[13]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[14]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[15]  Verónica Bolón-Canedo,et al.  A framework for cost-based feature selection , 2014, Pattern Recognit..

[16]  Mengjie Zhang,et al.  A multi-objective particle swarm optimisation for filter-based feature selection in classification problems , 2012, Connect. Sci..

[17]  Amin Alizadeh Naeini,et al.  Particle Swarm Optimization for Object-Based Feature Selection of VHSR Satellite Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[18]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[19]  Sarunas Raudys,et al.  On Understanding and Assessing Feature Selection Bias , 2005, AIME.

[20]  Tomasz Lukaszuk,et al.  The feature selection bias problem in relation to high-dimensional gene data , 2016, Artif. Intell. Medicine.

[21]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[22]  Jian Cheng,et al.  Multi-Objective Particle Swarm Optimization Approach for Cost-Based Feature Selection in Classification , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[23]  Yong Luo,et al.  Cost-Sensitive Feature Selection by Optimizing F-Measures , 2018, IEEE Transactions on Image Processing.

[24]  Fernando Jiménez,et al.  Multiobjective Evolutionary Feature Selection for Fuzzy Classification , 2019, IEEE Transactions on Fuzzy Systems.

[25]  Minxia Luo,et al.  The distance between fuzzy sets in fuzzy metric spaces , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[26]  Lorenzo Bruzzone,et al.  Feature Selection Based on High Dimensional Model Representation for Hyperspectral Images , 2017, IEEE Transactions on Image Processing.

[27]  Xiaoyan Sun,et al.  Fuzzy cost-based feature selection using interval multi-objective particle swarm optimization algorithm , 2016, J. Intell. Fuzzy Syst..

[28]  Mengjie Zhang,et al.  Pareto front feature selection based on artificial bee colony optimization , 2018, Inf. Sci..

[29]  Lei Wu,et al.  Coordinated Scheduling for Improving Uncertain Wind Power Adsorption in Electric Vehicles—Wind Integrated Power Systems by Multiobjective Optimization Approach , 2020, IEEE Transactions on Industry Applications.

[30]  Huan Liu,et al.  Feature subset selection bias for classification learning , 2006, ICML.

[31]  Fakhri Karray,et al.  Multi-objective Feature Selection with NSGA II , 2007, ICANNGA.

[32]  El-Ghazali Talbi,et al.  A generic fuzzy approach for multi-objective optimization under uncertainty , 2018, Swarm Evol. Comput..

[33]  Wang Xiao-kai Modified particle swarm optimizer using non-linear inertia weight , 2007 .

[34]  Maoguo Gong,et al.  Quantum-behaved discrete multi-objective particle swarm optimization for complex network clustering , 2017, Pattern Recognit..

[35]  Dunwei Gong,et al.  Binary differential evolution with self-learning for multi-objective feature selection , 2020, Inf. Sci..

[36]  Mengjie Zhang,et al.  Differential evolution for filter feature selection based on information theory and feature ranking , 2018, Knowl. Based Syst..

[37]  Kourosh Neshatian,et al.  Feature Bundles and their Effect on the Performance of Tree-based Evolutionary Classification and Feature Selection Algorithms , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[38]  Junmo Kim,et al.  Unified Simultaneous Clustering and Feature Selection for Unlabeled and Labeled Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Qingfu Zhang,et al.  An External Archive Guided Multiobjective Evolutionary Algorithm Based on Decomposition for Combinatorial Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[40]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[41]  Mengjie Zhang,et al.  Multi-objective Evolutionary Algorithms for filter Based Feature Selection in Classification , 2013, Int. J. Artif. Intell. Tools.

[42]  Hong Zhao,et al.  Cost-sensitive feature selection via the ℓ2, 1-norm , 2019, Int. J. Approx. Reason..

[43]  Behrouz Minaei-Bidgoli,et al.  Optimizing multi-objective PSO based feature selection method using a feature elitism mechanism , 2018, Expert Syst. Appl..

[44]  Will N. Browne,et al.  Feature Quality-Based Dynamic Feature Selection for Improving Salient Object Detection , 2016, IEEE Transactions on Image Processing.

[45]  Jun Zhang,et al.  A Discrete Multiobjective Particle Swarm Optimizer for Automated Assembly of Parallel Cognitive Diagnosis Tests , 2019, IEEE Transactions on Cybernetics.

[46]  Dun-Wei Gong,et al.  Feature selection of unreliable data using an improved multi-objective PSO algorithm , 2016, Neurocomputing.

[47]  Chaokun Yan,et al.  A hybrid algorithm based on binary chemical reaction optimization and tabu search for feature selection of high-dimensional biomedical data , 2018, Tsinghua Science and Technology.

[48]  Mengjie Zhang,et al.  Self-Adaptive Particle Swarm Optimization for Large-Scale Feature Selection in Classification , 2019, ACM Trans. Knowl. Discov. Data.

[49]  Li Hua Improvement on Judgement Matrix Based on Triangle Fuzzy Number , 2003 .

[50]  Tao Li,et al.  Cost-sensitive feature selection using random forest: Selecting low-cost subsets of informative features , 2016, Knowl. Based Syst..

[51]  Jianyong Sun,et al.  A decomposition-based archiving approach for multi-objective evolutionary optimization , 2018, Inf. Sci..

[52]  K DasAsit,et al.  Ensemble feature selection using bi-objective genetic algorithm , 2017 .