A Combined Ant Colony and Differential Evolution Feature Selection Algorithm

Feature selection is an important step in many pattern recognition systems that aims to overcome the so-called curse of dimensionality problem. Although Ant Colony Optimization (ACO) proved to be a powerful technique in different optimization problems, but it still needs some improvements when applied to the feature selection problem. This is due to the fact that it builds its solutions sequentially, where in feature selection this behavior will most likely not lead to the optimal solution. In this paper, a novel feature selection algorithm based on a combination of ACO and a simple, yet powerful, Differential Evolution (DE) operator is presented. The proposed combination enhances both the exploration and exploitation capabilities of the search procedure. The new algorithm is tested on two biosignal-driven applications. The performance of the proposed algorithm is compared with other dimensionality reduction techniques to prove its superiority.

[1]  Maryhelen Stevenson,et al.  Signal representation for classification of the transient myoelectric signal , 1998 .

[2]  Petra Perner,et al.  Advances in Data Mining , 2002, Lecture Notes in Computer Science.

[3]  Bernhard Schölkopf,et al.  Feature selection for support vector machines by means of genetic algorithm , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[4]  Mohamed A. Deriche,et al.  A new mutual information based measure for feature selection , 2003, Intell. Data Anal..

[5]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[6]  Erik D. Goodman,et al.  Swarmed feature selection , 2004, 33rd Applied Imagery Pattern Recognition Workshop (AIPR'04).

[7]  Zhong Yan,et al.  Ant Colony Optimization for Feature Selection in Face Recognition , 2004, ICBA.

[8]  Richard Jensen,et al.  Combining rough and fuzzy sets for feature selection , 2004 .

[9]  Hui-Hua Yang,et al.  Ant colony optimization based network intrusion feature selection and detection , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[10]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[11]  Hong Hu,et al.  Feature selection using the hybrid of ant colony optimization and mutual information for the forecaster , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[12]  Adrian D. C. Chan,et al.  Investigating Classification Parameters for Continuous Myoelectrically Controlled Prostheses , 2005 .

[13]  Ahmed Al-Ani,et al.  Feature Subset Selection Using Ant Colony Optimization , 2008 .

[14]  Alfred C. Weaver,et al.  Biometric authentication , 2006, Computer.

[15]  Mu-Seong Mun,et al.  A Supervised Feature Projection for Real-Time Multifunction Myoelectric Hand Control , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  A. Al-Ani,et al.  Effect of Feature and Channel Selection on EEG Classification , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[18]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2022 .

[19]  Karim Faez,et al.  Feature Selection Using Ant Colony Optimization (ACO): A New Method and Comparative Study in the Application of Face Recognition System , 2007, ICDM.

[20]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[21]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .