Feature subset selection using separability index matrix

Effective Feature Subset Selection (FSS) is an important step when designing engineering systems that classify complex data in real time. The electromyographic (EMG) signal-based walking assistance system is a typical system that requires an efficient computational architecture for classification. The performance of such a system depends largely on a criterion function that assesses the quality of selected feature subsets. However, many well-known conventional criterion functions use less relevant features for classification or they have a high computational cost. Here, we propose a new criterion function that provides more effective FSS. The proposed criterion function, known as a separability index matrix (SIM), provides features pertinent to the classification task and a very low computational cost. This new function produces to a simple feature selection algorithm when combined with the forward search paradigm. We performed extensive experimental comparisons in terms of classification accuracy and computational costs to confirm that the proposed algorithm outperformed other filter-type feature selection methods that are based on various distance measures, including inter-intra, Euclidean, Mahalanobis, and Bhattacharyya distances. We then applied the proposed method to a gait phase recognition problem in our EMG signal-based walking assistance system. We demonstrated that the proposed method performed competitively when compared with other wrapper-type feature selection methods in terms of class-separability and recognition rate.

[1]  Rui Xia,et al.  Ensemble of feature sets and classification algorithms for sentiment classification , 2011, Inf. Sci..

[2]  Yoshiyuki Sankai,et al.  Power assist control for leg with HAL-3 based on virtual torque and impedance adjustment , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[3]  Z. Bien,et al.  Walking Phase Recognition for People with Lower Limb Disability , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[4]  Josef Kittler,et al.  Fast branch & bound algorithms for optimal feature selection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[6]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[7]  H. Kawamoto,et al.  Power assist method for HAL-3 using EMG-based feedback controller , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[8]  Yoshiyuki Sankai,et al.  Power assist control for walking aid with HAL-3 based on EMG and impedance adjustment around knee joint , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Satoru Kuhara,et al.  Recursive gene selection based on maximum margin criterion: a comparison with SVM-RFE , 2006, BMC Bioinformatics.

[10]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  B. Rosner A Generalization of the Paired t-Test , 1982 .

[12]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[13]  Chong-Ho Choi,et al.  Input Feature Selection by Mutual Information Based on Parzen Window , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ravi Kothari,et al.  Feature subset selection using a new definition of classifiability , 2003, Pattern Recognit. Lett..

[15]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[16]  Qinghua Hu,et al.  Soft fuzzy rough sets for robust feature evaluation and selection , 2010, Inf. Sci..

[17]  Richard Weber,et al.  Simultaneous feature selection and classification using kernel-penalized support vector machines , 2011, Inf. Sci..

[18]  S. Krishnan,et al.  Feature selection for pattern classification with Gaussian mixture models: A new objective criterion , 1996, Pattern Recognit. Lett..

[19]  D. Harville Matrix Algebra From a Statistician's Perspective , 1998 .

[20]  Günter Hommel,et al.  Predicting the intended motion with EMG signals for an exoskeleton orthosis controller , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  David G. Stork,et al.  Pattern Classification , 1973 .

[22]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[24]  Henri Maître,et al.  On the relevance of linear discriminative features , 2010, Inf. Sci..

[25]  Vojislav Kecman,et al.  Kernel Based Algorithms for Mining Huge Data Sets: Supervised, Semi-supervised, and Unsupervised Learning , 2006, Studies in Computational Intelligence.

[26]  Hiroshi Motoda,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998, The Springer International Series in Engineering and Computer Science.