An Improved Maximum Relevance and Minimum Redundancy Feature Selection Algorithm Based on Normalized Mutual Information

We present in this paper a comprehensive analysis of the mutual information based feature selection algorithms. We point out the limitations of some recent work in this area then propose an improvement to overcome the weak points. The experiment results confirm that we achieve a better feature sets compared with the two recent developed algorithms, which are Maximum Relevance and Minimum Redundancy (mRMR) and Normalized Mutual Information Feature Selection (NMIFS), in terms of the classification accuracy.

[1]  Marimuthu Palaniswami,et al.  Support vector machines for automated gait classification , 2005, IEEE Transactions on Biomedical Engineering.

[2]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Helton Hideraldo Bíscaro,et al.  Hand movement recognition for Brazilian Sign Language: A study using distance-based neural networks , 2009, 2009 International Joint Conference on Neural Networks.

[4]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[5]  Jan Paul Siebert,et al.  Vehicle Recognition Using Rule Based Methods , 1987 .

[6]  D. Jamieson,et al.  Acoustic discrimination of pathological voice: sustained vowels versus continuous speech. , 2001, Journal of speech, language, and hearing research : JSLHR.

[7]  Chong-Ho Choi,et al.  Input feature selection for classification problems , 2002, IEEE Trans. Neural Networks.

[8]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[9]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[10]  H. A. Guvenir,et al.  A supervised machine learning algorithm for arrhythmia analysis , 1997, Computers in Cardiology 1997.

[11]  Robert P. W. Duin,et al.  Handwritten digit recognition by combined classifiers , 1998, Kybernetika.