Gait Feature Subset Selection by Mutual Information

Feature selection is an important pre-processing step for pattern recognition. It can discard irrelevant and redundant information that may not only affect a classifier's performance, but also tell against system's efficiency. Meanwhile, feature selection can help to identify the factors that most influence the recognition accuracy. The result can provide valuable clues to understand and reason what is the underlying distinctness among human gait-patterns. In this paper, we introduce a computationally-efficient solution to the problem of human gait feature selection. We show that feature selection based on mutual information can provide a realistic solution for high-dimensional human gait data. To assess the performance of the proposed approach, experiments are carried out based on a 73-dimensional model-based gait features set and a 64 by 64 pixels model-free gait symmetry map. The experimental results confirmed the effectiveness of the method, removing about 50% of the model-based features and 95% of the symmetry map's pixels without significant accuracy loss, which outperforms correlation and ANOVA based methods.

[1]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[2]  Mark S. Nixon,et al.  Automated markerless extraction of walking people using deformable contour models , 2004, Comput. Animat. Virtual Worlds.

[3]  Mohamed A. Deriche,et al.  A new algorithm for EEG feature selection using mutual information , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[4]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[5]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[7]  Rama Chellappa,et al.  Role of shape and kinematics in human movement analysis , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[9]  R. Chellappa,et al.  Human Identification Based on Gait (The Kluwer International Series on Biometrics) , 2005 .

[10]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[11]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[12]  I. Ilišević,et al.  Jensen's inequality , 2005 .

[13]  Chong-Ho Choi,et al.  Input Feature Selection by Mutual Information Based on Parzen Window , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Chong-Ho Choi,et al.  Input feature selection for classification problems , 2002, IEEE Trans. Neural Networks.

[15]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[16]  Robert I. Damper,et al.  A fast separability-based feature-selection method for high-dimensional remotely sensed image classification , 2008, Pattern Recognit..

[17]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Mark S. Nixon,et al.  Probabilistic combination of static and dynamic gait features for verification , 2005, SPIE Defense + Commercial Sensing.

[19]  Hervé Abdi,et al.  Coefficients of Correlation , Alienation and Determination , 2006 .

[20]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Mark S. Nixon,et al.  What image information is important in silhouette-based gait recognition? , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  Sudeep Sarkar,et al.  Toward understanding the limits of gait recognition , 2004, SPIE Defense + Commercial Sensing.

[23]  Mark S. Nixon,et al.  Automatic Gait Recognition by Symmetry Analysis , 2001, AVBPA.

[24]  S NixonMark,et al.  Gait feature subset selection by mutual information , 2009 .

[25]  Bir Bhanu,et al.  Human Recognition on Combining Kinematic and Stationary Features , 2003, AVBPA.

[26]  ChoiChong-Ho,et al.  Input Feature Selection by Mutual Information Based on Parzen Window , 2002 .

[27]  Mark S. Nixon,et al.  Automatic Recognition by Gait , 2006, Proceedings of the IEEE.

[28]  Xiaobo Zhou,et al.  Mutual information-based feature selection in studying perturbation of dendritic structure caused by TSC2 inactivation , 2006, Neuroinformatics.

[29]  Neil Salkind Encyclopedia of Measurement and Statistics , 2006 .

[30]  Mark S. Nixon,et al.  On a Large Sequence-Based Human Gait Database , 2004 .

[31]  Tieniu Tan,et al.  Human identification based on gait , 2005, The Kluwer international series on biometrics.

[32]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  M. Strzelecki,et al.  Evaluation of texture features based on mutual information , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[34]  Kari Torkkola,et al.  Feature Extraction by Non-Parametric Mutual Information Maximization , 2003, J. Mach. Learn. Res..

[35]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[36]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  TanTieniu,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003 .

[38]  David Kenneth Wagg Local and global models for articulated motion analysis , 2006 .

[39]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[40]  Mark S. Nixon,et al.  Automated person recognition by walking and running via model-based approaches , 2004, Pattern Recognit..

[41]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[42]  E. J. McShane Jensen's inequality , 1937 .

[43]  Martin E. Hellman,et al.  Probability of error, equivocation, and the Chernoff bound , 1970, IEEE Trans. Inf. Theory.

[44]  Deniz Erdogmus,et al.  Lower and Upper Bounds for Misclassification Probability Based on Renyi's Information , 2004, J. VLSI Signal Process..