On the effectiveness of feature selection methods for gait classification under different covariate factors

Abstract Gait classification is the problem of recognising individuals by the way in which they walk. The presence of covariate factors such as different clothing types, carrying conditions, walking surfaces, etc., can seriously complicate the task. Clothing, for instance, can occlude a significant amount of gait features and make human recognition difficult. Since the location of occlusion may differ for different covariate factors, relevant gait features may become irrelevant when the covariate factor changes, and exploiting occluded gait features can hinder the recognition performance. Therefore, feature selection has become an important step to make the analysis more manageable and to extract useful information for the gait classification task. Nevertheless, although feature selection is often used in order to identify the relevant body parts, to the best of our knowledge, a comparative analysis of feature selection techniques in gait recognition is seldom addressed. In this paper, we present an empirical approach to evaluate the degree of consistency among the performance of different selection algorithms in the context of gait identification under the effect of various covariate factors. First, a model-based framework for extracting informative gait features is introduced, then, an extensive comparative analysis of feature selection approaches in gait recognition is carried out. We perform a statistical study via ANOVA and mixed-effects models to examine the effect of six popular selection feature methods across classifiers and covariates. In addition, we systematically compare the selected feature subsets and the computational cost of the different selection approaches. The implemented method addresses the problem of feature selection for gait recognition on two well-known benchmark databases: the SOTON covariate database and the CASIA-B dataset, respectively. The investigated approach is able to select the discriminative input gait features and achieve an improved classification accuracy on par with other state-of-the-art methods.

[1]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[3]  Neha Jain,et al.  Gait recognition based on gait pal and pal entropy image , 2013, 2013 IEEE International Conference on Image Processing.

[4]  T. Hothorn,et al.  Simultaneous Inference in General Parametric Models , 2008, Biometrical journal. Biometrische Zeitschrift.

[5]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Mark S. Nixon,et al.  Automatic extraction and description of human gait models for recognition purposes , 2003, Comput. Vis. Image Underst..

[7]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[8]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[9]  Somaya Al-Máadeed,et al.  Gait recognition based on modified phase-only correlation , 2016, Signal Image Video Process..

[10]  Mark S. Nixon,et al.  Automated Markerless Analysis of Human Gait Motion for Recognition and Classification , 2011 .

[11]  Saeid Nahavandi,et al.  A Review of Vision-Based Gait Recognition Methods for Human Identification , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[12]  Worapan Kusakunniran,et al.  Attribute-based learning for gait recognition using spatio-temporal interest points , 2014, Image Vis. Comput..

[13]  Vijay Bhaskar Semwal,et al.  An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification , 2017, Multimedia Tools and Applications.

[14]  Hu Ng,et al.  Human Identification Based on Extracted Gait Features , 2011 .

[15]  Adrien Goëffon,et al.  Hill-climbing strategies on various landscapes: an empirical comparison , 2013, GECCO '13.

[16]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[17]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[18]  Hu Ng,et al.  Improved Gait Recognition with Automatic Body Joint Identification , 2011, IVIC.

[19]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[20]  Saúl Zapotecas Martínez,et al.  Genetic algorithm assisted by a SVM for feature selection in gait classification , 2014, 2014 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[21]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Mark S. Nixon,et al.  Gait Feature Subset Selection by Mutual Information , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[23]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Gilles Louppe,et al.  Understanding Random Forests: From Theory to Practice , 2014, 1407.7502.

[25]  Ahmed Bouridane,et al.  Improved Human Gait Recognition , 2015, ICIAP.

[26]  Shaogang Gong,et al.  Feature selection on Gait Energy Image for human identification , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Mark S. Nixon,et al.  Towards automated visual surveillance using gait for identity recognition and tracking across multiple non-intersecting cameras , 2014, Multimedia Tools and Applications.

[28]  David J. Hand,et al.  Classifier Technology and the Illusion of Progress , 2006, math/0606441.

[29]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[30]  Shaogang Gong,et al.  Gait Representation Using Flow Fields , 2009, BMVC.

[31]  Darko S. Matovski,et al.  Gait Recognition: Databases, Representations, and Applications , 2015, Computer Vision.

[32]  Mark S. Nixon,et al.  Exploratory factor analysis of gait recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[33]  Xudong Jiang,et al.  Human Body Part Selection by Group Lasso of Motion for Model-Free Gait Recognition , 2016, IEEE Signal Processing Letters.

[34]  Gilles Louppe,et al.  Understanding variable importances in forests of randomized trees , 2013, NIPS.

[35]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[36]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[37]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[38]  Aaron F. Bobick,et al.  Gait recognition from time-normalized joint-angle trajectories in the walking plane , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[39]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[40]  James J. Little,et al.  Incremental Learning for Video-Based Gait Recognition With LBP Flow , 2013, IEEE Transactions on Cybernetics.

[41]  Rossitza Setchi,et al.  Feature selection using Joint Mutual Information Maximisation , 2015, Expert Syst. Appl..

[42]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[43]  Ji-Wei Liu,et al.  A gait recognition method based on positioning human body joints , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[44]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[45]  Zehang Sun,et al.  Object detection using feature subset selection , 2004, Pattern Recognit..

[46]  Mark S. Nixon,et al.  On a Large Sequence-Based Human Gait Database , 2004 .

[47]  Worapan Kusakunniran,et al.  Recognizing Gaits on Spatio-Temporal Feature Domain , 2014, IEEE Transactions on Information Forensics and Security.

[48]  Yohan Dupuis,et al.  Feature subset selection applied to model-free gait recognition , 2013, Image Vis. Comput..

[49]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[50]  Marco Chiarandini,et al.  Mixed Models for the Analysis of Optimization Algorithms , 2010, Experimental Methods for the Analysis of Optimization Algorithms.

[51]  Chang-Tsun Li,et al.  On Reducing the Effect of Covariate Factors in Gait Recognition: A Classifier Ensemble Method , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Aaron F. Bobick,et al.  Gait recognition using static, activity-specific parameters , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[53]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[54]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[56]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Tieniu Tan,et al.  Robust view transformation model for gait recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[58]  Saúl Zapotecas Martínez,et al.  Feature Selection in Gait Classification Using Geometric PSO Assisted by SVM , 2015, CAIP.

[59]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[60]  Neil M. Robertson,et al.  On covariate factor detection and removal for robust gait recognition , 2015, Machine Vision and Applications.

[61]  Massimo Panella,et al.  A genetic algorithm for feature selection in gait analysis , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[62]  Saeid Sanei,et al.  A comprehensive review of past and present vision-based techniques for gait recognition , 2013, Multimedia Tools and Applications.

[63]  Girijesh Prasad,et al.  Individual Identification Using Gait Sequences under Different Covariate Factors , 2009, ICVS.