Gait-Based Gender Classification Using Mixed Conditional Random Field

This paper proposes a supervised modeling approach for gait-based gender classification. Different from traditional temporal modeling methods, male and female gait traits are competitively learned by the addition of gender labels. Shape appearance and temporal dynamics of both genders are integrated into a sequential model called mixed conditional random field (CRF) (MCRF), which provides an open framework applicable to various spatiotemporal features. In this paper, for the spatial part, pyramids of fitting coefficients are used to generate the gait shape descriptors; for the temporal part, neighborhood-preserving embeddings are clustered to allocate the stance indexes over gait cycles. During these processes, we employ evaluation functions like the partition index and Xie and Beni's index to improve the feature sparseness. By fusion of shape descriptors and stance indexes, the MCRF is constructed in coordination with intra- and intergender temporary Markov properties. Analogous to the maximum likelihood decision used in hidden Markov models (HMMs), several classification strategies on the MCRF are discussed. We use CASIA (Data set B) and IRIP Gait Databases for the experiments. The results show the superior performance of the MCRF over HMMs and separately trained CRFs.

[1]  Yunhong Wang,et al.  A New Approach for Gender Classification Based on Gait Analysis , 2009, 2009 Fifth International Conference on Image and Graphics.

[2]  Yanxi Liu,et al.  Shape Variation-Based Frieze Pattern for Robust Gait Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Mark S. Nixon,et al.  Covariate Analysis for View-Point Independent Gait Recognition , 2009, ICB.

[4]  Trevor Darrell,et al.  Hidden Conditional Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Rudolf Fleischer,et al.  Multilinear Tensor-Based Non-parametric Dimension Reduction for Gait Recognition , 2009, ICB.

[6]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[8]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[9]  James C. Bezdek,et al.  Validity-guided (re)clustering with applications to image segmentation , 1996, IEEE Trans. Fuzzy Syst..

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[11]  Tieniu Tan,et al.  A Study on Gait-Based Gender Classification , 2009, IEEE Transactions on Image Processing.

[12]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[13]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[15]  Andrew Zisserman,et al.  Pose search: Retrieving people using their pose , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Liang Wang,et al.  Recognizing Human Activities from Silhouettes: Motion Subspace and Factorial Discriminative Graphical Model , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Xuelong Li,et al.  Discriminant Locally Linear Embedding With High-Order Tensor Data , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Xuelong Li,et al.  Gait Components and Their Application to Gender Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Xuelong Li,et al.  Gender recognition based on local body motions , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[20]  Trevor Darrell,et al.  Latent-Dynamic Discriminative Models for Continuous Gesture Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Chung-Lin Huang,et al.  Gait Analysis For Human Identification Through Manifold Learning and HMM , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[22]  Yanchun Zhang,et al.  Gait Classificaiton in Children with Cerebral Palsy by Bayesian Approach , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[23]  Thomas S. Huang Locally Linear Embedded Eigenspace Analysis , 2005 .

[24]  Haihong Hu,et al.  Frame difference energy image for gait recognition with incomplete silhouettes , 2009, Pattern Recognit. Lett..

[25]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[26]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Mark S. Nixon,et al.  Gait Feature Subset Selection by Mutual Information , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[28]  Yunhong Wang,et al.  Gender Recognition Based on Fusion of Face and Multi-view Gait , 2009, ICB.

[29]  Matti Pietikäinen,et al.  Dynamic Texture Based Gait Recognition , 2009, ICB.

[30]  Tao Ding A robust identification approach to gait recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Bailing Zhang,et al.  Gait Classificaiton in Children with Cerebral Palsy by Bayesian Approach , 2007 .

[32]  Yunhong Wang,et al.  Investigating the separability of features from different views for gait based gender classification , 2008, 2008 19th International Conference on Pattern Recognition.

[33]  Yiding Wang,et al.  Combining Spatial and Temporal Information for Gait Based Gender Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[34]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[35]  Yunhong Wang,et al.  Gender Classification Based on Fusion of Multi-view Gait Sequences , 2007, ACCV.

[36]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[37]  Danica Kragic,et al.  Simultaneous Visual Recognition of Manipulation Actions and Manipulated Objects , 2008, ECCV.

[38]  Qiang Wu,et al.  Support vector regression for multi-view gait recognition based on local motion feature selection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Yun-Hong Wang,et al.  Gender recognition based on fusion on face and gait information , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[40]  Yasushi Makihara,et al.  Silhouette transformation based on walking speed for gait identification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Fernando Pereira,et al.  Shallow Parsing with Conditional Random Fields , 2003, NAACL.

[42]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Yanxi Liu,et al.  Gait Sequence Analysis Using Frieze Patterns , 2002, ECCV.

[44]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[45]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[47]  Yasushi Makihara,et al.  Gait Recognition Using a View Transformation Model in the Frequency Domain , 2006, ECCV.

[48]  A. N. Rajagopalan,et al.  Gait-based recognition of humans using continuous HMMs , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[49]  William W. Cohen,et al.  Semi-Markov Conditional Random Fields for Information Extraction , 2004, NIPS.

[50]  Robert Bergevin,et al.  Towards view-invariant gait modeling: Computing view-normalized body part trajectories , 2009, Pattern Recognit..

[51]  Nikolaos V. Boulgouris,et al.  Gait Recognition Using Radon Transform and Linear Discriminant Analysis , 2007, IEEE Transactions on Image Processing.