Robust gait recognition via discriminative set matching

In this paper, we propose a framework for gait recognition across varying views and walking conditions based on gait sequences collected from multiple viewpoints. Different from most existing view-dependent gait recognition systems, we devise a new Multiview Subspace Representation (MSR) method which considers gait sequences collected from different views of the same subject as a feature set and extracts a linear subspace to describe the feature set. Subspace-based feature representation methods measure the variances among samples, and can handle certain intra-subject variations. To better exploit the discriminative information from these subspaces for recognition, we further propose a marginal canonical correlation analysis (MCCA) method which maximizes the margins of interclass subspaces within a neighborhood. Experimental results on a widely used multiview gait database are presented to demonstrate the effectiveness of the proposed framework.

[1]  Frank P. Ferrie,et al.  Pareto discriminant analysis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Osamu Yamaguchi,et al.  Face Recognition Using Multi-viewpoint Patterns for Robot Vision , 2003, ISRR.

[3]  Masashi Nishiyama,et al.  Face Recognition with the Multiple Constrained Mutual Subspace Method , 2003, AVBPA.

[4]  Hua Li,et al.  3D gait recognition using multiple cameras , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[5]  Qionghai Dai,et al.  Weighted Subspace Distance and Its Applications to Object Recognition and Retrieval With Image Sets , 2009, IEEE Signal Processing Letters.

[6]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Fei Wang,et al.  Feature Extraction by Maximizing the Average Neighborhood Margin , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jiwen Lu,et al.  Joint Subspace Learning for View-Invariant Gait Recognition , 2011, IEEE Signal Processing Letters.

[9]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[11]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[12]  Andrew Beng Jin Teoh,et al.  Neighbourhood preserving discriminant embedding in face recognition , 2009, J. Vis. Commun. Image Represent..

[13]  Bir Bhanu,et al.  Ethnicity classification based on gait using multi-view fusion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[15]  Nikolaos V. Boulgouris,et al.  Gait recognition using multiple views , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Shuicheng Yan,et al.  Graph embedding: a general framework for dimensionality reduction , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Jiwen Lu,et al.  Gait recognition for human identification based on ICA and fuzzy SVM through multiple views fusion , 2007, Pattern Recognit. Lett..

[18]  Shin'ichi Satoh,et al.  Comparative evaluation of face sequence matching for content-based video access , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[20]  David G. Stork,et al.  Pattern Classification , 1973 .

[21]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jiwen Lu,et al.  Uncorrelated discriminant simplex analysis for view-invariant gait signal computing , 2010, Pattern Recognit. Lett..

[23]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[24]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[25]  Tieniu Tan,et al.  Video-Based Face Recognition Using Earth Mover's Distance , 2005, AVBPA.

[26]  Yunhong Wang,et al.  Gender Classification Based on Fusion of Multi-view Gait Sequences , 2007, ACCV.

[27]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[28]  Tsuhan Chen,et al.  Video-based face recognition using adaptive hidden Markov models , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[29]  Ken-ichi Maeda,et al.  Face recognition using temporal image sequence , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[30]  Tieniu Tan,et al.  Gait Recognition Based on Fusion of Multi-view Gait Sequences , 2006, ICB.

[31]  Yasushi Makihara,et al.  Gait Identification Based on Multi-view Observations Using Omnidirectional Camera , 2007, ACCV.

[32]  Koichi Shinoda,et al.  Robust Gait Recognition Against Speed Variation , 2010, 2010 20th International Conference on Pattern Recognition.

[33]  Thomas Kailath,et al.  A view of three decades of linear filtering theory , 1974, IEEE Trans. Inf. Theory.

[34]  Trevor Darrell,et al.  Integrated face and gait recognition from multiple views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[35]  Pang Ying Han,et al.  Kernel Discriminant Embedding in face recognition , 2011 .

[36]  Gene H. Golub,et al.  Numerical methods for computing angles between linear subspaces , 1971, Milestones in Matrix Computation.

[37]  Josef Kittler,et al.  Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Qiang Wu,et al.  Support vector regression for multi-view gait recognition based on local motion feature selection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Tao Jiang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[40]  Jan J. Gerbrands,et al.  On the relationships between SVD, KLT and PCA , 1981, Pattern Recognit..

[41]  Jiwen Lu,et al.  Set-to-set gait recognition across varying views and walking conditions , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[42]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..