Silhouette-based gait recognition via deterministic learning

In this paper, we present a new silhouette-based gait recognition method via deterministic learning theory, which combines spatio-temporal motion characteristics and physical parameters of a human subject by analyzing shape parameters of the subject@?s silhouette contour. It has been validated only in sequences with lateral view, recorded in laboratory conditions. The ratio of the silhouette@?s height and width (H-W ratio), the width of the outer contour of the binarized silhouette, the silhouette area and the vertical coordinate of centroid of the outer contour are combined as gait features for recognition. They represent the dynamics of gait motion and can more effectively reflect the tiny variance between different gait patterns. The gait recognition approach consists of two phases: a training phase and a test phase. In the training phase, the gait dynamics underlying different individuals@? gaits are locally accurately approximated by radial basis function (RBF) networks via deterministic learning theory. The obtained knowledge of approximated gait dynamics is stored in constant RBF networks. In the test phase, a bank of dynamical estimators is constructed for all the training gait patterns. The constant RBF networks obtained from the training phase are embedded in the estimators. By comparing the set of estimators with a test gait pattern, a set of recognition errors are generated, and the average L"1 norms of the errors are taken as the similarity measure between the dynamics of the training gait patterns and the dynamics of the test gait pattern. The test gait pattern similar to one of the training gait patterns can be recognized according to the smallest error principle. Finally, the recognition performance of the proposed algorithm is comparatively illustrated to take into consideration the published gait recognition approaches on the most well-known public gait databases: CASIA, CMU MoBo and TUM GAID.

[1]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[2]  Jiwen Lu,et al.  Gait recognition for human identification based on ICA and fuzzy SVM through multiple views fusion , 2007, Pattern Recognit. Lett..

[3]  Reza Safabakhsh,et al.  Model-based human gait recognition using leg and arm movements , 2010, Eng. Appl. Artif. Intell..

[4]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dimitry M. Gorinevsky,et al.  On the persistency of excitation in radial basis function network identification of nonlinear systems , 1995, IEEE Trans. Neural Networks.

[6]  Yilong Yin,et al.  Gait Recognition Based on Outermost Contour , 2010, RSKT.

[7]  Adilson Gonzaga,et al.  Human gait recognition using extraction and fusion of global motion features , 2011, Multimedia Tools and Applications.

[8]  Tieniu Tan,et al.  Efficient Night Gait Recognition Based on Template Matching , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Tardi Tjahjadi,et al.  Silhouette-based gait recognition using Procrustes shape analysis and elliptic Fourier descriptors , 2012, Pattern Recognit..

[10]  Jay A. Farrell,et al.  Stability and approximator convergence in nonparametric nonlinear adaptive control , 1998, IEEE Trans. Neural Networks.

[11]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[12]  M. Nixon,et al.  Extraction and recognition of periodically deforming objects by continuous, spatio-temporal shape description , 2004, CVPR 2004.

[13]  Nissan Kunju,et al.  Active marker based kinematic and spatio-temporal gait measurement system using LabVIEW vision , 2010 .

[14]  Björn W. Schuller,et al.  The TUM Gait from Audio, Image and Depth (GAID) database: Multimodal recognition of subjects and traits , 2014, J. Vis. Commun. Image Represent..

[15]  Tieniu Tan,et al.  A Study on Gait-Based Gender Classification , 2009, IEEE Transactions on Image Processing.

[16]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[17]  Cong Wang,et al.  Deterministic learning of nonlinear dynamical systems , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.

[18]  M. Orendurff,et al.  The effect of walking speed on center of mass displacement. , 2004, Journal of rehabilitation research and development.

[19]  Nikolaos V. Boulgouris,et al.  Gait Recognition With Shifted Energy Image and Structural Feature Extraction , 2012, IEEE Transactions on Image Processing.

[20]  Mark S. Nixon,et al.  Self-Calibrating View-Invariant Gait Biometrics , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Cong Wang,et al.  Learning from neural control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[22]  Mark S. Nixon,et al.  Model-based approaches for predicting gait changes over time , 2005, 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[23]  Mark S. Nixon,et al.  The Effect of Time on Gait Recognition Performance , 2012, IEEE Transactions on Information Forensics and Security.

[24]  M. Nixon,et al.  Model-based Gait Recognition , 2009 .

[25]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[27]  Marc Van Droogenbroeck,et al.  Frontal-view gait recognition by intra- and inter-frame rectangle size distribution , 2009, Pattern Recognit. Lett..

[28]  A. N. Rajagopalan,et al.  Gait-based recognition of humans using continuous HMMs , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[29]  Rama Chellappa,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2 , 2022 .

[30]  Qiang Wu,et al.  Automatic Gait Recognition Using Weighted Binary Pattern on Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[31]  J. Cutting,et al.  Gait Perception as an Example of How We May Perceive Events , 1981 .

[32]  James J. Little,et al.  Incremental Learning for Video-Based Gait Recognition With LBP Flow , 2013, IEEE Transactions on Cybernetics.

[33]  Mark S. Nixon,et al.  Automated person recognition by walking and running via model-based approaches , 2004, Pattern Recognit..

[34]  Nikolaos V. Boulgouris,et al.  Model-based human gait recognition using fusion of features , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[35]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[36]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[37]  Mark S. Nixon,et al.  Performance analysis for automated gait extraction and recognition in multi-camera surveillance , 2010, Multimedia Tools and Applications.

[38]  Luv Rustagi,et al.  Human Gait Recognition Based on Dynamic and Static Features Using Generalized Regression Neural Network , 2009, 2009 Second International Conference on Machine Vision.

[39]  Adam Prügel-Bennett,et al.  Automatic gait recognition using area-based metrics , 2003 .

[40]  Mark S. Nixon,et al.  On Acquisition and Analysis of a Dataset Comprising of Gait, Ear and Semantic data , 2011 .

[41]  Dusan Starcevic,et al.  Walking in Colors: Human Gait Recognition Using Kinect and CBIR , 2013, IEEE MultiMedia.

[42]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[43]  David J. Hill,et al.  Deterministic Learning Theory , 2009 .

[44]  Murat Ekinci,et al.  Improved gait recognition by multiple-projections normalization , 2010, Machine Vision and Applications.

[45]  Osama Masoud,et al.  View-independent human motion classification using image-based reconstruction , 2009, Image Vis. Comput..

[46]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Hua Li,et al.  3D gait recognition using multiple cameras , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[48]  Faouzi Alaya Cheikh,et al.  Gait Recognition using Time-of-Flight Sensor , 2011, BIOSIG.

[49]  LiuZongyi,et al.  The HumanID Gait Challenge Problem , 2005 .

[50]  Wei Xiong,et al.  Active energy image plus 2DLPP for gait recognition , 2010, Signal Process..

[51]  Wei Zeng,et al.  Human gait recognition via deterministic learning , 2012, Neural Networks.

[52]  Tieniu Tan,et al.  Automatic gait recognition based on statistical shape analysis , 2003, IEEE Trans. Image Process..

[53]  Sudeep Sarkar,et al.  Effect of silhouette quality on hard problems in gait recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[54]  M. P. Murray Gait as a total pattern of movement. , 1967, American journal of physical medicine.

[55]  Yee-Hong Yang,et al.  The background primal sketch: An approach for tracking moving objects , 1992, Machine Vision and Applications.

[56]  Nikolaos Papanikolopoulos,et al.  3D Reconstruction of Periodic Motion from a Single View , 2010, International Journal of Computer Vision.