Robust CNN-based Gait Verification and Identification using Skeleton Gait Energy Image

As a kind of behavioral biometrie feature, gait has been widely applied for human verification and identification. Approaches to gait recognition can be classified into two categories: model-free approaches and model-based approaches. Model-free approaches are sensitive to appearance changes. For model-based approaches, it is difficult to extract the reliable body models from gait sequences. In this paper, based on the robust skeleton points produced from a two-branch multi-stage CNN network, a novel model-based feature, Skeleton Gait Energy Image (SGEI), has been proposed. Relevant experimental performances indicate that SGEI is more robust to the cloth changes. Another contribution is that two different CNN-based architectures have been separately proposed for gait verification and gait identification. Both these two architectures have been evaluated on the datasets. They have presented satisfying performances and increased the robustness for gait recognition in the unconstrained environments with view variances and cloth variances.

[1]  M. Nixon,et al.  Model-based Gait Recognition , 2009 .

[2]  Manuel J. Marín-Jiménez,et al.  Automatic Learning of Gait Signatures for People Identification , 2016, IWANN.

[3]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yasushi Makihara,et al.  GEINet: View-invariant gait recognition using a convolutional neural network , 2016, 2016 International Conference on Biometrics (ICB).

[5]  Hua Li,et al.  3D gait recognition using multiple cameras , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[6]  Yasushi Makihara,et al.  Gait Verification System for Criminal Investigation , 2013, IPSJ Trans. Comput. Vis. Appl..

[7]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Yasushi Makihara,et al.  Silhouette transformation based on walking speed for gait identification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Yasushi Makihara,et al.  Two-Point Gait: Decoupling Gait from Body Shape , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Wu Liu,et al.  Siamese neural network based gait recognition for human identification , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Yasushi Makihara,et al.  Clothing-invariant gait identification using part-based clothing categorization and adaptive weight control , 2010, Pattern Recognit..

[13]  Kanad K. Biswas,et al.  Biometric Gait Recognition with Carrying and Clothing Variants , 2009, PReMI.

[14]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[15]  Qiang Wu,et al.  Gait Recognition Under Various Viewing Angles Based on Correlated Motion Regression , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[17]  Xiaogang Wang,et al.  A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yasushi Makihara,et al.  On Input/Output Architectures for Convolutional Neural Network-Based Cross-View Gait Recognition , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Raymond S. T. Lee,et al.  Human Identification by Using the Motion and Static Characteristic of Gait , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[20]  Mark S. Nixon,et al.  Using Gait as a Biometric, via Phase-weighted Magnitude Spectra , 1997, AVBPA.

[21]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Pascal Fua,et al.  3D tracking for gait characterization and recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[24]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[25]  Mark S. Nixon,et al.  Model-Based Feature Extraction for Gait Analysis and Recognition , 2007, MIRAGE.

[26]  Tieniu Tan,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2004, IEEE Trans. Circuits Syst. Video Technol..

[27]  Qiang Wu,et al.  Recognizing Gaits Across Views Through Correlated Motion Co-Clustering , 2014, IEEE Transactions on Image Processing.

[28]  Thomas Wolf,et al.  Multi-view gait recognition using 3D convolutional neural networks , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[29]  Ryo Kurazume,et al.  Identification of people walking along curved trajectories , 2014, Pattern Recognit. Lett..