Model-based gait recognition using graph network on very large population database

At present, the existing gait recognition systems are focusing on developing methods to extract robust gait feature from silhouette images and they indeed achieved great success. However, gait can be sensitive to appearance features such as clothing and carried items. Compared with appearance-based method, model-based gait recognition is promising due to the robustness against these variations. In recent years, with the development of human pose estimation, the difficulty of model-based gait recognition methods has been mitigated. In this paper, to resist the increase of subjects and views variation, local features are built and a siamese network is proposed to maximize the distance of samples from the same subject. We leverage recent advances in action recognition to embed human pose sequence to a vector and introduce Spatial-Temporal Graph Convolution Blocks (STGCB) which has been commonly used in action recognition for gait recognition. Experiments on the very large population dataset named OUMVLP-Pose and the popular dataset, CASIA-B, show that our method archives some state-of-the-art (SOTA) performances in model-based gait recognition. The code and models of our method are available at https://github.com/timelessnaive/Gait-for-Large-Dataset after being accepted.

[1]  Aaron F. Bobick,et al.  Gait recognition from time-normalized joint-angle trajectories in the walking plane , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Francisco Javier Ferrández Pastor,et al.  Vision Based Extraction of Dynamic Gait Features Focused on Feet Movement Using RGB Camera , 2015, AmIHEALTH.

[4]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dimitris Kastaniotis,et al.  Pose-based gait recognition with local gradient descriptors and hierarchically aggregated residuals , 2016, J. Electronic Imaging.

[6]  Kihyuk Sohn,et al.  Improved Deep Metric Learning with Multi-class N-pair Loss Objective , 2016, NIPS.

[7]  Shiqi Yu,et al.  Pose-Based Temporal-Spatial Network (PTSN) for Gait Recognition with Carrying and Clothing Variations , 2017, CCBR.

[8]  Shiqi Yu,et al.  A model-based gait recognition method with body pose and human prior knowledge , 2020, Pattern Recognit..

[9]  Manuel J. Marín-Jiménez,et al.  Evaluation of Cnn Architectures for Gait Recognition Based on Optical Flow Maps , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[10]  Dahua Lin,et al.  Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition , 2018, AAAI.

[11]  Qing Li,et al.  GaitPart: Temporal Part-Based Model for Gait Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Marco Grangetto,et al.  Gait characterization using dynamic skeleton acquisition , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[13]  Iasonas Kokkinos,et al.  DensePose: Dense Human Pose Estimation in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  M. D. Jan Nordin and Ali Saadoon,et al.  A Survey of Gait Recognition Based on Skeleton Model for Human Identification , 2016 .

[15]  Yang Yu,et al.  Performance Evaluation of Model-Based Gait on Multi-View Very Large Population Database With Pose Sequences , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[16]  Nicholay Topin,et al.  Super-convergence: very fast training of neural networks using large learning rates , 2018, Defense + Commercial Sensing.

[17]  M. Nixon,et al.  Automated Human Recognition by Gait using Neural Network , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[18]  Tieniu Tan,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[20]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[21]  Chaoying Tang,et al.  Model-Based Gait Recognition Using Graph Network with Pose Sequences , 2021, PRCV.

[22]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Alireza Sepas-Moghaddam,et al.  Deep Gait Recognition: A Survey , 2021, ArXiv.

[24]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Anton Konushin,et al.  View Resistant Gait Recognition , 2019, ICVIP.

[26]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[27]  Lei Shi,et al.  Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Jianfeng Feng,et al.  GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition , 2018, AAAI.

[29]  Liang Wang,et al.  GaitNet: An end-to-end network for gait based human identification , 2019, Pattern Recognit..