Deep Gait Recognition: A Survey

Gait recognition is an appealing biometric modality which aims to identify individuals based on the way they walk. Deep learning has reshaped the research landscape in this area since 2015 through the ability to automatically learn discriminative representations. Gait recognition methods based on deep learning now dominate the state-of-the-art in the field and have fostered real-world applications. In this paper, we present a comprehensive overview of breakthroughs and recent developments in gait recognition with deep learning, and cover broad topics including datasets, test protocols, state-of-the-art solutions, challenges, and future research directions. We first review the commonly used gait datasets along with the principles designed for evaluating them. We then propose a novel taxonomy made up of four separate dimensions namely body representation, temporal representation, feature representation, and neural architecture, to help characterize and organize the research landscape and literature in this area. Following our proposed taxonomy, a comprehensive survey of gait recognition methods using deep learning is presented with discussions on their performances, characteristics, advantages, and limitations. We conclude this survey with a discussion on current challenges and mention a number of promising directions for future research in gait recognition.

[1]  Jianfeng Feng,et al.  GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition , 2018, AAAI.

[2]  Jianbo Li,et al.  SpiderNet: A spiderweb graph neural network for multi-view gait recognition , 2020, Knowl. Based Syst..

[3]  Peter Peer,et al.  Ear recognition: More than a survey , 2016, Neurocomputing.

[4]  Xiaoming Liu,et al.  Gait Recognition via Disentangled Representation Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Yasushi Yagi,et al.  Gait Recognition via Semi-supervised Disentangled Representation Learning to Identity and Covariate Features , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[7]  Jing Zhang,et al.  Transfer Learning for Cross-Dataset Recognition: A Survey , 2017, 1705.04396.

[8]  Anton Konushin,et al.  Pose-based Deep Gait Recognition , 2017, IET Biom..

[9]  Vladlen Koltun,et al.  Robust continuous clustering , 2017, Proceedings of the National Academy of Sciences.

[10]  Zhenghao Chen,et al.  Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Chao Li,et al.  DeepGait: A Learning Deep Convolutional Representation for View-Invariant Gait Recognition Using Joint Bayesian , 2017 .

[12]  Liang Wang,et al.  GaitNet: An end-to-end network for gait based human identification , 2019, Pattern Recognit..

[13]  Matthew C. Valenti,et al.  Multibiometric secure system based on deep learning , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[14]  Mao Ye,et al.  Memory-based Gait Recognition , 2016, BMVC.

[15]  Frans Coenen,et al.  Multi-attributes gait identification by convolutional neural networks , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[16]  Wu Liu,et al.  Beyond View Transformation: Cycle-Consistent Global and Partial Perception Gan for View-Invariant Gait Recognition , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[17]  Yang Feng,et al.  Learning effective Gait features using LSTM , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[18]  S. Ali Etemad,et al.  Expert-Driven Perceptual Features for Modeling Style and Affect in Human Motion , 2016, IEEE Transactions on Human-Machine Systems.

[19]  Jun Miura,et al.  Identification of a specific person using color, height, and gait features for a person following robot , 2016, Robotics Auton. Syst..

[20]  Sarajane Marques Peres,et al.  Fusion of Face and Gait for Biometric Recognition: Systematic Literature Review , 2016, SBSI.

[21]  Luís Ducla Soares,et al.  Using transfer learning for classification of gait pathologies , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[22]  Jonathan Masci,et al.  Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Wei Jia,et al.  Survey of Gait Recognition , 2009, ICIC.

[24]  Kai Ma,et al.  Generative Adversarial Networks for Video-to-Video Domain Adaptation , 2020, AAAI.

[25]  M. D. Jan Nordin and Ali Saadoon,et al.  A Survey of Gait Recognition Based on Skeleton Model for Human Identification , 2016 .

[26]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[27]  Shang-Hong Lai,et al.  AugGAN: Cross Domain Adaptation with GAN-Based Data Augmentation , 2018, ECCV.

[28]  Lavinia Mihaela Dinca,et al.  The Fall of One, the Rise of Many A Survey on Multi-Biometric Fusion Methods , 2017 .

[29]  Ersin Yumer,et al.  Self-supervised Multi-view Person Association and Its Applications. , 2020, IEEE transactions on pattern analysis and machine intelligence.

[30]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[31]  Haihong Hu,et al.  Frame difference energy image for gait recognition with incomplete silhouettes , 2009, Pattern Recognit. Lett..

[32]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[33]  Ausif Mahmood,et al.  Improved Gait recognition based on specialized deep convolutional neural networks , 2015, 2015 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[34]  Jin Young Choi,et al.  Appearance and motion based deep learning architecture for moving object detection in moving camera , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[35]  Yingli Tian,et al.  Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[37]  Dimitris N. Metaxas,et al.  Reconstruction-Based Disentanglement for Pose-Invariant Face Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[38]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Yasushi Makihara,et al.  Cross-View Gait Recognition Using Pairwise Spatial Transformer Networks , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Dariu Gavrila,et al.  Joint multi-person detection and tracking from overlapping cameras , 2014, Comput. Vis. Image Underst..

[41]  Julian Fierrez,et al.  GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection , 2019, IEEE Journal of Selected Topics in Signal Processing.

[42]  Andrew J. Davison,et al.  End-To-End Multi-Task Learning With Attention , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[44]  LinLin Shen,et al.  Invariant feature extraction for gait recognition using only one uniform model , 2017, Neurocomputing.

[45]  Wai Lok Woo,et al.  Multi-View Temporal Ensemble for Classification of Non-Stationary Signals , 2019, IEEE Access.

[46]  Arun Ross,et al.  Biometric recognition by gait: A survey of modalities and features , 2018, Comput. Vis. Image Underst..

[47]  Pong C. Yuen,et al.  Improving Gait Recognition with 3D Pose Estimation , 2018, CCBR.

[48]  Larry S. Davis,et al.  View-invariant Estimation of Height and Stride for Gait Recognition , 2002, Biometric Authentication.

[49]  Gabriela Csurka,et al.  Domain Adaptation for Visual Applications: A Comprehensive Survey , 2017, ArXiv.

[50]  Qing Li,et al.  GaitPart: Temporal Part-Based Model for Gait Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Yang Yu,et al.  Performance Evaluation of Model-Based Gait on Multi-View Very Large Population Database With Pose Sequences , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[52]  Imad Rida,et al.  Towards Human Body-Part Learning for Model-Free Gait Recognition , 2019, ArXiv.

[53]  Yasushi Makihara,et al.  Gait Analysis of Gender and Age Using a Large-Scale Multi-view Gait Database , 2010, ACCV.

[54]  Vivek Kanhangad,et al.  Gender classification in smartphones using gait information , 2018, Expert Syst. Appl..

[55]  Mark S. Nixon,et al.  On a Large Sequence-Based Human Gait Database , 2004 .

[56]  Wu Liu,et al.  Learning Efficient Spatial-Temporal Gait Features with Deep Learning for Human Identification , 2018, Neuroinformatics.

[57]  Youngbae Hwang,et al.  Robust Deep Multi-modal Learning Based on Gated Information Fusion Network , 2018, ACCV.

[58]  Kimberly D. Kendricks,et al.  Deep network for analyzing gait patterns in low resolution video towards threat identification. , 2016 .

[59]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Ying Li,et al.  View-invariant gait recognition method by three-dimensional convolutional neural network , 2018 .

[61]  Xiaofeng Liu,et al.  Disentanglement for Discriminative Visual Recognition , 2020, ArXiv.

[62]  Ke Yan,et al.  Gait classification through CNN-based ensemble learning , 2020, Multim. Tools Appl..

[63]  Jing Li,et al.  Gait recognition based on 3D skeleton joints captured by kinect , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[64]  Maria De Marsico,et al.  A Survey on Gait Recognition via Wearable Sensors , 2019, ACM Comput. Surv..

[65]  Shiqi Yu,et al.  GaitGANv2: Invariant gait feature extraction using generative adversarial networks , 2019, Pattern Recognit..

[66]  松田 直人 『Google Scholar』の利点 , 2009 .

[67]  M. Nixon,et al.  Automated Human Recognition by Gait using Neural Network , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[68]  Franck Multon,et al.  Computer animation of human walking: a survey , 1999, Comput. Animat. Virtual Worlds.

[69]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[70]  Fei Wu,et al.  VersatileGait: A Large-Scale Synthetic Gait Dataset with Fine-GrainedAttributes and Complicated Scenarios , 2021, ArXiv.

[71]  Chen Wang,et al.  Chrono-Gait Image: A Novel Temporal Template for Gait Recognition , 2010, ECCV.

[72]  Hefei Ling,et al.  Cross-view gait recognition based on a restrictive triplet network , 2019, Pattern Recognit. Lett..

[73]  Yan Gao,et al.  Robust Cross-View Gait Identification with Evidence: A Discriminant Gait GAN (DiGGAN) Approach on 10000 People , 2018, ArXiv.

[74]  Yi Guo,et al.  Accurate Ambulatory Gait Analysis in Walking and Running Using Machine Learning Models , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[75]  Saeid Sanei,et al.  A Review on Accelerometry-Based Gait Analysis and Emerging Clinical Applications , 2018, IEEE Reviews in Biomedical Engineering.

[76]  Jingsong Xu,et al.  VN-GAN: Identity-preserved Variation Normalizing GAN for Gait Recognition , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[77]  Chang-Tsun Li,et al.  Combining gait and face for tackling the elapsed time challenges , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[78]  Xiang Li,et al.  The OU-ISIR Large Population Gait Database with real-life carried object and its performance evaluation , 2018, IPSJ Transactions on Computer Vision and Applications.

[79]  Jian Weng,et al.  Feedback weight convolutional neural network for gait recognition , 2018, J. Vis. Commun. Image Represent..

[80]  Daksh Thapar,et al.  VGR-net: A view invariant gait recognition network , 2017, 2018 IEEE 4th International Conference on Identity, Security, and Behavior Analysis (ISBA).

[81]  Liang Wang,et al.  Cross-View Gait Recognition by Discriminative Feature Learning , 2020, IEEE Transactions on Image Processing.

[82]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[83]  Somaya Al-Máadeed,et al.  Robust gait recognition: a comprehensive survey , 2018, IET Biom..

[84]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[85]  Senthil Yogamani,et al.  MultiNet++: Multi-Stream Feature Aggregation and Geometric Loss Strategy for Multi-Task Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[86]  Najoua Essoukri Ben Amara,et al.  Contribution to the fusion of soft facial and body biometrics for remote people identification , 2016, 2016 2nd International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[87]  Hefei Ling,et al.  Gait recognition with cross-domain transfer networks , 2019, J. Syst. Archit..

[88]  Shiqi Yu,et al.  GaitGAN: Invariant Gait Feature Extraction Using Generative Adversarial Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[89]  Kyoobin Lee,et al.  Feature Extraction Using an RNN Autoencoder for Skeleton-Based Abnormal Gait Recognition , 2020, IEEE Access.

[90]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[91]  Yasushi Makihara,et al.  Clothing-invariant gait identification using part-based clothing categorization and adaptive weight control , 2010, Pattern Recognit..

[92]  Qin Zhang,et al.  Gait recognition based on capsule network , 2019, J. Vis. Commun. Image Represent..

[93]  Xiuhui Wang,et al.  Gait feature extraction and gait classification using two-branch CNN , 2019, Multimedia Tools and Applications.

[94]  Yasushi Makihara,et al.  Joint Intensity Transformer Network for Gait Recognition Robust Against Clothing and Carrying Status , 2019, IEEE Transactions on Information Forensics and Security.

[95]  Yunchao Wei,et al.  Horizontal Pyramid Matching for Person Re-identification , 2018, AAAI.

[96]  Roland Göcke,et al.  Extending Long Short-Term Memory for Multi-View Structured Learning , 2016, ECCV.

[97]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[98]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[99]  Mubarak Shah,et al.  Human Pose Estimation in Videos , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[100]  Feng Liu,et al.  On Learning Disentangled Representations for Gait Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[101]  Chun Chen,et al.  A survey of human pose estimation: The body parts parsing based methods , 2015, J. Vis. Commun. Image Represent..

[102]  Yasushi Makihara,et al.  GEINet: View-invariant gait recognition using a convolutional neural network , 2016, 2016 International Conference on Biometrics (ICB).

[103]  Gongping Yang,et al.  Face and Gait Recognition Based on Semi-supervised Learning , 2012, CCPR.

[104]  M. Samson,et al.  Differences in gait parameters at a preferred walking speed in healthy subjects due to age, height and body weight , 2001, Aging.

[105]  Shiqi Yu,et al.  Pose-Based Temporal-Spatial Network (PTSN) for Gait Recognition with Carrying and Clothing Variations , 2017, CCBR.

[106]  Francisco Javier Ferrández Pastor,et al.  Vision Based Extraction of Dynamic Gait Features Focused on Feet Movement Using RGB Camera , 2015, AmIHEALTH.

[107]  Yu Zhang,et al.  A Survey on Multi-Task Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[108]  Wei Qi Yan,et al.  Gait recognition using multichannel convolution neural networks , 2019, Neural Computing and Applications.

[109]  Bowen Du,et al.  EV-Gait: Event-Based Robust Gait Recognition Using Dynamic Vision Sensors , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[110]  Alberto Botana López,et al.  Deep Learning in Biometrics: A Survey , 2019, ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal.

[111]  J. Carroll,et al.  K-means clustering in a low-dimensional Euclidean space , 1994 .

[112]  Rama Chellappa,et al.  Fusion of gait and face for human identification , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[113]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[114]  Jingsong Xu,et al.  VT-GAN: View Transformation GAN for Gait Recognition Across Views , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[115]  Saeid Sanei,et al.  A comprehensive review of past and present vision-based techniques for gait recognition , 2013, Multimedia Tools and Applications.

[116]  Yasushi Makihara,et al.  On Input/Output Architectures for Convolutional Neural Network-Based Cross-View Gait Recognition , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[117]  Yongzhen Huang,et al.  Dense-View GEIs Set: View Space Covering for Gait Recognition based on Dense-View GAN , 2020, 2020 IEEE International Joint Conference on Biometrics (IJCB).

[118]  S. Ali Etemad,et al.  Correlation-optimized time warping for motion , 2014, The Visual Computer.

[119]  Wu Liu,et al.  Siamese neural network based gait recognition for human identification , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[120]  Yasushi Makihara,et al.  End-to-End Model-Based Gait Recognition , 2020, ACCV.

[121]  Ioannis A. Kakadiaris,et al.  Curriculum Learning for Multi-task Classification of Visual Attributes , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[122]  A. V. Olgac,et al.  Performance Analysis of Various Activation Functions in Generalized MLP Architectures of Neural Networks , 2011 .

[123]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[124]  Dimitrios Kollias,et al.  Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFace , 2019, BMVC.

[125]  Qiang Wu,et al.  Robust CNN-based Gait Verification and Identification using Skeleton Gait Energy Image , 2018, 2018 Digital Image Computing: Techniques and Applications (DICTA).

[126]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[127]  Lina J. Karam,et al.  Unconstrained ear recognition using deep neural networks , 2018, IET Biom..

[128]  Yasushi Makihara,et al.  Multi-view large population gait dataset and its performance evaluation for cross-view gait recognition , 2018, IPSJ Transactions on Computer Vision and Applications.

[129]  Guoheng Huang,et al.  Flexible Gait Recognition Based on Flow Regulation of Local Features Between Key Frames , 2020, IEEE Access.

[130]  Michael Crawshaw,et al.  Multi-Task Learning with Deep Neural Networks: A Survey , 2020, ArXiv.

[131]  Xiaoming Liu,et al.  Disentangled Representation Learning GAN for Pose-Invariant Face Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[132]  Yasushi Yagi,et al.  Gait-based age estimation using multi-stage convolutional neural network , 2019, IPSJ Transactions on Computer Vision and Applications.

[133]  Uday Pratap Singh,et al.  Vision-Based Gait Recognition: A Survey , 2018, IEEE Access.

[134]  Pengfei Guo,et al.  Multi-person 3D Pose Estimation in Crowded Scenes Based on Multi-View Geometry , 2020, ECCV.

[135]  Xiaogang Wang,et al.  A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[136]  Wei Qi Yan,et al.  Non-local gait feature extraction and human identification , 2020, Multimedia Tools and Applications.

[137]  Hongming Shan,et al.  Multi-Task GANs for View-Specific Feature Learning in Gait Recognition , 2019, IEEE Transactions on Information Forensics and Security.

[138]  Tieniu Tan,et al.  Efficient Night Gait Recognition Based on Template Matching , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[139]  A. Etemad,et al.  Self-Supervised ECG Representation Learning for Emotion Recognition , 2020, IEEE Transactions on Affective Computing.

[140]  Alfredo Petrosino,et al.  TGLSTM: A time based graph deep learning approach to gait recognition , 2019, Pattern Recognit. Lett..

[141]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[142]  Anton van den Hengel,et al.  On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law , 2020, NeurIPS.

[143]  Chiung Ching Ho,et al.  Background subtraction on gait videos containing illumination variates , 2018 .

[144]  Qi Tian,et al.  Multi-View Gait Image Generation for Cross-View Gait Recognition , 2021, IEEE Transactions on Image Processing.

[145]  Jasvinder Pal Singh,et al.  A Survey of Behavioral Biometric Gait Recognition: Current Success and Future Perspectives , 2019, Archives of Computational Methods in Engineering.

[146]  F. Karray,et al.  Fisher Discriminant Triplet and Contrastive Losses for Training Siamese Networks , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[147]  Rafael Medina Carnicer,et al.  Deep multi-task learning for gait-based biometrics , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[148]  Shiguang Shan,et al.  Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[149]  Paulo Lobato Correia,et al.  Ear recognition in a light field imaging framework: a new perspective , 2018, IET Biom..

[150]  N. B. Ben Amara,et al.  Remote person authentication in different scenarios based on gait and face in front view , 2017, 2017 14th International Multi-Conference on Systems, Signals & Devices (SSD).

[151]  Yasushi Makihara,et al.  Gait recognition invariant to carried objects using alpha blending generative adversarial networks , 2020, Pattern Recognit..

[152]  Yongzhen Huang,et al.  Gait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition , 2020, ECCV.

[153]  Vighnesh Birodkar,et al.  Unsupervised Learning of Disentangled Representations from Video , 2017, NIPS.

[154]  Zhikui Chen,et al.  A Survey on Deep Learning for Multimodal Data Fusion , 2020, Neural Computation.

[155]  Stefanos Zafeiriou,et al.  ArcFace: Additive Angular Margin Loss for Deep Face Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[156]  Yang Zhao,et al.  Deep Metric Learning Based On Center-Ranked Loss for Gait Recognition , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[157]  Hefei Ling,et al.  Multi-View Gait Recognition Based on a Spatial-Temporal Deep Neural Network , 2018, IEEE Access.

[158]  Wu Liu,et al.  Attentive Spatial–Temporal Summary Networks for Feature Learning in Irregular Gait Recognition , 2019, IEEE Transactions on Multimedia.

[159]  Mingkui Tan,et al.  A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification , 2021, IEEE transactions on pattern analysis and machine intelligence.

[160]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[161]  Anton Konushin,et al.  View Resistant Gait Recognition , 2019, ICVIP.

[162]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[163]  Guillaume-Alexandre Bilodeau,et al.  Unsupervised Disentanglement GAN for Domain Adaptive Person Re-Identification , 2020, ArXiv.

[164]  Stefano Soatto,et al.  Emergence of Invariance and Disentanglement in Deep Representations , 2017, 2018 Information Theory and Applications Workshop (ITA).

[165]  Feng Liu,et al.  On the Detection of Digital Face Manipulation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[166]  Shiqi Yu,et al.  A model-based gait recognition method with body pose and human prior knowledge , 2020, Pattern Recognit..

[167]  Razvan Pascanu,et al.  Deep Learners Benefit More from Out-of-Distribution Examples , 2011, AISTATS.

[168]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[169]  Manuel J. Marín-Jiménez,et al.  Evaluation of Cnn Architectures for Gait Recognition Based on Optical Flow Maps , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[170]  Paulo Lobato Correia,et al.  Face Recognition: A Novel Multi-Level Taxonomy based Survey , 2019, IET Biom..

[171]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[172]  Na Li,et al.  A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mapping , 2020, ArXiv.

[173]  Nikolaus F. Troje,et al.  Gait Recognition using Multi-Scale Partial Representation Transformation with Capsules , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[174]  Gang Wang,et al.  Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[175]  Jaakko Lehtinen,et al.  Analyzing and Improving the Image Quality of StyleGAN , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[176]  Mark S. Nixon,et al.  Using Gait as a Biometric, via Phase-weighted Magnitude Spectra , 1997, AVBPA.

[177]  Hongdong Li,et al.  Learning Joint Gait Representation via Quintuplet Loss Minimization , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[178]  Yao Guo,et al.  From Emotions to Mood Disorders: A Survey on Gait Analysis Methodology , 2019, IEEE Journal of Biomedical and Health Informatics.

[179]  Yasushi Makihara,et al.  Silhouette transformation based on walking speed for gait identification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[180]  Wei Qi Yan,et al.  Cross-view gait recognition through ensemble learning , 2019, Neural Computing and Applications.

[181]  Ali Etemad,et al.  View-Invariant Gait Recognition With Attentive Recurrent Learning of Partial Representations , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[182]  Thomas Wolf,et al.  Multi-view gait recognition using 3D convolutional neural networks , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[183]  Marco Grangetto,et al.  Gait characterization using dynamic skeleton acquisition , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[184]  Michael C. Mozer,et al.  Learning Deep Disentangled Embeddings with the F-Statistic Loss , 2018, NeurIPS.

[185]  Shiqi Yu,et al.  A comprehensive study on gait biometrics using a joint CNN-based method , 2019, Pattern Recognit..

[186]  Shiqi Wang,et al.  GMFAD: Towards Generalized Visual Recognition via Multi-Layer Feature Alignment and Disentanglement. , 2020, IEEE transactions on pattern analysis and machine intelligence.

[187]  Li Zhuo,et al.  3D Hand Pose Estimation with Disentangled Cross-Modal Latent Space , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[188]  Xin Yu,et al.  Learning Effective Representations from Global and Local Features for Cross-View Gait Recognition , 2020, ArXiv.

[189]  Gerhard Rigoll,et al.  2.5D gait biometrics using the Depth Gradient Histogram Energy Image , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[190]  Ahmed Bouridane,et al.  Gait recognition for person re-identification , 2020, The Journal of Supercomputing.

[191]  Shaogang Gong,et al.  Gait recognition using Gait Entropy Image , 2009, ICDP.

[192]  S. Ali Etemad,et al.  Classification and translation of style and affect in human motion using RBF neural networks , 2014, Neurocomputing.

[193]  Begonya Garcia-Zapirain,et al.  Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications , 2014, Sensors.

[194]  Shunli Zhang,et al.  Gait Recognition with Multiple-Temporal-Scale 3D Convolutional Neural Network , 2020, ACM Multimedia.

[195]  Johan Lukkien,et al.  Multi-task Self-Supervised Learning for Human Activity Detection , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[196]  Zhenyu Wang,et al.  Learning view invariant gait features with Two-Stream GAN , 2019, Neurocomputing.

[197]  Chengcheng Wu,et al.  Gait Recognition Based on Feedback Weight Capsule Network , 2020, 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[198]  Xianglei Xing,et al.  Fusion of Gait and Facial Features using Coupled Projections for People Identification at a Distance , 2015, IEEE Signal Processing Letters.

[199]  Liang Wang,et al.  Learning Representative Deep Features for Image Set Analysis , 2015, IEEE Transactions on Multimedia.

[200]  Luís Ducla Soares,et al.  Gait recognition in the wild using shadow silhouettes , 2018, Image Vis. Comput..

[201]  Ali Etemad,et al.  Self-Supervised Learning for ECG-Based Emotion Recognition , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[202]  Junqin Wen Gait Recognition Based on GF-CNN and Metric Learning , 2020, J. Inf. Process. Syst..

[203]  Benouis Mohamed,et al.  Gait recognition based on model-based methods and deep belief networks , 2016, Int. J. Biom..

[204]  Iasonas Kokkinos,et al.  DensePose: Dense Human Pose Estimation in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[205]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[206]  Yasushi Yagi,et al.  Spatio-temporal silhouette sequence reconstruction for gait recognition against occlusion , 2019, IPSJ Transactions on Computer Vision and Applications.

[207]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[208]  Imran Ashraf,et al.  Prosperous Human Gait Recognition: an end-to-end system based on pre-trained CNN features selection , 2020, Multimedia Tools and Applications.

[209]  Dan Wang,et al.  Cross-View Gait Identification with Embedded Learning , 2017, ACM Multimedia.

[210]  Bernhard Egger,et al.  Analyzing and Reducing the Damage of Dataset Bias to Face Recognition With Synthetic Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[211]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[212]  Carlos D. Castillo,et al.  L2-constrained Softmax Loss for Discriminative Face Verification , 2017, ArXiv.

[213]  Bernd Brügge,et al.  Gait and jump classification in modern equestrian sports , 2018, UbiComp.

[214]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.