Gait-DenseNet: A Hybrid Convolutional Neural Network for Gait Recognition and model-free approaches. Model-based approach [1, 2, 3, 4, 5] models the human body by using

—Gait is the walking posture of a human, which involves movements of joints at upper limbs and lower limbs of the body. In gait recognition, the human appearance changes are taken into account, which makes it easier to differentiate every individual. However, covariates such as viewing angle, clothing and carrying condition act as the crucial factors that affect the gait recognition process. In this work, a hybrid model that integrates pre-trained DenseNet-201 and multilayer perceptron is presented. The method first extracts the gait energy image by windowing the gait binary images. Sub-sequently, transfer learning of the pre-trained DenseNet-201 model is leveraged to learn the representative features of the gait energy image. A multilayer perceptron is then used to further capture the relationships between these features. Finally, a classification layer assigns the features to the associated class label. The performance of the proposed method is evaluated on CASIA-B dataset, OU-ISIR D dataset and OU-ISIR Large Population dataset. The experimental results show significant improvements on all the datasets compared to the state-of-the- art methods.

[1]  S. Balamurugan,et al.  Deep Features Based Multiview Gait Recognition , 2021 .

[2]  Hongming Shan,et al.  Selfgait: A Spatiotemporal Representation Learning Method for Self-Supervised Gait Recognition , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Xin Yu,et al.  Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation , 2020, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Ali Etemad,et al.  View-Invariant Gait Recognition With Attentive Recurrent Learning of Partial Representations , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[5]  C. Pluempitiwiriyawej,et al.  Gait Biometric-based Human Recognition System Using Deep Convolutional Neural Network in Surveillance System , 2020, 2020 Asia Conference on Computers and Communications (ACCC).

[6]  Ahmed Bouridane,et al.  Gait recognition for person re-identification , 2020, The Journal of Supercomputing.

[7]  Qing Li,et al.  GaitPart: Temporal Part-Based Model for Gait Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xiaoyang Liu,et al.  Gait Recognition Method of Underground Coal Mine Personnel Based on Densely Connected Convolution Network and Stacked Convolutional Autoencoder , 2020, Entropy.

[9]  Tanzila Saba,et al.  A Machine Learning Method with Threshold Based Parallel Feature Fusion and Feature Selection for Automated Gait Recognition , 2020, J. Organ. End User Comput..

[10]  Suresh Chandra Satapathy,et al.  A multilevel paradigm for deep convolutional neural network features selection with an application to human gait recognition , 2020, Expert Syst. J. Knowl. Eng..

[11]  Chin Poo Lee,et al.  Gait recognition using histograms of temporal gradients , 2020 .

[12]  Shiqi Yu,et al.  A model-based gait recognition method with body pose and human prior knowledge , 2020, Pattern Recognit..

[13]  Xiuhui Wang,et al.  Gait feature extraction and gait classification using two-branch CNN , 2019, Multimedia Tools and Applications.

[14]  Liang Wang,et al.  GaitNet: An end-to-end network for gait based human identification , 2019, Pattern Recognit..

[15]  Thian Song Ong,et al.  Gait Recognition Using Deep Convolutional Features , 2019, 2019 7th International Conference on Information and Communication Technology (ICoICT).

[16]  Yasushi Makihara,et al.  Joint Intensity Transformer Network for Gait Recognition Robust Against Clothing and Carrying Status , 2019, IEEE Transactions on Information Forensics and Security.

[17]  Imad Rida,et al.  Towards Human Body-Part Learning for Model-Free Gait Recognition , 2019, ArXiv.

[18]  Wonjun Kim,et al.  Skeleton-Based Gait Recognition via Robust Frame-Level Matching , 2019, IEEE Transactions on Information Forensics and Security.

[19]  Worapan Kusakunniran,et al.  Deep Trajectory Based Gait Recognition for Human Re-identification , 2018, TENCON 2018 - 2018 IEEE Region 10 Conference.

[20]  Jiande Sun,et al.  View-invariant gait recognition based on kinect skeleton feature , 2018, Multimedia Tools and Applications.

[21]  Marcin Grzegorzek,et al.  Spatiotemporal features of human motion for gait recognition , 2018, Signal Image Video Process..

[22]  Jian Weng,et al.  Feedback weight convolutional neural network for gait recognition , 2018, J. Vis. Commun. Image Represent..

[23]  Cong Wang,et al.  Human gait recognition based on deterministic learning and Kinect sensor , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[24]  Wei Zeng,et al.  Fusion of spatial-temporal and kinematic features for gait recognition with deterministic learning , 2017, Pattern Recognit..

[25]  Chin Poo Lee,et al.  Gait recognition using temporal gradient patterns , 2017, 2017 5th International Conference on Information and Communication Technology (ICoIC7).

[26]  Chao Li,et al.  DeepGait: A Learning Deep Convolutional Representation for View-Invariant Gait Recognition Using Joint Bayesian , 2017 .

[27]  Xiaogang Wang,et al.  A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jing Li,et al.  Gait recognition based on 3D skeleton joints captured by kinect , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[30]  Yasushi Makihara,et al.  GEINet: View-invariant gait recognition using a convolutional neural network , 2016, 2016 International Conference on Biometrics (ICB).

[31]  Alan W. C. Tan,et al.  Gait recognition with Transient Binary Patterns , 2015, J. Vis. Commun. Image Represent..

[32]  Ausif Mahmood,et al.  Improved Gait recognition based on specialized deep convolutional neural networks , 2015, 2015 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[33]  Smriti Srivastava,et al.  Gait recognition using gait Gaussian image , 2015, 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN).

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Alan W. C. Tan,et al.  Gait probability image: An information-theoretic model of gait representation , 2014, J. Vis. Commun. Image Represent..

[36]  Alan W. C. Tan,et al.  Time-sliced averaged motion history image for gait recognition , 2014, J. Vis. Commun. Image Represent..

[37]  Wei Zeng,et al.  Model-Based Human Gait Recognition Via Deterministic Learning , 2014, Cognitive Computation.

[38]  Kosuke Okusa,et al.  Fast gait parameter estimation for frontal view gait video data based on the model selection and parameter optimization approach , 2013 .

[39]  Alan W. C. Tan,et al.  Gait recognition via optimally interpolated deformable contours , 2013, Pattern Recognit. Lett..

[40]  Kosuke Okusa,et al.  Gait parameter and speed estimation from the frontal view gait video data based on the gait motion and spatial modeling , 2013 .

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[43]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Treadmill Dataset , 2012, IPSJ Trans. Comput. Vis. Appl..

[44]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[45]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Junqin Wen Gait Recognition Based on GF-CNN and Metric Learning , 2020, J. Inf. Process. Syst..

[47]  Kosuke Okusa,et al.  Human Gait Modeling and Statistical Registration for the Frontal View Gait Data with Application to the Normal/Abnormal Gait Analysis , 2014 .