GADER: GAit DEtection and Recognition in the Wild

Gait recognition holds the promise of robustly identifying subjects based on their walking patterns instead of color information. While previous approaches have performed well for curated indoor scenes, they have significantly impeded applicability in unconstrained situations, e.g. outdoor, long distance scenes. We propose an end-to-end GAit DEtection and Recognition (GADER) algorithm for human authentication in challenging outdoor scenarios. Specifically, GADER leverages a Double Helical Signature to detect the fragment of human movement and incorporates a novel gait recognition method, which learns representations by distilling from an auxiliary RGB recognition model. At inference time, GADER only uses the silhouette modality but benefits from a more robust representation. Extensive experiments on indoor and outdoor datasets demonstrate that the proposed method outperforms the State-of-The-Arts for gait recognition and verification, with a significant 20.6% improvement on unconstrained, long distance scenes.

[1]  Seth T. Baird,et al.  Expanding Accurate Person Recognition to New Altitudes and Ranges: The BRIAR Dataset , 2022, 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW).

[2]  Chun Pong Lau,et al.  Multi-Modal Human Authentication Using Silhouettes, Gait and RGB , 2022, 2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG).

[3]  Liang Wang,et al.  A Comprehensive Survey on Deep Gait Recognition: Algorithms, Datasets and Challenges , 2022, ArXiv.

[4]  Annan Li,et al.  Lagrange Motion Analysis and View Embeddings for Improved Gait Recognition , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Xinchen Liu,et al.  Gait Recognition in the Wild with Dense 3D Representations and A Benchmark , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Yongzhen Huang,et al.  Gait Quality Aware Network: Toward the Interpretability of Silhouette-Based Gait Recognition , 2022, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Yongzhen Huang,et al.  GaitEdge: Beyond Plain End-to-end Gait Recognition for Better Practicality , 2022, ECCV.

[8]  A. Yuille,et al.  Learning from Temporal Gradient for Semi-supervised Action Recognition , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Xinmei Tian,et al.  3D Local Convolutional Neural Networks for Gait Recognition , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[10]  Jie Zhou,et al.  Gait Recognition in the Wild: A Benchmark , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Xinggang Wang,et al.  Context-Sensitive Temporal Feature Learning for Gait Recognition , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Vishal M. Patel,et al.  Learning to Restore Images Degraded by Atmospheric Turbulence Using Uncertainty , 2021, 2021 IEEE International Conference on Image Processing (ICIP).

[13]  Carlos D. Castillo,et al.  ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition From Atmospheric Turbulence , 2021, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[14]  A. Etemad,et al.  Deep Gait Recognition: A Survey , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Xin Yu,et al.  Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation , 2020, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Qing Li,et al.  GaitPart: Temporal Part-Based Model for Gait Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[18]  Alfredo Petrosino,et al.  TGLSTM: A time based graph deep learning approach to gait recognition , 2019, Pattern Recognit. Lett..

[19]  Lynn Rochester,et al.  Gait analysis with wearables predicts conversion to Parkinson disease , 2019, Annals of neurology.

[20]  Yasushi Makihara,et al.  Multi-view large population gait dataset and its performance evaluation for cross-view gait recognition , 2018, IPSJ Transactions on Computer Vision and Applications.

[21]  Jianfeng Feng,et al.  GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition , 2018, AAAI.

[22]  Pong C. Yuen,et al.  Improving Gait Recognition with 3D Pose Estimation , 2018, CCBR.

[23]  Shiqi Yu,et al.  Pose-Based Temporal-Spatial Network (PTSN) for Gait Recognition with Carrying and Clothing Variations , 2017, CCBR.

[24]  Xiaogang Wang,et al.  A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Yasushi Makihara,et al.  GEINet: View-invariant gait recognition using a convolutional neural network , 2016, 2016 International Conference on Biometrics (ICB).

[26]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[27]  Emdad Hossain,et al.  Multimodal Feature Learning for Gait Biometric Based Human Identity Recognition , 2013, ICONIP.

[28]  Matti Pietikäinen,et al.  Can gait biometrics be Spoofed? , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[29]  Rama Chellappa,et al.  Applications of a Simple Characterization of Human Gait in Surveillance , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Wei Xiong,et al.  Active energy image plus 2DLPP for gait recognition , 2010, Signal Process..

[31]  Haihong Hu,et al.  Frame difference energy image for gait recognition with incomplete silhouettes , 2009, Pattern Recognit. Lett..

[32]  M. Nixon,et al.  Automated Human Recognition by Gait using Neural Network , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[33]  Xuelong Li,et al.  Gait Components and Their Application to Gender Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Nanning Zheng,et al.  Gait History Image: A Novel Temporal Template for Gait Recognition , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[35]  Nikolaos V. Boulgouris,et al.  Human gait recognition based on matching of body components , 2007, Pattern Recognit..

[36]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[37]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[41]  Sudeep Sarkar,et al.  Toward understanding the limits of gait recognition , 2004, SPIE Defense + Commercial Sensing.

[42]  Tieniu Tan,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Larry S. Davis,et al.  Stride and cadence as a biometric in automatic person identification and verification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[44]  Aaron F. Bobick,et al.  Gait recognition from time-normalized joint-angle trajectories in the walking plane , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[45]  Aaron F. Bobick,et al.  Gait recognition using static, activity-specific parameters , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[46]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Mark S. Nixon,et al.  Dynamic feature extraction via the velocity Hough transform , 1997, Pattern Recognit. Lett..

[48]  E. Adelson,et al.  Analyzing gait with spatiotemporal surfaces , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[49]  Liang Wang,et al.  Cross-View Gait Recognition by Discriminative Feature Learning , 2020, IEEE Transactions on Image Processing.

[50]  Csaba Benedek,et al.  Lidar-Based Gait Analysis and Activity Recognition in a 4D Surveillance System , 2018, IEEE Transactions on Circuits and Systems for Video Technology.