Beyond view transformation: feature distribution consistent GANs for cross-view gait recognition

Gait recognition systems have shown great potentials in the field of biometric recognition. Unfortunately, the accuracy of gait recognition is easily affected by a large view angle. To address the problem, this study proposes a feature distribution consistent generative adversarial network (FDC-GAN) to transform gait images from arbitrary views to the target view and then perform identity recognition. Besides reconstruction loss, view classification and identity preserving loss are also introduced to guide the generator to produce gait images of the target views and keep identity information simultaneously. To further encourage the network to generate gait images whose feature distribution can well align the true distribution, we also exploit the recently proposed recurrent cycle consistency loss, which can help to remove the unnoticed and useless content preserved in the generated gait images. The experimental results on datasets CASIA-B and OU-MVLP demonstrate the state-of-the-art performance of our model compared to other GAN-based cross-view gait recognition models.

[1]  Jingsong Xu,et al.  VN-GAN: Identity-preserved Variation Normalizing GAN for Gait Recognition , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[2]  Xianglei Xing,et al.  Complete canonical correlation analysis with application to multi-view gait recognition , 2016, Pattern Recognit..

[3]  Fukun Bi,et al.  SSGAN: generative adversarial networks for the stroke segmentation of calligraphic characters , 2021 .

[4]  Michel F. Valstar,et al.  Triple consistency loss for pairing distributions in GAN-based face synthesis , 2018, ArXiv.

[5]  Ahmed A. Abd El-Latif,et al.  Toward accurate localization and high recognition performance for noisy iris images , 2012, Multimedia Tools and Applications.

[6]  Qiang Wu,et al.  Support vector regression for multi-view gait recognition based on local motion feature selection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jiangjian Xiao,et al.  Facial expression GAN for voice-driven face generation , 2021, Vis. Comput..

[9]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[10]  Ayman El-Sayed,et al.  Iris Recognition Using Multi-Algorithmic Approaches for Cognitive Internet of things (CIoT) Framework , 2018, Future Gener. Comput. Syst..

[11]  Hongming Shan,et al.  Multi-Task GANs for View-Specific Feature Learning in Gait Recognition , 2019, IEEE Transactions on Information Forensics and Security.

[12]  Michel Valstar,et al.  A recurrent cycle consistency loss for progressive face-to-face synthesis , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[13]  Shiqi Yu,et al.  GaitGAN: Invariant Gait Feature Extraction Using Generative Adversarial Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Qiang Wu,et al.  Multiple views gait recognition using View Transformation Model based on optimized Gait Energy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[15]  Zhenyu Wang,et al.  Learning view invariant gait features with Two-Stream GAN , 2019, Neurocomputing.

[16]  Jiwen Lu,et al.  Uncorrelated discriminant simplex analysis for view-invariant gait signal computing , 2010, Pattern Recognit. Lett..

[17]  Yasushi Makihara,et al.  Cross-View Gait Recognition Using Pairwise Spatial Transformer Networks , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  James J. Little,et al.  View-Invariant Discriminative Projection for Multi-View Gait-Based Human Identification , 2013, IEEE Transactions on Information Forensics and Security.

[19]  Yi Yang,et al.  Similarity-preserving Image-image Domain Adaptation for Person Re-identification , 2018, ArXiv.

[20]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Haizhou Li,et al.  Optimizing Voice Conversion Network with Cycle Consistency Loss of Speaker Identity , 2020, 2021 IEEE Spoken Language Technology Workshop (SLT).

[22]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[23]  Ahmed A. Abd El-Latif,et al.  An enhanced thermal face recognition method based on multiscale complex fusion for Gabor coefficients , 2013, Multimedia Tools and Applications.

[24]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Guisheng Yin,et al.  $\hbox {S}^2\hbox {RGAN}$: sonar-image super-resolution based on generative adversarial network , 2020, Vis. Comput..

[26]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Jingsong Xu,et al.  VT-GAN: View Transformation GAN for Gait Recognition Across Views , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[28]  Jianfeng Feng,et al.  GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition , 2018, AAAI.

[29]  Somnath Dey,et al.  Fingerprint liveness detection using local quality features , 2018, The Visual Computer.

[30]  Liang Wang,et al.  GaitNet: An end-to-end network for gait based human identification , 2019, Pattern Recognit..

[31]  Keren Fu,et al.  Identity-and-pose-guided generative adversarial network for face rotation , 2021, Neurocomputing.

[32]  Gunawan Ariyanto,et al.  Model-based 3D gait biometrics , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[33]  Shijian Lu,et al.  Spatial-Aware GAN for Unsupervised Person Re- identification , 2019, 2020 25th International Conference on Pattern Recognition (ICPR).

[34]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[35]  Yasushi Makihara,et al.  Gait Recognition Using a View Transformation Model in the Frequency Domain , 2006, ECCV.

[36]  Chen Gao,et al.  PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Yongzhen Huang,et al.  Dense-View GEIs Set: View Space Covering for Gait Recognition based on Dense-View GAN , 2020, 2020 IEEE International Joint Conference on Biometrics (IJCB).

[38]  Mark S. Nixon,et al.  Self-Calibrating View-Invariant Gait Biometrics , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Yasushi Makihara,et al.  Multi-view large population gait dataset and its performance evaluation for cross-view gait recognition , 2018, IPSJ Transactions on Computer Vision and Applications.

[40]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[42]  Seah Hock Soon,et al.  A Multiple Camera System with Real-Time Volume Reconstruction for Articulated Skeleton Pose Tracking , 2011, MMM.