Cross-view gait recognition by fusion of multiple transformation consistency measures

Gait is a promising modality for forensic science because it has discrimination ability even if the gait features are extracted from low-quality image sequences captured at a distance. However, in forensic cases the observation view is often different, leading to accuracy degradation. Therefore the authors propose a gait recognition algorithm that achieves high accuracy in cases where observation views are different. They used a view transformation technique, and generated multiple joint gait features by changing the source gait features. They formed a hypothesis that the multiple transformed features and original features should be similar to each other if the target subjects are the same. They calculated multiple scores that measured the consistency of the features, and a likelihood ratio from the scores. To evaluate the accuracy of the proposed method, they drew Tippett plots and empirical cross-entropy plots, together with cumulative match characteristic curves and receiver operator characteristic curves, and evaluated discrimination ability and calibration quality. The results showed that their proposed method achieves good results in terms of discrimination and calibration.

[1]  Tao Xiang,et al.  Gait Recognition by Ranking , 2012, ECCV.

[2]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yasushi Makihara,et al.  Quality-dependent view transformation model for cross-view gait recognition , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[4]  Julian Fierrez,et al.  Dealing with sensor interoperability in multi-biometrics: the UPM experience at the Biosecure Multimodal Evaluation 2007 , 2008, SPIE Defense + Commercial Sensing.

[5]  Niels Lynnerup,et al.  Gait as evidence , 2014, IET Biom..

[6]  Rama Chellappa,et al.  Towards a view invariant gait recognition algorithm , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[7]  James Nga-Kwok Liu,et al.  Gait flow image: A silhouette-based gait representation for human identification , 2011, Pattern Recognit..

[8]  Raymond N. J. Veldhuis,et al.  Forensic biometrics: From two communities to one discipline , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[9]  Imed Bouchrika,et al.  On Using Gait in Forensic Biometrics , 2011, Journal of forensic sciences.

[10]  Ryo Kurazume,et al.  Person Identification from Spatio-temporal 3D Gait , 2010, 2010 International Conference on Emerging Security Technologies.

[11]  S. Sathiya Keerthi,et al.  Efficient algorithms for ranking with SVMs , 2010, Information Retrieval.

[12]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[13]  Yasushi Makihara,et al.  View transformation-based cross-view gait recognition using transformation consistency measure , 2014, 2nd International Workshop on Biometrics and Forensics.

[14]  Hirotake Yamazoe,et al.  Adaptation of Appearance Model for Human Tracking Using Geometorical Pixel Value Distributions , 2003 .

[15]  Robert Bergevin,et al.  Computing and evaluating view-normalized body part trajectories , 2009, Image Vis. Comput..

[16]  Amit K. Roy-Chowdhury,et al.  A study on view-insensitive gait recognition , 2005, IEEE International Conference on Image Processing 2005.

[17]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tom Fawcett,et al.  PAV and the ROC convex hull , 2007, Machine Learning.

[19]  Niels Lynnerup,et al.  Person identification by gait analysis and photogrammetry. , 2005, Journal of forensic sciences.

[20]  Jiwen Lu,et al.  Uncorrelated discriminant simplex analysis for view-invariant gait signal computing , 2010, Pattern Recognit. Lett..

[21]  Yasushi Makihara,et al.  Gait Recognition Using a View Transformation Model in the Frequency Domain , 2006, ECCV.

[22]  Anil K. Jain,et al.  Likelihood Ratio-Based Biometric Score Fusion , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Jiwen Lu,et al.  Joint Subspace Learning for View-Invariant Gait Recognition , 2011, IEEE Signal Processing Letters.

[24]  Yasushi Makihara,et al.  Arbitrary view transformation model for gait person authentication , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[25]  Yasushi Makihara,et al.  Gait Verification System for Criminal Investigation , 2013, IPSJ Trans. Comput. Vis. Appl..

[26]  Qiang Wu,et al.  Gait Recognition Under Various Viewing Angles Based on Correlated Motion Regression , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Grzegorz Zadora,et al.  Information‐Theoretical Assessment of the Performance of Likelihood Ratio Computation Methods , 2013, Journal of forensic sciences.

[28]  Qiang Wu,et al.  Support vector regression for multi-view gait recognition based on local motion feature selection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.