Subject Identification Based on Gait Using a RGB-D Camera

Biometric authentication (i.e., verification of a given subject’s identity using biological characteristics) relying on gait characteristics obtained in a non-intrusive way can be very useful in the area of security, for smart surveillance and access control. In this contribution, we investigated the possibility of carrying out subject identification based on a predictive model built using machine learning techniques, and features extracted from 3-D body joint data provided by a single low-cost RGB-D camera (Microsoft Kinect v2). We obtained a dataset including 400 gait cycles from 20 healthy subjects, and 25 anthropometric measures and gait parameters per gait cycle. Different machine learning algorithms were explored: k-nearest neighbors, decision tree, random forest, support vector machines, multilayer perceptron, and multilayer perceptron ensemble. The algorithm that led to the model with best trade-off between the considered evaluation metrics was the random forest: overall accuracy of 99%, class accuracy of 100 ± 0%, and F1 score of 99 ± 2%. These results show the potential of using a RGB-D camera for subject identification based on quantitative gait analysis.

[1]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[2]  Ricardo Matsumura de Araújo,et al.  Full Body Person Identification Using the Kinect Sensor , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[3]  Kingshuk Chakravarty,et al.  Pose Based Person Identification Using Kinect , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[4]  João Paulo da Silva Cunha,et al.  A novel portable, low-cost kinect-based system for motion analysis in neurological diseases , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Kingshuk Chakravarty,et al.  Person Identification using Skeleton Information from Kinect , 2013, ACHI 2013.

[6]  Marina L. Gavrilova,et al.  DTW-based kernel and rank-level fusion for 3D gait recognition using Kinect , 2015, The Visual Computer.

[7]  Fabio Tozeto Ramos,et al.  Unsupervised clustering of people from ‘skeleton’ data , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  João Paulo Silva Cunha,et al.  System for automatic gait analysis based on a single RGB-D camera , 2018, PloS one.

[9]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[10]  James Nga-Kwok Liu,et al.  Gait flow image: A silhouette-based gait representation for human identification , 2011, Pattern Recognit..

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  T. Therneau,et al.  An Introduction to Recursive Partitioning Using the RPART Routines , 2015 .

[13]  D. Hatzinakos,et al.  Gait recognition: a challenging signal processing technology for biometric identification , 2005, IEEE Signal Processing Magazine.

[14]  Ana L. N. Fred,et al.  Towards View-point Invariant Person Re-identification via Fusion of Anthropometric and Gait Features from Kinect Measurements , 2017, VISIGRAPP.

[15]  Saeid Nahavandi,et al.  A Review of Vision-Based Gait Recognition Methods for Human Identification , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[16]  Paulo Cortez,et al.  Data Mining with Neural Networks and Support Vector Machines Using the R/rminer Tool , 2010, ICDM.

[17]  Klaus Hechenbichler,et al.  Weighted k-Nearest-Neighbor Techniques and Ordinal Classification , 2004 .

[18]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[19]  Chung-Lin Huang,et al.  Gait Analysis for Human Identification through Manifold Learning and HMM , 2008, 2007 IEEE International Symposium on Circuits and Systems.

[20]  Kurt Hornik,et al.  Support Vector Machines in R , 2006 .

[21]  Marina L. Gavrilova,et al.  Kinect gait skeletal joint feature-based person identification , 2017, 2017 IEEE 16th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[22]  Tieniu Tan,et al.  Human identification based on gait , 2005, The Kluwer international series on biometrics.

[23]  Claudia Linnhoff-Popien,et al.  Gait Recognition with Kinect , 2012 .

[24]  Kurt Hornik,et al.  kernlab - An S4 Package for Kernel Methods in R , 2004 .

[25]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Jian Pei,et al.  2012- Data Mining. Concepts and Techniques, 3rd Edition.pdf , 2012 .

[27]  R. Samworth Optimal weighted nearest neighbour classifiers , 2011, 1101.5783.

[28]  Yuanyuan Zhang,et al.  Real Time Gait Recognition System Based on Kinect Skeleton Feature , 2014, ACCV Workshops.

[29]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .