Frequency features and GMM-UBM approach for gait-based person identification using smartphone inertial signals

Gait Recognition using Gaussian Mixture Model-Universal Background Model.Frequency-based feature extraction from Inertial Signals.Important dimensionality reduction. This paper describes the development of a Gait-based Person Identification (GPI) system based on a Gaussian Mixture Model-Universal Background Model (GMM-UBM) approach that uses inertial signals from a smartphone. The system integrates five main modules or steps: signal pre-processing, feature extraction, GMM-UBM training, Maximum A Posteriori (MAP) adaptation, and a comparison module for providing the identified user. This system also integrates new feature extraction strategies proposed recently (Mel Frequency Cepstral Coefficients (MFCCs) and Perceptual Lineal Prediction (PLP) coefficients) for improving the results. This study has been done using the public available dataset called UCI Human Activity Recognition Using Smartphones dataset. A six-fold cross-validation procedure has been carried out, showing the average value for every experiment. The final results demonstrate the capability of the GMM-UBM approach for gait recognition, and show how the PLP coefficients can improve system performance while reducing drastically the number of features (from 561 to 90). The best result shows a User Recognition Error Rate of 34.0% with 30 enrolled users. When reducing the number of enrolled users, the error rate decreases: for a number smaller than six, the URER error becomes lower than 10%.

[1]  Bo Du,et al.  A sparse and discriminative tensor to vector projection for human gait feature representation , 2015, Signal Process..

[2]  Michelle Karg,et al.  Recognition of Affect Based on Gait Patterns , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Marc Van Droogenbroeck,et al.  Frontal-view gait recognition by intra- and inter-frame rectangle size distribution , 2009, Pattern Recognit. Lett..

[4]  Davide Anguita,et al.  Human Activity and Motion Disorder Recognition: towards smarter Interactive Cognitive Environments , 2013, ESANN.

[5]  Jiwen Lu,et al.  Ordinary Preserving Manifold Analysis for Human Age and Head Pose Estimation , 2013, IEEE Transactions on Human-Machine Systems.

[6]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[7]  Christoph Busch,et al.  Scenario test of accelerometer-based biometric gait recognition , 2011, 2011 Third International Workshop on Security and Communication Networks (IWSCN).

[8]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[9]  Gang Wang,et al.  Human Identity and Gender Recognition From Gait Sequences With Arbitrary Walking Directions , 2014, IEEE Transactions on Information Forensics and Security.

[10]  Davide Anguita,et al.  Energy Efficient Smartphone-Based Activity Recognition using Fixed-Point Arithmetic , 2013, J. Univers. Comput. Sci..

[11]  Y.-K. Lee,et al.  Human Activity Recognition via an Accelerometer-Enabled-Smartphone Using Kernel Discriminant Analysis , 2010, 2010 5th International Conference on Future Information Technology.

[12]  Qinghan Xiao,et al.  Technology review - Biometrics-Technology, Application, Challenge, and Computational Intelligence Solutions , 2007, IEEE Computational Intelligence Magazine.

[13]  Jiwen Lu,et al.  Uncorrelated discriminant simplex analysis for view-invariant gait signal computing , 2010, Pattern Recognit. Lett..

[14]  Atsuo Takanishi,et al.  Emotional gait generation method based on emotion mental model — Preliminary experiment with happiness and sadness , 2013, 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[15]  Jiwen Lu,et al.  Gait-Based Human Age Estimation , 2010, IEEE Transactions on Information Forensics and Security.

[16]  Christoph Busch,et al.  Unobtrusive User-Authentication on Mobile Phones Using Biometric Gait Recognition , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[17]  Rui Yan,et al.  Kernel coupled distance metric learning for gait recognition and face recognition , 2013, Neurocomputing.

[18]  Gary M. Weiss,et al.  Cell phone-based biometric identification , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[19]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[20]  Dusan Starcevic,et al.  Walking in Colors: Human Gait Recognition Using Kinect and CBIR , 2013, IEEE MultiMedia.

[21]  M. P. Murray Gait as a total pattern of movement. , 1967, American journal of physical medicine.

[22]  Rajesh B. Mapari,et al.  Real time human pose recognition using leap motion sensor , 2015, 2015 IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN).

[23]  Erik Wästlund,et al.  Exploring Touch-Screen Biometrics for User Identification on Smart Phones , 2011, PrimeLife.

[24]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[25]  Patrick Bours,et al.  Improved Cycle Detection for Accelerometer Based Gait Authentication , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[26]  Mark S. Nixon,et al.  Automatic Recognition by Gait , 2006, Proceedings of the IEEE.

[27]  Steve Young,et al.  The HTK book , 1995 .

[28]  Fernando Fernández Martínez,et al.  Feature extraction from smartphone inertial signals for human activity segmentation , 2016, Signal Process..

[29]  Rui Yan,et al.  Dual-ellipse fitting approach for robust gait periodicity detection , 2012, Neurocomputing.

[30]  Alan W. C. Tan,et al.  Gait recognition via optimally interpolated deformable contours , 2013, Pattern Recognit. Lett..

[31]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[32]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[33]  Toby Sharp,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR.

[34]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[35]  D. Hatzinakos,et al.  Gait recognition: a challenging signal processing technology for biometric identification , 2005, IEEE Signal Processing Magazine.

[36]  Kjetil Holien,et al.  Gait recognition under non-standard circumstances , 2008 .

[37]  Jiwen Lu,et al.  Gait recognition for human identification based on ICA and fuzzy SVM through multiple views fusion , 2007, Pattern Recognit. Lett..

[38]  Jiwen Lu,et al.  Ordinary preserving manifold analysis for human age estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[39]  Shamik Sural,et al.  Frontal gait recognition from occluded scenes , 2015, Pattern Recognit. Lett..

[40]  Patrick Bours,et al.  Gait and activity recognition using commercial phones , 2013, Comput. Secur..

[41]  Satoshi Hoshino,et al.  Impact of artificial "gummy" fingers on fingerprint systems , 2002, IS&T/SPIE Electronic Imaging.

[42]  Danilo Gligoroski,et al.  Walk the Walk: Attacking Gait Biometrics by Imitation , 2010, ISC.

[43]  Jiwen Lu,et al.  Joint Subspace Learning for View-Invariant Gait Recognition , 2011, IEEE Signal Processing Letters.

[44]  Davrondzhon Gafurov,et al.  Performance and security analysis of Gait-based user authentication , 2008 .

[45]  Mikko Lindholm,et al.  Identifying people from gait pattern with accelerometers , 2005, SPIE Defense + Commercial Sensing.

[46]  Kirsi Helkala,et al.  Gait recognition using acceleration from MEMS , 2006, First International Conference on Availability, Reliability and Security (ARES'06).

[47]  Bo Du,et al.  A hypothesis independent subpixel target detector for hyperspectral Images , 2015, Signal Process..

[48]  Young-Koo Lee,et al.  Semi-Markov conditional random fields for accelerometer-based activity recognition , 2010, Applied Intelligence.

[49]  Patrick Bours,et al.  Eigensteps: A giant leap for gait recognition , 2010, 2010 2nd International Workshop on Security and Communication Networks (IWSCN).

[50]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.