Feature extraction from smartphone inertial signals for human activity segmentation

This paper proposes the adaptation of well-known strategies successfully used in speech processing: Mel Frequency Cepstral Coefficients (MFCCs) and Perceptual Linear Prediction (PLP) coefficients. Additionally characteristics like RASTA filtering or delta coefficients are also considered and evaluated for inertial signal processing. These adaptations have been incorporated into a Human Activity Recognition and Segmentation (HARS) system based on Hidden Markov Models (HMMs) for recognizing and segmenting six different physical activities: walking, walking-upstairs, walking-downstairs, sitting, standing and lying.All experiments have been done using a publicly available dataset named UCI Human Activity Recognition Using Smartphones, which includes several sessions with physical activity sequences from 30 volunteers. This dataset has been randomly divided into six subsets for performing a six-fold cross validation procedure. For every experiment, average values from the six-fold cross-validation procedure are shown.The results presented in this paper overcome significantly baseline error rates, constituting a relevant contribution in the field. Adapted MFCC and PLP coefficients improve human activity recognition and segmentation accuracies while reducing feature vector size considerably. RASTA-filtering and delta coefficients contribute significantly to reduce the segmentation error rate obtaining the best results: an Activity Segmentation Error Rate lower than 0.5%. Human activity segmentation using Hidden Markov Models.Frequency-based feature extraction from Inertial Signals.RASTA filtering analysis and delta coefficients.Important dimensionality reduction.

[1]  Hynek Hermansky,et al.  RASTA processing of speech , 1994, IEEE Trans. Speech Audio Process..

[2]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[3]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[4]  Davide Anguita,et al.  Energy Efficient Smartphone-Based Activity Recognition using Fixed-Point Arithmetic , 2013, J. Univers. Comput. Sci..

[5]  Mariusz Kle,et al.  International workshop on Innovations in Information and Communication Science and Technology, IICST 2014, 3-5 September 2014, Warsaw, Poland Unsupervised Feature Pre-training of the Scattering Wavelet Transform for Musical Genre Recognition , 2014 .

[6]  Hichem Sahbi,et al.  Mid-level features and spatio-temporal context for activity recognition , 2012, Pattern Recognit..

[7]  Hitoshi Ogawa,et al.  Human Activity Recognition System Including Smartphone Position , 2014 .

[8]  D. O'Shaughnessy,et al.  Linear predictive coding , 1988, IEEE Potentials.

[9]  Wanmin Wu,et al.  Classification Accuracies of Physical Activities Using Smartphone Motion Sensors , 2012, Journal of medical Internet research.

[10]  David W. Mizell,et al.  Using gravity to estimate accelerometer orientation , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[11]  Gary M. Weiss,et al.  Cell phone-based biometric identification , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[12]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[13]  Jalal A. Nasiri,et al.  Energy-based model of least squares twin Support Vector Machines for human action recognition , 2014, Signal Process..

[14]  Y.-K. Lee,et al.  Human Activity Recognition via an Accelerometer-Enabled-Smartphone Using Kernel Discriminant Analysis , 2010, 2010 5th International Conference on Future Information Technology.

[15]  S. Furui,et al.  Speaker-independent isolated word recognition based on emphasized spectral dynamics , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Christian Peter,et al.  Mobile physical activity recognition of stand-up and sit-down transitions for user behavior analysis , 2010, PETRA '10.

[17]  Surapa Thiemjarus,et al.  Accurate Activity Recognition Using a Mobile Phone Regardless of Device Orientation and Location , 2011, 2011 International Conference on Body Sensor Networks.

[18]  Young-Koo Lee,et al.  Semi-Markov conditional random fields for accelerometer-based activity recognition , 2010, Applied Intelligence.

[19]  Matthias Budde,et al.  ActiServ: Activity Recognition Service for mobile phones , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[20]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[21]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[22]  Jun Yang,et al.  Toward physical activity diary: motion recognition using simple acceleration features with mobile phones , 2009, IMCE '09.

[23]  Friedrich Foerster,et al.  Motion pattern and posture: Correctly assessed by calibrated accelerometers , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[24]  Chiraz Ben Abdelkader Stride and Cadence as a Biometric in Automatic Person Identification and Verification , 2002 .

[25]  Davide Anguita,et al.  Human Activity and Motion Disorder Recognition: towards smarter Interactive Cognitive Environments , 2013, ESANN.

[26]  Yang Yi,et al.  Human action recognition with salient trajectories , 2013, Signal Process..

[27]  H Hermansky,et al.  Perceptual linear predictive (PLP) analysis of speech. , 1990, The Journal of the Acoustical Society of America.

[28]  Andrey Temko,et al.  Acoustic Event Detection and Classification , 2007, Computers in the Human Interaction Loop.

[29]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[30]  Juan-Luis Gorricho,et al.  Activity Recognition from Accelerometer Data on a Mobile Phone , 2009, IWANN.

[31]  Rubén San-Segundo-Hernández,et al.  Human activity monitoring based on hidden Markov models using a smartphone , 2016, IEEE Instrumentation & Measurement Magazine.

[32]  Larry S. Davis,et al.  Stride and cadence as a biometric in automatic person identification and verification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[33]  Tadahiro Kuroda,et al.  Haar-Like Filtering for Human Activity Recognition Using 3D Accelerometer , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[34]  Hynek Hermansky,et al.  Automatic Speech Recognition: an Auditory Perspective , 2004 .

[35]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[36]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[37]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[38]  Stan Davis,et al.  Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Se , 1980 .

[39]  Kalaiarasi Sonai Muthu,et al.  Classification Algorithms in Human Activity Recognition using Smartphones , 2012 .

[40]  Zan Gao,et al.  Multi-view discriminative and structured dictionary learning with group sparsity for human action recognition , 2015, Signal Process..

[41]  Robert Bergevin,et al.  Semantic human activity recognition: A literature review , 2015, Pattern Recognit..

[42]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.