Template-Based Recognition of Human Locomotion in IMU Sensor Data Using Dynamic Time Warping

Increased levels of light, moderate and vigorous physical activity (PA) are positively associated with health benefits. Therefore, sensor-based human activity recognition can identify different types and levels of PA. In this paper, we propose a two-layer locomotion recognition method using dynamic time warping applied to inertial sensor data. Based on a video-validated dataset (ADAPT), which included inertial sensor data recorded at the lower back (L5 position) during an unsupervised task-based free-living protocol, the recognition algorithm was developed, validated and tested. As a first step, we focused on the identification of locomotion activities walking, ascending and descending stairs. These activities are difficult to differentiate due to a high similarity. The results showed that walking could be recognized with a sensitivity of 88% and a specificity of 89%. Specificity for stair climbing was higher compared to walking, but sensitivity was noticeably decreased. In most cases of misclassification, stair climbing was falsely detected as walking, with only 0.2–5% not assigned to any of the chosen types of locomotion. Our results demonstrate a promising approach to recognize and differentiate human locomotion within a variety of daily activities.

[1]  Björn Eskofier,et al.  Stride Segmentation during Free Walk Movements Using Multi-Dimensional Subsequence Dynamic Time Warping on Inertial Sensor Data , 2015, Sensors.

[2]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[3]  Christopher R. Harris,et al.  Accurate and Reliable Gait Cycle Detection in Parkinson's Disease , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Angelo M. Sabatini,et al.  A hidden Markov model-based technique for gait segmentation using a foot-mounted gyroscope , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  A M Jette,et al.  The disablement process. , 1994, Social science & medicine.

[6]  Sergio Escalera,et al.  A Gesture Recognition System for Detecting Behavioral Patterns of ADHD , 2014, IEEE Transactions on Cybernetics.

[7]  D M Buchner,et al.  Unstable disability and the fluctuations of frailty. , 1997, Age and ageing.

[8]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[9]  Diego G. S. Santos,et al.  HAGR-D: A Novel Approach for Gesture Recognition with Depth Maps , 2015, Sensors.

[10]  K. Park,et al.  Gait detection from three dimensional acceleration signals of ankles for the patients with Parkinson ’ s disease , 2022 .

[11]  Jun Wang,et al.  Generalizing DTW to the multi-dimensional case requires an adaptive approach , 2016, Data Mining and Knowledge Discovery.

[12]  José A. Rodríguez-Serrano,et al.  A Model-Based Sequence Similarity with Application to Handwritten Word Spotting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Alan Kevin Bourke,et al.  Development of a gold-standard method for the identification of sedentary, light and moderate physical activities in older adults: Definitions for video annotation. , 2019, Journal of science and medicine in sport.

[14]  K. Khan,et al.  Physical activity to prevent falls in older people: time to intervene in high risk groups using falls as an outcome , 2001, British journal of sports medicine.

[15]  Silvia Conforto,et al.  Early recognition of upper limb motor tasks through accelerometers: real-time implementation of a DTW-based algorithm , 2011, Comput. Biol. Medicine.

[16]  Robert W Motl,et al.  Physical activity, disability, and quality of life in older adults. , 2010, Physical medicine and rehabilitation clinics of North America.

[17]  Phil D. Green,et al.  Isolated word recognition of silent speech using magnetic implants and sensors. , 2010, Medical engineering & physics.

[18]  Yiannos Manoli,et al.  Using multi-dimensional dynamic time warping for TUG test instrumentation with inertial sensors , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[19]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  W. Zijlstra,et al.  Wearable systems for monitoring mobility-related activities in older people: a systematic review , 2008, Clinical rehabilitation.

[21]  S. Iliffe,et al.  Bmc Medical Research Methodology Open Access the Hawthorne Effect: a Randomised, Controlled Trial , 2007 .

[22]  Physical Activity Guidelines Advisory Committee report, 2008. To the Secretary of Health and Human Services. Part A: executive summary. , 2009, Nutrition reviews.

[23]  Geoffrey I. Webb,et al.  Time series classification for varying length series , 2019, ArXiv.

[24]  Mirko Meboldt,et al.  Wearable Inertial Measurement Units for Assessing Gait in Real-World Environments , 2020, Frontiers in Physiology.

[25]  Beatrix Vereijken,et al.  A Physical Activity Reference Data-Set Recorded from Older Adults Using Body-Worn Inertial Sensors and Video Technology—The ADAPT Study Data-Set , 2017, Sensors.

[26]  Ciprian Dobre,et al.  Human Physical Activity Recognition Using Smartphone Sensors , 2019, Sensors.

[27]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Laurent Oudre,et al.  Non-Linear Template-Based Approach for the Study of Locomotion , 2020, Sensors.

[29]  Reza Lotfian,et al.  Impact of sensor misplacement on dynamic time warping based human activity recognition using wearable computers , 2012, Wireless Health.