Rehabilitation Exercise Segmentation for Autonomous Biofeedback Systems with ConvFSM

Segmenting physical movements is a key step for any accelerometry-based autonomous biofeedback system oriented to rehabilitation and physiotherapy activities. Fundamentally, this can be reduced to the detection of recurrent patterns, also called motion primitives, in longer inertial signals. Most of the solutions developed in the literature require extensive domain knowledge, or are incapable of scaling to complex motion patterns and new exercises. In this paper, we explore the capabilities of inertial measurement units for the segmentation of upper limb rehabilitation exercises. To do so, we introduce a novel segmentation technique based on Convolutional Neural Networks and Finite State Machines, called ConvFSM. ConvFSM is able to isolate motion primitives from raw streaming data, using very little domain knowledge. We also investigate different combinations of sensors, in order to identify the most effective and flexible setup that could fit a home-based rehabilitation feedback system. Experimental results are presented, based on a dataset obtained from a combination of common upper limb and lower limb exercises.

[1]  Héctor Pomares,et al.  Evaluating the effects of signal segmentation on activity recognition , 2014, IWBBIO.

[2]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[3]  M. Tahar Kechadi,et al.  Human Activity Recognition with Convolutional Neural Networks , 2018, ECML/PKDD.

[4]  D. Kulić,et al.  Automatic Human Motion Segmentation and Identification using Feature Guided HMM for Physical Rehabilitation Exercises , 2011 .

[5]  Dana Kulic,et al.  Segmenting human motion for automated rehabilitation exercise analysis , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Jonathan Feng-Shun Lin,et al.  Classification-based Segmentation for Rehabilitation Exercise Monitoring , 2018, Journal of rehabilitation and assistive technologies engineering.

[7]  Yoshua Bengio,et al.  Markovian Models for Sequential Data , 2004 .

[8]  William Robson Schwartz,et al.  Human Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-Art , 2018, ArXiv.

[9]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[10]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[11]  Michelle Karg,et al.  Movement Primitive Segmentation for Human Motion Modeling: A Framework for Analysis , 2016, IEEE Transactions on Human-Machine Systems.

[12]  Brian Caulfield,et al.  Rehabilitation exercise assessment using inertial sensors: a cross-sectional analytical study , 2014, Journal of NeuroEngineering and Rehabilitation.

[13]  Brian Caulfield,et al.  Patient Involvement With Home-Based Exercise Programs: Can Connected Health Interventions Influence Adherence? , 2018, JMIR mHealth and uHealth.

[14]  Alan Bundy,et al.  Dynamic Time Warping , 1984 .

[15]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[16]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[17]  M. Tahar Kechadi,et al.  Automatic classification of knee rehabilitation exercises using a single inertial sensor: A case study , 2018, 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN).