A Hidden Semi-Markov Model based approach for rehabilitation exercise assessment

In this paper, a Hidden Semi-Markov Model (HSMM) based approach is proposed to evaluate and monitor body motion during a rehabilitation training program. The approach extracts clinically relevant motion features from skeleton joint trajectories, acquired by the RGB-D camera, and provides a score for the subject's performance. The approach combines different aspects of rule and template based methods. The features have been defined by clinicians as exercise descriptors and are then assessed by a HSMM, trained upon an exemplar motion sequence. The reliability of the proposed approach is studied by evaluating its correlation with both a clinical assessment and a Dynamic Time Warping (DTW) algorithm, while healthy and neurological disabled people performed physical exercises. With respect to the discrimination between healthy and pathological conditions, the HSMM based method correlates better with the physician's score than DTW. The study supports the use of HSMMs to assess motor performance providing a quantitative feedback to physiotherapist and patients. This result is particularly appropriate and useful for a remote assessment in the home.

[1]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .

[2]  S. McEwen,et al.  Exercise-enhanced neuroplasticity targeting motor and cognitive circuitry in Parkinson's disease , 2013, The Lancet Neurology.

[3]  Alexandros Iosifidis,et al.  View-Invariant Action Recognition Based on Artificial Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Min-Chun Hu,et al.  Real-Time Human Movement Retrieval and Assessment With Kinect Sensor , 2015, IEEE Transactions on Cybernetics.

[6]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[7]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[8]  Moi Hoon Yap,et al.  Automated Analysis and Quantification of Human Mobility Using a Depth Sensor , 2017, IEEE Journal of Biomedical and Health Informatics.

[9]  Ruzena Bajcsy,et al.  Recognizing the intensity of strength training exercises with wearable sensors , 2015, J. Biomed. Informatics.

[10]  Francisco Javier Ferrández Pastor,et al.  A vision based proposal for classification of normal and abnormal gait using RGB camera , 2016, J. Biomed. Informatics.

[11]  Hao Ma,et al.  Human Gait Modeling and Analysis Using a Semi-Markov Process With Ground Reaction Forces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[13]  Xi Long,et al.  Sleep and Wake Classification With Actigraphy and Respiratory Effort Using Dynamic Warping , 2014, IEEE Journal of Biomedical and Health Informatics.

[14]  Zhe Zhang,et al.  Objective Assessment of Upper-Limb Mobility for Poststroke Rehabilitation , 2016, IEEE Transactions on Biomedical Engineering.

[15]  Jonathan Feng-Shun Lin,et al.  Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[17]  Chuan-Jun Su,et al.  Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic , 2014, Appl. Soft Comput..

[18]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[19]  Shunzheng Yu,et al.  Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2006, IEEE Transactions on Signal Processing.

[20]  Kai Liu,et al.  Profile HMMs for skeleton-based human action recognition , 2016, Signal Process. Image Commun..

[21]  Raymond W. McGorry,et al.  The validity of the first and second generation Microsoft Kinect™ for identifying joint center locations during static postures. , 2015, Applied ergonomics.

[22]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[23]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[24]  Victoria Barr,et al.  The expanded Chronic Care Model: an integration of concepts and strategies from population health promotion and the Chronic Care Model. , 2003, Hospital quarterly.