Detection and Evaluation of Physical Therapy Exercises by Dynamic Time Warping Using Wearable Motion Sensor Units

We develop an autonomous system that detects and evaluates physical therapy exercises using wearable motion sensors. We propose an algorithm that detects all the occurrences of one or more template signals (representing exercise movements) in a long signal acquired during a physical therapy session. In matching the signals, the algorithm allows some distortion in time, based on dynamic time warping (DTW). The algorithm classifies the executions in one of the exercises and evaluates them as correct/incorrect, giving the error type if there is any. It also provides a quantitative measure of similarity between each matched execution and its template. To evaluate the performance of the algorithm in physical therapy, a dataset consisting of one template execution and ten test executions of each of the three execution types of eight exercises performed by five subjects is recorded, having a total of 120 and 1,200 exercise executions in the training and test sets, respectively, as well as many idle time intervals in the test signals. The proposed algorithm detects 1,125 executions in the whole test set. 8.58 % of the 1,200 executions are missed and 4.91 % of the idle time intervals are incorrectly detected as executions. The accuracy is 93.46 % only for exercise classification and 88.65 % for simultaneous exercise and execution type classification. The proposed system may be used for both estimating the intensity of the physical therapy session and evaluating the executions to provide feedback to the patient and the specialist.

[1]  Huiru Zheng,et al.  Web-based monitoring system for home-based rehabilitation with stroke patients , 2005, 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05).

[2]  Eamonn J. Keogh,et al.  Scaling up Dynamic Time Warping to Massive Dataset , 1999, PKDD.

[3]  Patrick Boissy,et al.  Accelerometer-based wireless body area network to estimate intensity of therapy in post-acute rehabilitation , 2008, Journal of NeuroEngineering and Rehabilitation.

[4]  M. Decramer,et al.  Quantifying physical activity in daily life with questionnaires and motion sensors in COPD , 2006, European Respiratory Journal.

[5]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .

[6]  Toni Giorgino,et al.  Matching incomplete time series with dynamic time warping: an algorithm and an application to post-stroke rehabilitation , 2009, Artif. Intell. Medicine.

[7]  Aras Yurtman RECOGNITION AND CLASSIFICATION OF HUMAN ACTIVITIES USING WEARABLE SENSORS , 2012 .

[8]  Paul Fergus,et al.  Body Area Networks for Movement Analysis in Physiotherapy Treatments , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[9]  Paul Fergus,et al.  Remote physiotherapy treatments using wireless body sensor networks , 2009, IWCMC.

[10]  Billur Barshan,et al.  Human activity recognition using tag-based localization , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[11]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[12]  Huosheng Hu,et al.  Inertial motion tracking of human arm movements in stroke rehabilitation , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[13]  Jan Brutovsky,et al.  Low-cost motivated rehabilitation system for post-operation exercises , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Huosheng Hu,et al.  A Novel Sensing and Data Fusion System for 3-D Arm Motion Tracking in Telerehabilitation , 2008, IEEE Transactions on Instrumentation and Measurement.

[15]  Emil Jovanov,et al.  An accelerometer-based physical rehabilitation system , 2002, Proceedings of the Thirty-Fourth Southeastern Symposium on System Theory (Cat. No.02EX540).

[16]  José Bravo,et al.  m-Physio: Personalized Accelerometer-based Physical Rehabilitation Platform , 2010 .

[17]  Toni Giorgino,et al.  Wireless Support to Poststroke Rehabilitation: MyHeart's Neurological Rehabilitation Concept , 2009, IEEE Transactions on Information Technology in Biomedicine.