Early recognition of upper limb motor tasks through accelerometers: real-time implementation of a DTW-based algorithm

A new real-time implementation of a Dynamic Time Warping (DTW)-based classification scheme is presented here, and its performance evaluated on experimental data. Nine young adults were requested to perform instances of eight different purposeful movements described in the Wolf Motor Function Test, while wearing a three-axis accelerometer sensor placed on the inner forearm. Results include the correct recognition percentage, as compared to a classification scheme based on the traditional DTW measure, and the recognition percentage as a function of the time elapsed from the beginning of the performed movements. The Real-Time DTW basically performs with the same accuracy of the traditional DTW-based classification scheme (91.5% of correct recognition percentage), a figure that increases to 96.5% if the multidimensional scheme is adopted. Moreover, more than 60% of movements are correctly recognized before their end, thus setting the way for applications in rehabilitation and assistive technologies, where a real-time control scheme is able to interact with the user while the movement is being performed.

[1]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[2]  Toni Giorgino,et al.  Matching incomplete time series with dynamic time warping: an algorithm and an application to post-stroke rehabilitation , 2009, Artif. Intell. Medicine.

[3]  Björn W. Schuller,et al.  A multidimensional dynamic time warping algorithm for efficient multimodal fusion of asynchronous data streams , 2009, Neurocomputing.

[4]  George Awad,et al.  Modelling and segmenting subunits for sign language recognition based on hand motion analysis , 2009, Pattern Recognit. Lett..

[5]  W De Weerdt,et al.  Predicting motor recovery of the upper limb after stroke rehabilitation: value of a clinical examination. , 2000, Physiotherapy research international : the journal for researchers and clinicians in physical therapy.

[6]  David Howard,et al.  Movement variability in stroke patients and controls performing two upper limb functional tasks: a new assessment methodology , 2009, Journal of NeuroEngineering and Rehabilitation.

[7]  Alessandro Tognetti,et al.  CAPTURE AND CLASSIFICATION OF BODY POSTURE AND GESTURE USING WEARABLE KINESTHETIC SYSTEMS , 2005 .

[8]  M Schmid,et al.  An adaptive Kalman-based Bayes estimation technique to classify locomotor activities in young and elderly adults through accelerometers. , 2010, Medical engineering & physics.

[9]  Hsin-Min Wang,et al.  A Query-by-Singing System for Retrieving Karaoke Music , 2008, IEEE Transactions on Multimedia.

[10]  R. Lyle.  A performance test for assessment of upper limb function in physical rehabilitation treatment and research , 1981, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[11]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[12]  Stewart G Trost,et al.  Conducting accelerometer-based activity assessments in field-based research. , 2005, Medicine and science in sports and exercise.

[13]  Hicham Noçairi,et al.  Combination of dynamic time warping and multivariate analysis for the comparison of comprehensive two-dimensional gas chromatograms: application to plant extracts. , 2009, Journal of chromatography. A.

[14]  P. Stratford,et al.  Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. , 1993, Physical therapy.

[15]  Vit Niennattrakul,et al.  Speeding Up Similarity Search on a Large Time Series Dataset under Time Warping Distance , 2009, PAKDD.

[16]  E. Taub,et al.  Objective measurement of functional upper-extremity movement using accelerometer recordings transformed with a threshold filter. , 2000, Stroke.

[17]  Huosheng Hu,et al.  Application of wearable inertial sensors in stroke rehabilitation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[18]  L. Cohen,et al.  Mechanisms underlying recovery of motor function after stroke. , 2004, Postgraduate medical journal.

[19]  I. Manunza,et al.  Pressure sensing using a completely flexible organic transistor. , 2007, Biosensors & bioelectronics.

[20]  Josien C van den Noort,et al.  Evaluation of clinical spasticity assessment in cerebral palsy using inertial sensors. , 2009, Gait & posture.

[21]  Emilio Bizzi,et al.  Virtual-Environment-Based Telerehabilitation in Patients with Stroke , 2005, Presence: Teleoperators & Virtual Environments.

[22]  Susan L Murphy,et al.  Review of physical activity measurement using accelerometers in older adults: considerations for research design and conduct. , 2009, Preventive medicine.

[23]  D. Rossi,et al.  Wearable kinesthetic system for capturing and classifying upper limb gesture in post-stroke rehabilitation , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[24]  Silvia Conforto,et al.  The Median Point DTW Template to Classify Upper Limb Gestures at Different Speeds , 2009 .

[25]  S. Levinson,et al.  Considerations in dynamic time warping algorithms for discrete word recognition , 1978 .