Test–retest reliability of Kinect’s measurements for the evaluation of upper body recovery of stroke patients

BackgroundPerformance indices provide quantitative measures for the quality of motion, and therefore, assist in analyzing and monitoring patients’ progress. Measurement of performance indices requires costly devices, such as motion capture systems. Recent developments of sensors for game controllers, such as Microsoft Kinect, have motivated many researchers to develop affordable systems for performance measurement applicable to home and clinical care. In this work, the capability of Kinect in finding motion performance indices was assessed by analyzing intra-session and inter-session test–retest reliability.MethodEighteen stroke patients and twelve healthy subjects participated in this investigation. The intra-session and inter-session reliability of eight performance indices, namely mean velocity (MV), normalized mean speed (NMS), normalized speed peaks (NSP), logarithm of dimensionless jerk (LJ), curvature (C), spectral arc length (SAL), shoulder angle (SA), and elbow angle (EA), were assessed using intra-class correlation coefficient (ICC), standard error of measurement (SEM) and coefficient of variation (CV).ResultsThe results showed that, among the performance indices, MV, LJ, C, SA and EA have more than 0.9 ICC together with an acceptable SEM and CV in both stroke patients and healthy subjects. Comparing the results of different therapy sessions showed that MV, LJ and C are more sensitive than other indices, and hence, more capable of reflecting the progress of a patient during the rehabilitation process.ConclusionThe results of this study shows acceptable reliability and sensitivity across the sessions for MV, LJ and C measured by Kinect for both healthy subjects and stroke patients. The results are promising for the development of home-based rehabilitation systems, which can analyze patient’s movements using Kinect as an affordable motion capture sensor.

[1]  J. Deutsch,et al.  Use of a Low-Cost, Commercially Available Gaming Console (Wii) for Rehabilitation of an Adolescent With Cerebral Palsy , 2008, Physical Therapy.

[2]  Theo Gasser,et al.  Assessing intrarater, interrater and test–retest reliability of continuous measurements , 2002, Statistics in medicine.

[3]  J. Torrie,et al.  Principles and Procedures of Statistics with Special Reference to the Biological Sciences , 1962 .

[4]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[5]  Kwang Gi Kim,et al.  Nintendo Wii remote controllers for head posture measurement: accuracy, validity, and reliability of the infrared optical head tracker. , 2012, Investigative ophthalmology & visual science.

[6]  Amee L. Seitz,et al.  Validity and reliability of Kinect skeleton for measuring shoulder joint angles: a feasibility study. , 2015, Physiotherapy.

[7]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[8]  T. Platz,et al.  Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer Test, Action Research Arm Test and Box and Block Test: a multicentre study , 2005, Clinical rehabilitation.

[9]  Isabelle Laffont,et al.  The Contribution of Kinematics in the Assessment of Upper Limb Motor Recovery Early After Stroke , 2014, Neurorehabilitation and neural repair.

[10]  Dara Meldrum,et al.  Virtual reality rehabilitation of balance: assessment of the usability of the Nintendo Wii® Fit Plus , 2012, Disability and rehabilitation. Assistive technology.

[11]  Paolo Bonato,et al.  Patient specific ankle-foot orthoses using rapid prototyping , 2011, Journal of NeuroEngineering and Rehabilitation.

[12]  Le Li,et al.  Mechanism of Kinect-based virtual reality training for motor functional recovery of upper limbs after subacute stroke , 2013, Neural regeneration research.

[13]  W G Hopkins,et al.  Measures of Reliability in Sports Medicine and Science , 2000, Sports medicine.

[14]  J. Weir Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. , 2005, Journal of strength and conditioning research.

[15]  Daria Tsoupikova,et al.  Virtual Reality Environment Assisting Post Stroke Hand Rehabilitation: Case Report , 2013, MMVR.

[16]  Ashley N. Johnson,et al.  Dual-task motor performance with a tongue-operated assistive technology compared with hand operations , 2012, Journal of NeuroEngineering and Rehabilitation.

[17]  Erik A Wikstrom,et al.  Validity and reliability of Nintendo Wii Fit balance scores. , 2012, Journal of athletic training.

[18]  David Webster,et al.  Experimental evaluation of Microsoft Kinect's accuracy and capture rate for stroke rehabilitation applications , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[19]  Derek Abbott,et al.  Arm movement speed assessment via a Kinect camera: A preliminary study in healthy subjects , 2014, Biomedical engineering online.

[20]  Dagmar Sternad,et al.  Sensitivity of Smoothness Measures to Movement Duration, Amplitude, and Arrests , 2009, Journal of motor behavior.

[21]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[22]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[23]  Rieko Osu,et al.  Quantifying the quality of hand movement in stroke patients through three-dimensional curvature , 2011, Journal of NeuroEngineering and Rehabilitation.

[24]  B Bonnechère,et al.  Validity and reliability of the Kinect within functional assessment activities: comparison with standard stereophotogrammetry. , 2014, Gait & posture.

[25]  N. Hogan,et al.  Movement Smoothness Changes during Stroke Recovery , 2002, The Journal of Neuroscience.

[26]  Saeed Behzadipour,et al.  Accuracy of Kinect’s skeleton tracking for upper body rehabilitation applications , 2014, Disability and rehabilitation. Assistive technology.

[27]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[28]  S. Black,et al.  The Fugl-Meyer Assessment of Motor Recovery after Stroke: A Critical Review of Its Measurement Properties , 2002, Neurorehabilitation and neural repair.

[29]  John Darby,et al.  Gait and Posture , 2016 .

[30]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[31]  Etienne Burdet,et al.  A Robust and Sensitive Metric for Quantifying Movement Smoothness , 2012, IEEE Transactions on Biomedical Engineering.

[32]  Austin J. Brockmeier,et al.  An Association Framework to Analyze Dependence Structure in Time Series , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.

[34]  Stepán Obdrzálek,et al.  Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  Dae-Sung Park,et al.  Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation , 2014, Journal of NeuroEngineering and Rehabilitation.

[36]  Alessandra Mazzone,et al.  Test–Retest Reliability of Robotic Assessment Measures for the Evaluation of Upper Limb Recovery , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Eric Wade,et al.  Virtual Reality and Robotics for Stroke Rehabilitation: Where Do We Go from Here? , 2011, Topics in stroke rehabilitation.