Validation of a Kinect V2 based rehabilitation game

Interactive technologies are beneficial to stroke recovery as rehabilitation interventions; however, they lack evidence for use as assessment tools. Mystic Isle is a multi-planar full-body rehabilitation game developed using the Microsoft Kinect® V2. It aims to help stroke patients improve their motor function and daily activity performance and to assess the motions of the players. It is important that the assessment results generated from Mystic Isle are accurate. The Kinect V2 has been validated for tracking lower limbs and calculating gait-specific parameters. However, few studies have validated the accuracy of the Kinect® V2 skeleton model in upper-body movements. In this paper, we evaluated the spatial accuracy and measurement validity of a Kinect-based game Mystic Isle in comparison to a gold-standard optical motion capture system, the Vicon system. Thirty participants completed six trials in sitting and standing. Game data from the Kinect sensor and the Vicon system were recorded simultaneously, then filtered and sample rate synchronized. The spatial accuracy was evaluated using Pearson’s r correlation coefficient, signal to noise ratio (SNR) and 3D distance difference. Each arm-joint signal had an average correlation coefficient above 0.9 and a SNR above 5. The hip joints data had less stability and a large variation in SNR. Also, the mean 3D distance difference of joints were less than 10 centimeters. For measurement validity, the accuracy was evaluated using mean and standard error of the difference, percentage error, Pearson’s r correlation coefficient and intra-class correlation (ICC). Average errors of maximum hand extent of reach were less than 5% and the average errors of mean and maximum velocities were about 10% and less than 5%, respectively. We have demonstrated that Mystic Isle provides accurate measurement and assessment of movement relative to the Vicon system.

[1]  Julius Verrel,et al.  Accuracy and Reliability of the Kinect Version 2 for Clinical Measurement of Motor Function , 2016, PloS one.

[2]  Neal Sikka,et al.  Emerging Utility of Virtual Reality as a Multidisciplinary Tool in Clinical Medicine. , 2017, Games for health journal.

[3]  Marjorie Skubic,et al.  Comparison of 3D Joint Angles Measured With the Kinect 2.0 Skeletal Tracker Versus a Marker-Based Motion Capture System. , 2017, Journal of applied biomechanics.

[4]  Hieu Minh Trinh,et al.  Robust Real-Time Bio-Kinematic Movement Tracking Using Multiple Kinects for Tele-Rehabilitation , 2016, IEEE Transactions on Industrial Electronics.

[5]  Makoto Yoshizawa,et al.  Diagnosis and rehabilitation of hemispatial neglect patients with virtual reality technology. , 2005, Technology and health care : official journal of the European Society for Engineering and Medicine.

[6]  Marjorie Skubic,et al.  Evaluation of the microsoft kinect skeletal versus depth data analysis for timed-up and go and figure of 8 walk tests , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Melvyn Roerdink,et al.  Kinematic Validation of a Multi-Kinect v2 Instrumented 10-Meter Walkway for Quantitative Gait Assessments , 2015, PloS one.

[8]  Ruzena Bajcsy,et al.  Evaluation of upper extremity reachable workspace using Kinect camera. , 2013, Technology and health care : official journal of the European Society for Engineering and Medicine.

[9]  Hossein Mousavi Hondori,et al.  A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation , 2014, Journal of medical engineering.

[10]  B. Timmons,et al.  "Wii-Hab" in critically ill children: a pilot trial. , 2013, Journal of pediatric rehabilitation medicine.

[11]  Albert A. Rizzo,et al.  Towards pervasive physical rehabilitation using Microsoft Kinect , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[12]  Baihua Li,et al.  Can shoulder range of movement be measured accurately using the Microsoft Kinect sensor plus Medical Interactive Recovery Assistant (MIRA) software? , 2017, Journal of shoulder and elbow surgery.

[13]  Ayanna M. Howard,et al.  Quantitative evaluation of the Microsoft KinectTM for use in an upper extremity virtual rehabilitation environment , 2013, 2013 International Conference on Virtual Rehabilitation (ICVR).

[14]  Marjorie Skubic,et al.  Evaluation of an inexpensive depth camera for in-home gait assessment , 2011, J. Ambient Intell. Smart Environ..

[15]  Winfried Ilg,et al.  Validation of enhanced kinect sensor based motion capturing for gait assessment , 2017, PloS one.

[16]  M. Polat,et al.  Efficacy of neurodevelopmental treatment combined with the Nintendo® Wii in patients with cerebral palsy , 2016, Journal of physical therapy science.

[17]  S. Mawson,et al.  Telerehabilitation: enabling the remote delivery of healthcare, rehabilitation, and self management. , 2009, Studies in health technology and informatics.

[18]  Aviva Weisel-Eichler,et al.  Use of novel virtual reality system for the assessment and treatment of unilateral spatial neglect: A feasibility study , 2011, 2011 International Conference on Virtual Rehabilitation.

[19]  M. Hartmann,et al.  Improved accuracy with an optimized plug-in-gait protocol , 2014 .

[20]  Jurgen Broeren,et al.  Virtual Reality and Haptics as an Assessment Device in the Postacute Phase after Stroke , 2002, Cyberpsychology Behav. Soc. Netw..

[21]  Mark Bolas,et al.  Designing informed game-based rehabilitation tasks leveraging advances in virtual reality , 2012, Disability and rehabilitation.

[22]  S. Azen,et al.  Reliability of goniometric measurements. , 1978, Physical therapy.

[23]  Bryant A Seamon,et al.  Using Xbox kinect motion capture technology to improve clinical rehabilitation outcomes for balance and cardiovascular health in an individual with chronic TBI , 2017, Archives of Physiotherapy.

[24]  Shmuel Springer,et al.  Validity of the Kinect for Gait Assessment: A Focused Review , 2016, Sensors.

[25]  Marjorie Skubic,et al.  Quantitative Assessment and Validation of a Stroke Rehabilitation Game , 2017, 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[26]  Saeid Motiian,et al.  Automated extraction and validation of children’s gait parameters with the Kinect , 2015, BioMedical Engineering OnLine.

[27]  M M Horger,et al.  The reliability of goniometric measurements of active and passive wrist motions. , 1990, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[28]  Kelly Anderson,et al.  Virtual reality video games to promote movement recovery in stroke rehabilitation: a guide for clinicians. , 2015, Archives of physical medicine and rehabilitation.

[29]  Emiel van Trijffel,et al.  Inter-rater reliability for measurement of passive physiological range of motion of upper extremity joints is better if instruments are used: a systematic review. , 2010, Journal of physiotherapy.

[30]  B. Lange,et al.  Considerations in the Efficacy and Effectiveness of Virtual Reality Interventions for Stroke Rehabilitation: Moving the Field Forward , 2014, Physical Therapy.

[31]  Ross A Clark,et al.  Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables. , 2015, Journal of biomechanics.

[32]  James G. Phillips,et al.  Video Games and Virtual Reality as Persuasive Technologies for Health Care: An Overview , 2017, J. Wirel. Mob. Networks Ubiquitous Comput. Dependable Appl..

[33]  B. Lange,et al.  Feasibility of a Customized, In-Home, Game-Based Stroke Exercise Program Using the Microsoft Kinect® Sensor , 2015, International journal of telerehabilitation.

[34]  Uwe Kloos,et al.  Enhancing Medical Communication Training Using Motion Capture, Perspective Taking and Virtual Reality , 2012, MMVR.

[35]  Stephanie Morton,et al.  Reliability and validity of goniometric iPhone applications for the assessment of active shoulder external rotation , 2014, Physiotherapy theory and practice.