A Kinect-Based Virtual Rehabilitation System through Gesture Recognition

Stroke is one of the most common causes of death and long-term disability worldwide. People with motor disabilities caused by stroke experience limitations in performing daily tasks independently, and traditional rehabilitation programs have tediousness and accessibility problems for the patients. It is essential to develop novel and convenient rehabilitation systems to help people with motor impairment overcome these deficiencies. In this paper, we present a Microsoft Kinect sensor (Kinect) based virtual rehabilitation system, which allows a human operator to transmit his gesture information to the virtual environment by performing specified actions designed for our verification tasks. We verify the effectiveness and applicability of the proposed system in two user studies. In the first study, we carried out a left hand and right hand dexterity comparison experiment, in which the characteristic data of normal individuals have been obtained as assessment criteria during their accomplishing designed tasks such as upper limb raising and elbow bending. In the second study, we presented a six-level recovery assessment criterion through a body parts motion monitoring based recovery assessment method. Results suggest that it is effective for our proposed virtual rehabilitation system to assist patients in conducting home-based rehabilitation without physician's supervision.

[1]  Hyeon-Jeong Sin,et al.  Additional Virtual Reality Training Using Xbox Kinect in Stroke Survivors with Hemiplegia , 2013, American journal of physical medicine & rehabilitation.

[2]  Réjean Hébert,et al.  Development and Reliability of an Upper Extremity Function Test for the Elderly: The TEMPA , 1993 .

[3]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[4]  Chuan-Jun Su,et al.  Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic , 2014, Appl. Soft Comput..

[5]  Francisco Javier Díaz Pernas,et al.  A Kinect-based system for cognitive rehabilitation exercises monitoring , 2014, Comput. Methods Programs Biomed..

[6]  E. Taub,et al.  The reliability of the wolf motor function test for assessing upper extremity function after stroke. , 2001, Archives of physical medicine and rehabilitation.

[7]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[8]  B. Dobkin Rehabilitation after Stroke , 2005 .

[9]  Emily Eckel,et al.  Usability evaluation of a kinematics focused Kinect therapy program for individuals with stroke. , 2015, Technology and health care : official journal of the European Society for Engineering and Medicine.

[10]  Ahmet H. Ertas,et al.  A clinically feasible kinematic assessment method of upper extremity motor function impairment after stroke , 2016 .

[11]  S. Wolf,et al.  Forced use of hemiplegic upper extremities to reverse the effect of learned nonuse among chronic stroke and head-injured patients , 1989, Experimental Neurology.

[12]  Le Li,et al.  Mechanism of Kinect-based virtual reality training for motor functional recovery of upper limbs after subacute stroke , 2013, Neural regeneration research.

[13]  R. H. Jebsen,et al.  An objective and standardized test of hand function. , 1969, Archives of physical medicine and rehabilitation.

[14]  Christian Cipriani,et al.  Is it Finger or Wrist Dexterity That is Missing in Current Hand Prostheses? , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Gert Kwakkel,et al.  Predicting Long-Term Independency in Activities of Daily Living After Middle Cerebral Artery Stroke: Does Information From MRI Have Added Predictive Value Compared With Clinical Information? , 2006, Stroke.

[16]  Li-Chieh Kuo,et al.  The associations among hand dexterity, functional performance, and quality of life in diabetic patients with neuropathic hand from objective- and patient-perceived measurements , 2015, Quality of Life Research.