Development of a Diagnosis and Evaluation System for Hemiplegic Patients Post-Stroke Based on Motion Recognition Tracking and Analysis of Wrist Joint Kinematics

An inexperienced therapist lacks the analysis of a patient’s movement. In addition, the patient does not receive objective feedback from the therapist due to the visual subjective judgment. The aim is to provide a guide for in-depth rehabilitation therapy in virtual space by continuously tracking the user’s wrist joint during Leap Motion Controller (LMC) activities and present the basic data to confirm steady therapy results in real-time. The conventional Box and Block Test (BBT) is commonly used in upper extremity rehabilitation therapy. It was modeled in proportion to the actual size and Auto Desk Inventor was used to perform the 3D modeling work. The created 3D object was then implemented in C # through Unity5.6.2p4 based on LMC. After obtaining a wrist joint motion value, the motion was analyzed by 3D graph. Healthy subjects (23 males and 25 females, n = 48) were enrolled in this study. There was no statistically significant counting difference between conventional BBT and system BBT. This indicates the possibility of effective diagnosis and evaluation of hemiplegic patients post-stroke. We can keep track of wrist joints, check real-time continuous feedback in the implemented virtual space, and provide the basic data for an LMC-based quantitative rehabilitation therapy guide.

[1]  T. Olsen,et al.  Compensation in recovery of upper extremity function after stroke: the Copenhagen Stroke Study. , 1994, Archives of physical medicine and rehabilitation.

[2]  Sarinya Sriphetcharawut,et al.  Effectiveness of Information Processing Strategy Training on Academic Task Performance in Children with Learning Disabilities: A Pilot Study , 2017, Occupational therapy international.

[3]  Eugene Tunik,et al.  Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. , 2009, Studies in health technology and informatics.

[4]  James R. Andrews,et al.  Closed and Open Kinetic Chain Exercise for the Upper Extremity , 1996 .

[5]  A Qualitative Study to Explore Ways to Observe Results of Engaging Activities in Clients with Dementia , 2017, Occupational therapy international.

[6]  H. Flor,et al.  Plasticity in the motor system related to therapy-induced improvement of movement after stroke. , 1999, Neuroreport.

[7]  J. Vaupel,et al.  Ageing populations: the challenges ahead , 2009, The Lancet.

[8]  Virgil G Mathiowetz,et al.  Box and Block Test of Manual Dexterity: Norms for 6–19 Year Olds , 1985 .

[9]  Jeffrey W Jutai,et al.  The Necessity and Limitations of Evidence-Based Practice in Stroke Rehabilitation , 2003, Topics in stroke rehabilitation.

[10]  Yuan-Shin Lee,et al.  Evaluation of an Augmented Virtual Reality and Haptic Control Interface for Psychomotor Training , 2014, Assistive technology : the official journal of RESNA.

[11]  Robert Teasell,et al.  Stroke Rehabilitation: An International Perspective , 2009, Topics in stroke rehabilitation.

[12]  P. Clark,et al.  Factors Influencing Stroke Survivors' Quality of Life During Subacute Recovery , 2005, Stroke.

[13]  K Lee,et al.  Roughness preserving filter design to remove spatial noise from stereoscopic skin images for stable haptic rendering , 2017, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[14]  G. Kwakkel,et al.  Predicting disability in stroke--a critical review of the literature. , 1996, Age and ageing.

[15]  V. Mathiowetz,et al.  Adult norms for the Box and Block Test of manual dexterity. , 1985, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[16]  Min Ho Chun,et al.  The Effect of Virtual Reality Training on Unilateral Spatial Neglect in Stroke Patients , 2011, Annals of rehabilitation medicine.

[17]  D. Feldman.  Synaptic mechanisms for plasticity in neocortex. , 2009, Annual review of neuroscience.

[18]  Jong-Moon Chung,et al.  Augmented Reality based Low Power Consuming Smartphone Control Scheme , 2017, KSII Trans. Internet Inf. Syst..

[19]  Onseok Lee,et al.  An extended Kalman filter for mouse tracking , 2018, Medical & Biological Engineering & Computing.

[20]  J. Deutsch,et al.  Virtual Reality for Stroke Rehabilitation , 2011, The Cochrane database of systematic reviews.

[21]  K. Uğurbil,et al.  Analysis of fMRI and finger tracking training in subjects with chronic stroke. , 2002, Brain : a journal of neurology.

[22]  N Jeremy Hill,et al.  Validation of the Leap Motion Controller using markered motion capture technology. , 2016, Journal of biomechanics.

[23]  J. P. Miller,et al.  Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the EXCITE randomized clinical trial. , 2006, JAMA.

[24]  Luigi Cinque,et al.  Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures , 2018, IEEE Transactions on Multimedia.

[25]  J. Rothwell,et al.  Endogenous control of waking brain rhythms induces neuroplasticity in humans , 2010, The European journal of neuroscience.

[26]  Soo Kyun Kim,et al.  Development of Augmented Reality Indoor Navigation System based on Enhanced A* Algorithm , 2019, KSII Trans. Internet Inf. Syst..

[27]  Tong Zhang,et al.  Leap Motion-based virtual reality training for improving motor functional recovery of upper limbs and neural reorganization in subacute stroke patients , 2017, Neural regeneration research.

[28]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Meta-Analysis and Implications for Clinicians , 2011, Stroke.

[29]  Richard W. Bohannon,et al.  Treatment Interventions for the Paretic Upper Limb of Stroke Survivors: A Critical Review , 2003, Neurorehabilitation and neural repair.

[30]  Daniele Regazzoni,et al.  Hand rehabilitation assessment system using leap motion controller , 2019, AI & SOCIETY.

[31]  Munir S. Alam,et al.  Factors Influencing the , 2016 .

[32]  J. Deutsch,et al.  Virtual Reality for Stroke Rehabilitation , 2012 .

[33]  P. Langhorne,et al.  Motor recovery after stroke: a systematic review , 2009, The Lancet Neurology.

[34]  P. Phasukkit,et al.  Hand postures for evaluating trigger finger using leap motion controller , 2015, 2015 8th Biomedical Engineering International Conference (BMEiCON).

[35]  F. Fusco,et al.  Leap motion controlled videogame-based therapy for rehabilitation of elderly patients with subacute stroke: a feasibility pilot study , 2015, Topics in stroke rehabilitation.

[36]  Aray Kassenkhan,et al.  Gamification of Hand Rehabilitation Process Using Virtual Reality Tools: Using Leap Motion for Hand Rehabilitation , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[37]  Joze Guna,et al.  An Analysis of the Precision and Reliability of the Leap Motion Sensor and Its Suitability for Static and Dynamic Tracking , 2014, Sensors.

[38]  Daria Tsoupikova,et al.  Virtual Immersion for Post-Stroke Hand Rehabilitation Therapy , 2015, Annals of Biomedical Engineering.

[39]  E. Taub,et al.  Constraint-Induced Movement Therapy: a new family of techniques with broad application to physical rehabilitation--a clinical review. , 1999, Journal of rehabilitation research and development.

[40]  Mark Hallett,et al.  Cortical reorganization and associated functional motor recovery after virtual reality in patients with chronic stroke: an experimenter-blind preliminary study. , 2005, Archives of physical medicine and rehabilitation.

[41]  S. Brunnstrom,et al.  Motor testing procedures in hemiplegia: based on sequential recovery stages. , 1966, Physical therapy.