Real-Time Static Gesture Recognition for Upper Extremity Rehabilitation Using the Leap Motion

Cerebral Palsy is a motor disability that occurs in early childhood. Conventional therapy methods have proven useful for upper extremity rehabilitation, but can lead to non-compliance due to children getting bored with the repetition of exercises. Virtual reality and game-like simulations of conventional methods have proven to lead to higher rates of compliance, the patient being more engaged during exercising, and yield better performance during exercises. Most games are good at keeping players engaged, but does not focus on exercising fine motor control functions. In this paper, we present an analysis of classification techniques for static hand gestures. We also present a prototype of a game-like simulation of matching static hand gestures in order to increase motor control of the hand.

[1]  Darryl Charles,et al.  Close range depth sensing cameras for virtual reality based hand rehabilitation , 2014 .

[2]  G. Lewis,et al.  Virtual reality games for movement rehabilitation in neurological conditions: how do we meet the needs and expectations of the users? , 2012, Disability and rehabilitation.

[3]  Sergei V. Adamovich,et al.  Interfacing a haptic robotic system with complex virtual environments to treat impaired upper extremity motor function in children with cerebral palsy , 2010, Developmental neurorehabilitation.

[4]  B. Dan,et al.  A report: the definition and classification of cerebral palsy April 2006 , 2007, Developmental medicine and child neurology. Supplement.

[5]  Nicholas Hall,et al.  The relationship of cerebral palsy subtype and functional motor impairment: a population‐based study , 2009, Developmental medicine and child neurology.

[6]  A. Geurts,et al.  The Pirate group intervention protocol: description and a case report of a modified constraint-induced movement therapy combined with bimanual training for young children with unilateral spastic cerebral palsy. , 2012, Occupational therapy international.

[7]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[8]  A. Majnemer,et al.  Virtual reality as a therapeutic modality for children with cerebral palsy , 2010, Developmental neurorehabilitation.

[9]  Cristina V. Lopes,et al.  Free-hand interaction with leap motion controller for stroke rehabilitation , 2014, CHI Extended Abstracts.

[10]  Tien-Yow Chuang,et al.  Use of Virtual Reality to Improve Upper-Extremity Control in Children With Cerebral Palsy: A Single-Subject Design , 2007, Physical Therapy.

[11]  Heidi Sveistrup,et al.  Feasibility, Motivation, and Selective Motor Control: Virtual Reality Compared to Conventional Home Exercise in Children with Cerebral Palsy , 2006, Cyberpsychology Behav. Soc. Netw..

[12]  Mohamed Abdur Rahman Multimedia non-invasive hand therapy monitoring system , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[13]  Yu-Ping Chen,et al.  Game Analysis, Validation, and Potential Application of EyeToy Play and Play 2 to Upper-Extremity Rehabilitation , 2014, Rehabilitation research and practice.

[14]  I. Novak,et al.  A systematic review of interventions for children with cerebral palsy: state of the evidence , 2013, Developmental medicine and child neurology.

[15]  Chan Wai Yin,et al.  Virtual reality for upper extremity rehabilitation in early stroke: a pilot randomized controlled trial , 2014, Clinical rehabilitation.

[16]  J. Andreasen,et al.  Work Status and Return to the Workforce after Coronary Artery Bypass Grafting and/or Heart Valve Surgery: A One-Year-Follow Up Study , 2014, Rehabilitation research and practice.