Evaluation of Leap Motion Controller Usability in Development of Hand Gesture Recognition for Hemiplegia Patients

A hand gesture recognition system is developed for hemiplegia patients to undergo rehabilitation which can encourage patients’ motor function. The Leap Motion controller has been studied to detect human hand motion for development of hand gesture controlled robotic arms. It was shown that the Leap Motion sensor is useful to obtain the coordinate position and orientation of each human finger, palm and wrist movements. A set of test program has been designed using healthy hand to investigate the accuracy and reliability of the sensor. The test results show the effectiveness of the device in the recognition of the human hand gestures with a high accuracy rate of 100% for opening and closing of hand, 97.61% for whole hand tapping and 99.6% for right movement while 98.71% for left movement of whole hand lateral rotation.

[1]  Lu Yang,et al.  Survey on 3D Hand Gesture Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Nimali T. Medagedara,et al.  Control of Robot Arm Based on Hand Gestures Using Leap Motion Sensor Technology , 2017 .

[3]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[4]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[5]  Daniele Romano,et al.  Mirror Box Training in Hemiplegic Stroke Patients Affects Body Representation , 2018, Front. Hum. Neurosci..

[6]  H. Karbe,et al.  Mirror Therapy Promotes Recovery From Severe Hemiparesis: A Randomized Controlled Trial , 2009, Neurorehabilitation and neural repair.