A Virtual Glove System for the Hand Rehabilitation based on Two Orthogonal LEAP Motion Controllers

Hand rehabilitation therapy is fundamental in the recovery process for patients suffering from post-stroke or post-surgery impairments. Traditional approaches require the presence of therapist during the sessions, involving high costs and subjective measurements of the patients’ abilities and progresses. Recently, several alternative approaches have been proposed. Mechanical devices are often expensive, cumbersome and patient specific, while virtual devices are not subject to this limitations, but, especially if based on a single sensor, could suffer from occlusions. In this paper a novel multi-sensor approach, based on the simultaneous use of two LEAP motion controllers, is proposed. The hardware and software design is illustrated and the measurements error induced by the mutual infrared interference is discussed. Finally, a calibration procedure, a tracking model prototype based on the sensors turnover and preliminary experimental results are presented.

[1]  Danilo Avola,et al.  Design of an efficient framework for fast prototyping of customized human-computer interfaces and virtual environments for rehabilitation , 2013, Comput. Methods Programs Biomed..

[2]  S. Leonhardt,et al.  A survey on robotic devices for upper limb rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[3]  Ankit Chaudhary,et al.  Intelligent Approaches to interact with Machines using Hand Gesture Recognition in Natural way: A Survey , 2011, ArXiv.

[4]  Giuseppe Placidi,et al.  Characterization of a SimMechanics Model for a Virtual Glove Rehabilitation System , 2010, CompIMAGE.

[5]  Rahsaan J. Holley,et al.  Robotic Approaches for Rehabilitation of Hand Function After Stroke , 2012, American journal of physical medicine & rehabilitation.

[6]  E. Noé,et al.  Effectiveness, usability, and cost-benefit of a virtual reality-based telerehabilitation program for balance recovery after stroke: a randomized controlled trial. , 2015, Archives of physical medicine and rehabilitation.

[7]  Luigi Cinque,et al.  Overall design and implementation of the virtual glove , 2013, Comput. Biol. Medicine.

[8]  J. Liepert,et al.  Treatment-induced cortical reorganization after stroke in humans. , 2000, Stroke.

[9]  Jake K. Aggarwal,et al.  Estimation of motion from a pair of range images: A review , 1991, CVGIP Image Underst..

[10]  Darryl Charles,et al.  Close range depth sensing cameras for virtual reality based hand rehabilitation , 2014 .

[11]  V. Quaresima,et al.  A virtual ball task driven by forearm movements for neuro-rehabilitation , 2015, 2015 International Conference on Virtual Rehabilitation (ICVR).

[12]  H. F. Machiel van der Loos,et al.  Development of robots for rehabilitation therapy: the Palo Alto VA/Stanford experience. , 2000, Journal of rehabilitation research and development.

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Giuseppe Placidi,et al.  Development of an auxiliary system for the execution of vascular catheter interventions with a reduced radiological risk; system description and first experimental results , 2007, Comput. Methods Programs Biomed..

[15]  Gerhard Rinkenauer,et al.  Evaluation of the Leap Motion Controller as a New Contact-Free Pointing Device , 2014, Sensors.

[16]  W. Rymer,et al.  Robot-assisted movement training for the stroke-impaired arm: Does it matter what the robot does? , 2006, Journal of rehabilitation research and development.

[17]  Giuseppe Placidi,et al.  A smart virtual glove for the hand telerehabilitation , 2007, Comput. Biol. Medicine.

[18]  Valentina Quaresima,et al.  A low-cost real time virtual system for postural stability assessment at home , 2014, Comput. Methods Programs Biomed..

[19]  Andrea Petracca,et al.  A virtual system for postural stability assessment based on a TOF camera and a mirror , 2015, REHAB.

[20]  Giuseppe Placidi,et al.  A numerical hand model for a virtual glove rehabilitation system , 2009, 2009 IEEE International Workshop on Medical Measurements and Applications.

[21]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[22]  R. Garg,et al.  Movement therapy induced neural reorganization and motor recovery in stroke: a review. , 2011, Journal of bodywork and movement therapies.

[23]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[24]  Robert Riener,et al.  Increasing patient engagement during virtual reality-based motor rehabilitation. , 2013, Archives of physical medicine and rehabilitation.

[25]  Imre Horváth,et al.  Methodology for Controlling Contact Forces in Interactive Grasping Simulation , 2011 .

[26]  Mark Hallett,et al.  Plasticity of the human motor cortex and recovery from stroke , 2001, Brain Research Reviews.