Prototype of a VR upper-limb rehabilitation system enhanced with motion-based tactile feedback

Stroke is the leading cause of long-term disability in adults, with increasing incidence as the population ages. Physical and occupational therapy support the recovery process, with therapy duration and intensity having been identified as critical factors. However, conventional therapy is limited to a short period following the stroke, with only limited possibilities to continue therapy at home. Increasing health costs and lack of trained personnel further strengthen this problem. There is thus a great need for home-based therapy systems, allowing to engage patients and assess the training with sufficient precision to provide meaningful exercises. In this paper, we suggest expandable software architecture for virtual reality rehabilitation applications. This system utilizes various sensors and actuators (i.e. the Kinect for upper limb tracking and a haptic glove). Based on this system, we propose a motion based tactile rendering algorithm. It generates interactive vibration patterns employing the tactile apparent movement phenomenon based on user's movement to enhance the immersion and provide sensory feedback during rehabilitation training in the virtual reality environment. Three rehabilitation game applications are presented as proof of concept of the proposed system.

[1]  Jongeun Cha,et al.  Immersive Live Sports Experience with Vibrotactile Sensation , 2005, INTERACT.

[2]  G. Békésy,et al.  Funneling in the Nervous System and its Role in Loudness and Sensation Intensity on the Skin , 1958 .

[3]  Andreas Zell,et al.  Using depth in visual simultaneous localisation and mapping , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Abdulmotaleb El-Saddik,et al.  Investigating the influence of temporal intensity changes on apparent movement phenomenon , 2009, 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems.

[5]  J. Ratcliffe,et al.  Virtual reality stroke rehabilitation – hype or hope? , 2015 .

[6]  Andreas Kunz,et al.  User-aware Content Orientation on Interactive Tabletop Surfaces , 2012, 2012 International Conference on Cyberworlds.

[7]  Ali Israr,et al.  Control space of apparent haptic motion , 2011, 2011 IEEE World Haptics Conference.

[8]  Yuichiro Kume,et al.  Vibrotactile letter reading using a low-resolution tactor array , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[9]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Systematic Review of its Effectiveness for Upper Limb Motor Recovery , 2007, Topics in stroke rehabilitation.

[10]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.

[11]  Yuichiro Kume,et al.  Towards Effective Information Display Using Vibrotactile Apparent Motion , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[12]  H. Dinse,et al.  Long-term sensory stimulation therapy improves hand function and restores cortical responsiveness in patients with chronic cerebral lesions. Three single case studies , 2012, Front. Hum. Neurosci..

[13]  Ian Oakley,et al.  A tactile glove design and authoring system for immersive multimedia , 2010, IEEE MultiMedia.

[14]  Roger Gassert,et al.  Low-power sensor module for long-term activity monitoring , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[16]  Majid Sarrafzadeh,et al.  Gaming for upper extremities rehabilitation , 2011, Wireless Health.

[17]  Carl E. Sherrick,et al.  Apparent haptic movement , 1966 .

[18]  James M. Boyle,et al.  Engagement in digital entertainment games: A systematic review , 2012, Comput. Hum. Behav..

[19]  Jens Garstka View-dependent 3 D Projection using Depth-Image-based Head Tracking , 2011 .

[20]  Allison M. Okamura,et al.  HAPI Bands: A haptic augmented posture interface , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[21]  Lalit Kalra,et al.  Stroke rehabilitation 2009: old chestnuts and new insights. , 2010, Stroke.