Integrating haptic-tactile feedback into a video capture based VE for rehabilitation

Video capture VR systems are gaining popularity as intervention tools. To date these platforms offer visual and audio feedback but do not provide haptic feedback. We contend that adding haptic feedback may enhance the quality of intervention for various theoretical and empirical reasons. This study aims to integrate haptic-tactile feedback into a video capture system (GX VR) which is currently applied for rehabilitation. The proposed multi-modal system can deliver audio-visual as well as vibrotactile feedback. The latter is provided via small vibratory discs attached to the patient’s limbs. The paper describes the system, the guidelines of its design, and the ongoing usability study.

[1]  Noomi Katz,et al.  Video capture virtual reality as a flexible and effective rehabilitation tool , 2004, Journal of NeuroEngineering and Rehabilitation.

[2]  K. Sunnerhagen,et al.  Virtual reality and haptics as a training device for movement rehabilitation after stroke: a single-case study. , 2004, Archives of Physical Medicine and Rehabilitation.

[3]  Grigore C. Burdea,et al.  A Portable Dextrous Master with Force Feedback , 1992, Presence: Teleoperators & Virtual Environments.

[4]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[5]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[6]  Yongseok Jang,et al.  Designing a Vibro-Tactile Wear for "Close Range" Interaction for VR-based Motion Training , 2002 .

[7]  Michael B. Calford,et al.  Dynamic representational plasticity in sensory cortex , 2002, Neuroscience.

[8]  Jeffrey A. Lewis,et al.  Haptic effects for virtual reality-based post-stroke rehabilitation , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[9]  E A Bullock,et al.  Post-stroke rehabilitation. , 1975, Royal Society of Health journal.

[10]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[11]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[12]  Tactual learning and cross-modal transfer of an oddity problem in young children. , 1989, Journal of experimental child psychology.

[13]  E. Delay.  Effects of cross-modal transfer on direct and reversal learning in the rat , 1986 .

[14]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[15]  Stephen D. Laycock,et al.  Recent Developments and Applications of Haptic Devices , 2003, Comput. Graph. Forum.

[16]  Drf Irvine,et al.  INJURY‐ AND USE‐RELATED PLASTICITY IN THE PRIMARY SENSORY CORTEX OF ADULT MAMMALS: POSSIBLE RELATIONSHIP TO PERCEPTUAL LEARNING , 1996, Clinical and experimental pharmacology & physiology.

[17]  Judith E. Deutsch,et al.  Post-Stroke Rehabilitation with the Rutgers Ankle System: A Case Study , 2001, Presence: Teleoperators & Virtual Environments.

[18]  Shawn Marshall,et al.  Experimental Studies of Virtual Reality-Delivered Compared to Conventional Exercise Programs for Rehabilitation , 2003, Cyberpsychology Behav. Soc. Netw..

[19]  C. Spence,et al.  Multisensory perception: Beyond modularity and convergence , 2000, Current Biology.

[20]  D Cunningham,et al.  Virtual reality: a wholistic approach to rehabilitation. , 1999, Studies in health technology and informatics.

[21]  C. Spence,et al.  The cost of expecting events in the wrong sensory modality , 2001, Perception & psychophysics.

[22]  Atsushi Iriki,et al.  Self-images in the video monitor coded by monkey intraparietal neurons , 2001, Neuroscience Research.

[23]  T. Tran,et al.  Transfer of visual and haptic maze learning in rats , 1994 .

[24]  P. Duncan,et al.  Post-Stroke Rehabilitation , 2004 .

[25]  Patrick Haggard,et al.  Vision Modulates Somatosensory Cortical Processing , 2002, Current Biology.

[26]  Ren G Dong,et al.  Biodynamic response at the palm of the human hand subjected to a random vibration. , 2005, Industrial health.

[27]  A. Dellon,et al.  Somatosensory Testing and Rehabilitation , 1997 .

[28]  A Maravita,et al.  Vision and touch through the looking glass in a case of crossmodal extinction , 2000, Neuroreport.

[29]  A. Wing,et al.  Errorless learning using haptic guidance: research in cognitive rehabilitation following stroke , 2002 .

[30]  Helen Petrie,et al.  Haptic virtual reality for blind computer users , 1998, Assets '98.

[31]  Patrice L. Weiss,et al.  Adapting an immersive virtual reality system for rehabilitation , 2003, Comput. Animat. Virtual Worlds.

[32]  Patrice L. Weiss,et al.  Promoting research and clinical use of haptic feedback in virtual environments , 2004 .

[33]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[34]  Dahai Li,et al.  Haptic Shoes: Representing Information By Vibration , 2005, APVIS.