Beyond the visuals: tactile augmentation and sensory enhancement in an arthroscopy simulator

This paper considers tactile augmentation, the addition of a physical object within a virtual environment (VE) to provide haptic feedback. The resulting mixed reality environment is limited in terms of the ease with which changes can be made to the haptic properties of objects within it. Therefore sensory enhancements or illusions that make use of visual cues to alter the perceived hardness of a physical object allowing variation in haptic properties are considered. Experimental work demonstrates that a single physical surface can be made to ‘feel’ both softer and harder than it is in reality by the accompanying visual information presented. The strong impact visual cues have on the overall perception of object hardness, indicates haptic accuracy may not be essential for a realistic virtual experience. The experimental results are related specifically to the development of a VE for surgical training; however, the conclusions drawn are broadly applicable to the simulation of touch and the understanding of haptic perception within VEs.

[1]  Hunter G. Hoffman,et al.  Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[2]  E Bekiaris,et al.  Human Factors in the Age of Virtual Reality. , 2003 .

[3]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[4]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[5]  J T Petersik,et al.  Visual-Haptic Relations in a Two-Dimensional Size-Matching Task , 1994, Perceptual and motor skills.

[6]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[7]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[8]  McCarthy Ad,et al.  A commercially viable virtual reality knee arthroscopy training system. , 1998 .

[9]  E. Chen,et al.  Force feedback for surgical simulation , 1998, Proc. IEEE.

[10]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[11]  Richard A. Robb,et al.  Medicine Meets Virtual Reality 12: Building a Better You : The Next Tools for Medical Education, Diagnosis, and Care , 2004 .

[12]  Andrea Giachetti,et al.  A haptic model of a bone-cutting burr. , 2003, Studies in health technology and informatics.

[13]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[14]  William K. Durfee,et al.  Influence of haptic and visual displays on the estimation of virtual environment stiffness , 1997 .

[15]  Anatole Lécuyer,et al.  Simulating Haptic Information with Haptic Illusions in Virtual Environments , 2001 .

[16]  Rupert England.  Sensory-motor systems in virtual manipulation , 1995 .

[17]  Karel Brookhuis,et al.  Preface "Human Factors in the age of Virtual Reality" , 2003 .

[18]  Hong Z. Tan,et al.  HUMAN FACTORS FOR THE DESIGN OF FORCE-REFLECTING HAPTIC INTERFACES , 1994 .

[19]  Yanqing Wang,et al.  The role of contextual haptic and visual constraints on object manipulation in virtual environments , 2000, CHI.

[20]  McCarthy Ad.  Development and validation of a virtual environment as a training tool for surgeons in knee arthroscopy. , 2000 .

[21]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[22]  Louise Moody,et al.  Engineering requirements for a haptic simulator for knee arthroscopy training. , 2003, Studies in health technology and informatics.

[23]  Anatole Lécuyer,et al.  "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system , 2001, Proceedings IEEE Virtual Reality 2001.

[24]  Hong Zhang,et al.  Use of tactile sensors in enhancing the efficiency of vision-based object localization , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[25]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[26]  R W Webster,et al.  A prototype haptic suturing simulator. , 2001, Studies in health technology and informatics.

[27]  Barbara Deml,et al.  A Study on Visual, Auditory, and Haptic Feedback for Assembly Tasks , 2004, Presence: Teleoperators & Virtual Environments.

[28]  Mukul Mukherjee,et al.  Medicine Meets Virtual Reality 14 , 2005 .

[29]  S. Lederman,et al.  The role of haptic versus visual volume cues in the size-weight illusion , 1993, Perception & psychophysics.

[30]  M. Bro-nielsen,et al.  Simulation techniques for minimally invasive surgery , 1997 .

[31]  Cagatay Basdogan,et al.  Haptics in minimally invasive surgical simulation and training , 2004, IEEE Computer Graphics and Applications.

[32]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[33]  A D McCarthy,et al.  A commercially viable virtual reality knee arthroscopy training system. , 1998, Studies in health technology and informatics.

[34]  Robert W. Lindeman,et al.  Handling of Virtual Contact in Immersive Virtual Environments: Beyond Visuals , 2002, Virtual Reality.

[35]  Probal Mitra,et al.  THUMP: an immersive haptic console for surgical simulation and training. , 2004, Studies in health technology and informatics.

[36]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[37]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[38]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .