Effects of the Alignment Between a Haptic Device and Visual Display on the Perception of Object Softness

Virtual reality (VR) has been gaining popularity in surgical planning and simulation. Most VR surgical simulation systems provide haptic (pertinent to the sense of touch) and visual information simultaneously using certain alignments between a haptic device and visual display. A critical aspect of such VR surgical systems is to represent both haptic and visual information accurately to avoid perceptual illusions (e.g., to distinguish the softness of organs/tissues). This study compared three different alignments (same-location alignment, vertical alignment, and horizontal alignment) between a haptic device and visual display that are widely used in VR systems. We conducted three experiments to study the influence of each alignment on the perception of object softness. In each experiment, we tested 15 different human subjects with varying availability of haptic and visual information. During each trial, the task of the subject was to discriminate object softness between two deformable balls in different viewing angles. We analyzed the following dependent measurements: subject perception of object softness and objective measurements of maximum force and maximum pressing depth. The analysis results reveal that all three alignments (independent variables) have similar effect on subjective perception of object softness within the interval of viewing angles from -7.5° to +7.5°. The viewing angle does not affect objective measurements. The same-location alignment requires less physical effort compared with the other two alignments. These observations have implications in creating accurate simulation and interaction for VR surgical systems.

[1]  David Swapp,et al.  Interaction with co-located haptic feedback in virtual reality , 2006, Virtual Reality.

[2]  Lucian Panait,et al.  The role of haptic feedback in laparoscopic simulation training. , 2009, The Journal of surgical research.

[3]  Susan J. Lederman,et al.  Virtual peg-in-hole performance using a 6-DOF magnetic levitation haptic device: comparison with real forces and with visual guidance alone , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[4]  R Bruyer,et al.  The Ponzo Illusion with Auditory Substitution of Vision in Sighted and Early-Blind Subjects , 2005, Perception.

[5]  Antoine Widmer,et al.  The role of viewing angle in integrating the senses of vision and touch for perception of object softness , 2007, Canadian Journal of Electrical and Computer Engineering.

[6]  R. Martyn Bracewell,et al.  Brain Mechanisms of Haptic Perception , 2008, The Sense of Touch and its Rendering.

[7]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[8]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[9]  S. K. Moore,et al.  The virtual surgeon [virtual reality trainer] , 2000 .

[10]  A. Kappers,et al.  Haptic and visual perception of roughness. , 2007, Acta psychologica.

[11]  Thomas Kerwin,et al.  The role of multisensory feedback in haptic surface perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[12]  Matyka Maciej,et al.  Pressure Model of Soft Body Simulation , 2004, physics/0407003.

[13]  Jack McLaughlin,et al.  Haptic Workbench: a multisensory virtual environment , 1999, Electronic Imaging.

[14]  R W Webster,et al.  A prototype haptic suturing simulator. , 2001, Studies in health technology and informatics.

[15]  Aiguo Song,et al.  Discrimination and Memory Experiments on Haptic Perception of Softness , 2008, Perceptual and motor skills.

[16]  Adrian David Cheok,et al.  The Role of 3-D Sound in Human Reaction and Performance in Augmented Reality Environments , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[18]  Changmok Choi,et al.  Graphic and haptic modelling of the oesophagus for VR‐based medical simulation , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[19]  Heinrich H. Bülthoff,et al.  Touch can change visual slant perception , 2000, Nature Neuroscience.

[20]  R H LaMotte,et al.  Softness discrimination with a tool. , 2000, Journal of neurophysiology.

[21]  George D. Stetten,et al.  Psychophysical evaluation of in-situ ultrasound visualization , 2005, IEEE Transactions on Visualization and Computer Graphics.

[22]  Makoto Sato,et al.  Effect of Coupling Haptics and Stereopsis on Depth Perception in Virtual Environment , 2000 .

[23]  Colin Ware,et al.  Haptic state surface interactions , 2004, IEEE Computer Graphics and Applications.

[24]  José Duato,et al.  M-GRASP: A GRASP With Memory for Latency-Aware Partitioning Methods in DVE Systems , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Martin Buss,et al.  Passive Haptic Data-Compression Methods With Perceptual Coding for Bilateral Presence Systems , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Stefan Winkler,et al.  Immersive Multiplayer Games With Tangible and Physical Interaction , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Yonghua Chen,et al.  Haptic Surgical Simulation: An Application to Virtual Suture , 2006 .

[28]  Mark Ollila,et al.  Pressure Model of Soft Body Simulation , 2003 .