The Influence of Visual Cues on Passive Tactile Sensations in a Multimodal Immersive Virtual Environment

Haptic feedback, such as the sensation of 'being touched', is an essential part of how we experience our environment. Yet, it is often disregarded in current virtual reality (VR) systems. In addition to the technical challenge of creating such tactile experiences there are also human aspects that are not fully understood, especially with respect to how humans integrate multimodal stimuli. In this research, we proved that the visual stimuli in a VR setting can influence how vibrotactile stimuli are perceived. In particular, we identified how visual cues that are associated with the characteristic of weight influence tactile perception, whereas a similar effect could not be achieved for a temperature-related visual cue. Our results have technical implications - for example, suggesting that a rather simple vibration motor may be sufficient to create a complex tactile experience such as perceiving weight - and relevance for practical implementations - for example, indicating that vibration intensities need to be 'exaggerated' to achieve certain effects.

[1]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[2]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[3]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[4]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[5]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[6]  Justin M. Harris,et al.  If I Were You: Perceptual Illusion of Body Swapping , 2008, PloS one.

[7]  Fumihisa Shibata,et al.  Psychophysical influence of mixed-reality visual stimulation on sense of hardness , 2011, 2011 IEEE Virtual Reality Conference.

[8]  Kellogg S. Booth,et al.  Evaluating 3D task performance for fish tank virtual worlds , 1993, TOIS.

[9]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[10]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[11]  Doug A. Bowman,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 2001, Presence Teleoperators Virtual Environ..

[12]  Paul Richard,et al.  Effect of Frame Rate and Force Feedback on Virtual Object Manipulation , 1996, Presence: Teleoperators & Virtual Environments.

[13]  Kazuhiko Yokosawa,et al.  Does Seeing Ice Really Feel Cold? Visual-Thermal Interaction under an Illusory Body-Ownership , 2012, PloS one.

[14]  Daisuke Iwai,et al.  Combining colour and temperature: A blue object is more likely to be judged as warm than a red object , 2014, Scientific Reports.

[15]  D. C. Higgins Human Spatial Orientation , 1967, The Yale Journal of Biology and Medicine.

[16]  Mark Lehto,et al.  A review of: “Virtual Reality Technology” Grigore Burdea and Philippe Coiffet John Wiley & Sons, Inc., 1994 , 1996 .

[17]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[18]  Fumihisa Shibata,et al.  Psychophysical Influence on Tactual Impression by Mixed-Reality Visual Stimulation , 2008, 2008 IEEE Virtual Reality Conference.

[19]  Takahiro Kawabe,et al.  Colour-Temperature Correspondences: When Reactions to Thermal Stimuli Are Influenced by Colour , 2014, PloS one.

[20]  S. Lederman,et al.  The role of haptic versus visual volume cues in the size-weight illusion , 1993, Perception & psychophysics.

[21]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[22]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[23]  Frank P. Schulte,et al.  Seeing Size and Feeling Weight: The Size-Weight Illusion in Natural and Virtual Reality , 2007, Hum. Factors.

[24]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[25]  Maurice A Smith,et al.  Bayesian and "anti-Bayesian" biases in sensory integration for action and perception in the size-weight illusion. , 2010, Journal of neurophysiology.

[26]  Kan Arai,et al.  Tactile force perception depends on the visual speed of the collision object. , 2009, Journal of vision.

[27]  Thomas Kerwin,et al.  The role of multisensory feedback in haptic surface perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[28]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.

[29]  Lee L. Rubin,et al.  Psychophysical scales of apparent heaviness and the size-weight illusion , 1970 .

[30]  Seung-Chan Kim,et al.  Tactile rendering of 3D features on touch surfaces , 2013, UIST.

[31]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.