Playing with Senses in VR: Alternate Perceptions Combining Vision and Touch

Virtual reality is an immersive experience based on computer-generated stimulations perceived with multiple sensory channels. It is possible to manipulate these sensory stimulations independently and create conflicting situations in which, for instance, vision and touch are spatially and/or temporally inconsistent. This article discusses how to exploit these ambiguous sensorial situations to generate new kinds of percept using three types of examples: pseudo-haptic effects, self-motion sensations, and body-ownership illusions.

[1]  Maud Marchal,et al.  The Virtual Mitten: A novel interaction paradigm for visuo-haptic manipulation of objects using grip force , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[2]  Maud Marchal,et al.  Toward "Pseudo-Haptic Avatars": Modifying the Visual Animation of Self-Avatar Can Simulate the Perception of Weight Lifting , 2014, IEEE Transactions on Visualization and Computer Graphics.

[3]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[4]  Ferran Argelaguet,et al.  A novel 3D carousel based on pseudo-haptic feedback and gestural interaction for virtual showcasing , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[5]  Anatole Lécuyer,et al.  The Influence of Spatial Delocation on Perceptual Integration of Vision and Touch , 2006, PRESENCE: Teleoperators and Virtual Environments.

[6]  Jacques Droulez,et al.  Application of the coherence scheme to the multisensory fusion problem , 1993 .

[7]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[8]  Maud Marchal,et al.  Elastic images: Perceiving local elasticity of images through a novel pseudo-haptic deformation effect , 2013, TAP.

[9]  Mel Slater,et al.  A Virtual Presence Counter , 2000, Presence: Teleoperators & Virtual Environments.

[10]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[11]  Anatole Lécuyer,et al.  HapSeat: producing motion sensation with multiple force-feedback devices embedded in a seat , 2012, VRST '12.

[12]  Anatole Lécuyer,et al.  Haptic motion: Improving sensation of self-motion in virtual worlds with force feedback , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[13]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[14]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[15]  Ferran Argelaguet,et al.  “Wow! I Have Six Fingers!”: Would You Accept Structural Changes of Your Hand in VR? , 2016, Front. Robot. AI.

[16]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.