Breaking the Tracking: Enabling Weight Perception using Perceivable Tracking Offsets

Virtual reality (VR) technology strives to enable a highly immersive experience for the user by including a wide variety of modalities (e.g. visuals, haptics). Current VR hardware however lacks a sufficient way of communicating the perception of weight of an object, resulting in scenarios where users can not distinguish between lifting a bowling ball or a feather. We propose a solely software based approach of simulating weight in VR by deliberately using perceivable tracking offsets. These tracking offsets nudge users to lift their arm higher and result in a visual and haptic perception of weight. We conducted two user studies showing that participants intuitively associated them with the sensation of weight and accept them as part of the virtual world. We further show that compared to no weight simulation, our approach led to significantly higher levels of presence, immersion and enjoyment. Finally, we report perceptional thresholds and offset boundaries as design guidelines for practitioners.

[1]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[2]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[3]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[4]  Hiroshi Ishii,et al.  Weight and volume changing device with liquid metal transfer , 2014, TEI '14.

[5]  Olivier Martin,et al.  HEMP-Hand-Displacement-Based Pseudo-Haptics: A Study of a Force Field Application , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[6]  Anatole Lécuyer,et al.  A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes , 2008, TAP.

[7]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[8]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[9]  Maud Marchal,et al.  Leveraging Passive Haptic Feedback in Virtual Environments with the Elastic-Arm Approach , 2016, PRESENCE: Teleoperators and Virtual Environments.

[10]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[11]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[12]  Anatole Lécuyer,et al.  "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system , 2001, Proceedings IEEE Virtual Reality 2001.

[13]  Olivier Martin,et al.  HEMP - hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis , 2009, Int. J. Hum. Comput. Stud..

[14]  Aerospatiale Matra Ccr,et al.  Simulating Haptic Information with Haptic Illusions in Virtual Environments , 2000 .

[15]  Enrico Rukzio,et al.  Demo of the Matrix Has You: Realizing Slow Motion in Full-Body Virtual Reality , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[16]  Maud Marchal,et al.  Toward "Pseudo-Haptic Avatars": Modifying the Visual Animation of Self-Avatar Can Simulate the Perception of Weight Lifting , 2014, IEEE Transactions on Visualization and Computer Graphics.

[17]  Simon Richir,et al.  Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[18]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[19]  Takuji Narumi,et al.  Modifying an identified curved surface shape using pseudo-haptic effect , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[20]  Laurent Étienne,et al.  Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures , 2004, CHI.

[21]  Koichi Hirota,et al.  Recognition of weight through shaking interaction , 2015, 2015 IEEE World Haptics Conference (WHC).

[22]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[23]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[24]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[25]  Mary C. Whitton,et al.  Redirected touching: The effect of warping space on task performance , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[26]  Maud Marchal,et al.  Elastic-Arm: Human-scale passive haptic feedback for augmenting interaction and perception in virtual environments , 2015, 2015 IEEE Virtual Reality (VR).

[27]  Julian Frommel,et al.  Conveying the Perception of Kinesthetic Feedback in Virtual Reality using State-of-the-Art Hardware , 2018, CHI.

[28]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[29]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[30]  Ipke Wachsmuth,et al.  The Visual, the Auditory and the Haptic - A User Study on Combining Modalities in Virtual Worlds , 2013, HCI.

[31]  Takuji Narumi,et al.  Modifying an Identified Angle of Edged Shapes Using Pseudo-haptic Effects , 2012, EuroHaptics.

[32]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.