Haptic motion: Improving sensation of self-motion in virtual worlds with force feedback

Haptic feedbacks are usually used to provide a sensation of interaction with virtual or distant objects. These feedbacks give an access to the physical properties or constraints of these objects in a given environment. In the present study, we wondered if a haptic feedback in the hands can provide an enhanced sensation of whole-body self-motion in virtual worlds. We designed two experiments where subjects were visually immersed in a moving virtual environment and exposed, in parallel, to a force feedback stimulation in hands coherent with the virtual camera motion. In the first experiment, the motion was in a straight line combined with a force feedback acting only on Z-axis (longitudinal) and with an amplitude proportional to the acceleration of the virtual camera. We showed that the visuo-haptic stimulation produces a higher sensation of self-motion compared to the visual feedback alone. In the second experiment, we tested our method with a more complex virtual camera trajectory, inducing an acceleration vector of the virtual camera owning components in each 3D axis. Based on the difference of orientation between the velocity and acceleration vectors of the camera, we showed that the force feedback, providing the most important sensation of self-motion, has the same 3D orientation and is proportional in magnitude to the acceleration of the virtual camera. These results highlight the way visual and haptic cues interact together to provide a self-motion sensation. Taken together our results suggest new applications of force-feedback devices in VR, for the purpose of enhancing self-motion sensations.

[1]  Robert J. van Beers,et al.  How humans combine simultaneous proprioceptive and visual position information , 1996, Experimental Brain Research.

[2]  A. Berthoz,et al.  Linear Acceleration Modifies the Perceived Velocity of a Moving Visual Scene , 1977, Perception.

[3]  D. McCloskey Kinesthetic sensibility. , 1978, Physiological reviews.

[4]  Tomohiro Amemiya,et al.  Shaking the world: galvanic vestibular stimulation as a novel sensation interface , 2005, SIGGRAPH '05.

[5]  Vincent Hayward,et al.  Vibrotactile inputs to the feet can modulate vection , 2013, 2013 World Haptics Conference (WHC).

[6]  Daniel M Merfeld,et al.  Rotation otolith tilt-translation reinterpretation (ROTTR) hypothesis: a new hypothesis to explain neurovestibular spaceflight adaptation. , 2003, Journal of vestibular research : equilibrium & orientation.

[7]  L. Harris,et al.  Visual and non-visual cues in the perception of linear self motion , 2000, Experimental Brain Research.

[8]  Heinrich H. Bülthoff,et al.  Circular, Linear, and Curvilinear Vection in a Large-screen Virtual Environment with Floor Projection , 2008, 2008 IEEE Virtual Reality Conference.

[9]  Anatole Lécuyer,et al.  Can haptic feedback improve the perception of self-motion in virtual reality? , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[10]  Herman Kingma,et al.  Galvanic-induced Body Sway in Vestibular Schwannoma Patients: Evidence for Stimulation of the Central Vestibular System , 2004, Acta oto-laryngologica.

[11]  Bernhard E. Riecke Simple user-generated motion cueing can enhance self-motion perception (Vection) in virtual reality , 2006, VRST '06.

[12]  A. Berthoz,et al.  Perception of linear horizontal self-motion induced by peripheral vision (linearvection) basic characteristics and visual-vestibular interactions , 1975, Experimental Brain Research.

[13]  F E Guedry,et al.  The effect of semicircular cana stimulation during tilting on the subsequent perception of the visual vertical. , 1970, Acta oto-laryngologica.

[14]  Michael R Ibbotson,et al.  Differential changes in human perception of speed due to motion adaptation. , 2008, Journal of vision.

[15]  Nizar Ouarti Lppa,et al.  MULTIMODAL FUSION IN SELF-MOTION PERCEPTION USING WAVELETS AND QUATERNIONS , 2008 .

[16]  Eric L Groen,et al.  Vestibulo-tactile interactions regarding motion perception and eye movements in yaw. , 2005, Journal of vestibular research : equilibrium & orientation.

[17]  L R Young,et al.  Microgravity enhances the relative contribution of visually-induced motion sensation. , 1990, Aviation, space, and environmental medicine.

[18]  Hiroyasu Ujike,et al.  Effects of visually simulated roll motion on vection and postural stabilization , 2007, Journal of NeuroEngineering and Rehabilitation.

[19]  S Palmisano,et al.  Perceiving self-motion in depth: The role of stereoscopic motion and changing-size cues , 1996, Perception & psychophysics.

[20]  Anatole Lécuyer,et al.  Enhancing Audiovisual Experience with Haptic Feedback: A Survey on HAV , 2013, IEEE Transactions on Haptics.

[21]  P Schnider,et al.  [Applied psychoacoustics in space flight]. , 1993, Wiener medizinische Wochenschrift.

[22]  Daniel Västfjäll,et al.  Vibrotactile enhancement of auditory induced self-motion and spatial presence , 2006 .

[23]  D. Stewart A Platform with Six Degrees of Freedom , 1965 .

[24]  Hendrik A. H. C. van Veen,et al.  A Tactile Cockpit Instrument Supports the Control of Self-Motion During Spatial Disorientation , 2006, Hum. Factors.

[25]  Heinrich H. Bülthoff,et al.  Towards lean and elegant self-motion simulation in virtual reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[26]  Bhaskar Dasgupta,et al.  The Stewart platform manipulator: a review , 2000 .

[27]  T. Mergner,et al.  Human perception of horizontal trunk and head rotation in space during vestibular and neck stimulation , 2004, Experimental Brain Research.

[28]  L. R. Young,et al.  Sensation of rotation about a vertical axis with a fixed visual field in different illuminations and in the dark , 2004, Experimental Brain Research.

[29]  B. Bergum,et al.  Attention and performance IX , 1982 .

[30]  D. Stewart,et al.  A platform with 6 degrees of freedom , 1966 .

[31]  Laura F. Fox,et al.  Self-motion perception during locomotor recalibration: more than meets the eye. , 2005, Journal of experimental psychology. Human perception and performance.