Effects of auditory information on self-motion perception during simultaneous presentation of visual shearing motion

Recent studies have found that self-motion perception induced by simultaneous presentation of visual and auditory motion is facilitated when the directions of visual and auditory motion stimuli are identical. They did not, however, examine possible contributions of auditory motion information for determining direction of self-motion perception. To examine this, a visual stimulus projected on a hemisphere screen and an auditory stimulus presented through headphones were presented separately or simultaneously, depending on experimental conditions. The participant continuously indicated the direction and strength of self-motion during the 130-s experimental trial. When the visual stimulus with a horizontal shearing rotation and the auditory stimulus with a horizontal one-directional rotation were presented simultaneously, the duration and strength of self-motion perceived in the opposite direction of the auditory rotation stimulus were significantly longer and stronger than those perceived in the same direction of the auditory rotation stimulus. However, the auditory stimulus alone could not sufficiently induce self-motion perception, and if it did, its direction was not consistent within each experimental trial. We concluded that auditory motion information can determine perceived direction of self-motion during simultaneous presentation of visual and auditory motion information, at least when visual stimuli moved in opposing directions (around the yaw-axis). We speculate that the contribution of auditory information depends on the plausibility and information balance of visual and auditory information.

[1]  K. Ukai,et al.  Visual rotation axis and body position relative to the gravitational direction: Effects on circular vection , 2012, i-Perception.

[2]  Bernhard E. Riecke,et al.  Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality , 2009, TAP.

[3]  Bernhard E. Riecke,et al.  Auditory self-motion illusions ("circular vection") can be facilitated by vibrations and the potential for actual motion , 2008, APGV '08.

[4]  J. Lackner,et al.  Induction of illusory self-rotation and nystagmus by a rotating sound-field. , 1977, Aviation, space, and environmental medicine.

[5]  Daniel Västfjäll,et al.  Perception of Self-motion and Presence in Auditory Virtual Environments , 2004 .

[6]  Heinrich H. Bülthoff,et al.  Influence of Auditory Cues on the visually-induced Self-Motion Illusion (Circular Vection) in Virtual Reality , 2005 .

[7]  Paul DiZio,et al.  Perceived self-motion in two visual contexts: dissociable mechanisms underlie perception. , 2006, Journal of vestibular research : equilibrium & orientation.

[8]  J. Lishman,et al.  The Autonomy of Visual Kinaesthesis , 1973, Perception.

[9]  R. Lutfi,et al.  Correlational analysis of acoustic cues for the discrimination of auditory motion. , 1996, The Journal of the Acoustical Society of America.

[10]  H. Wallach,et al.  The role of head movements and vestibular and visual cues in sound localization. , 1940 .

[11]  Hiroyasu Ujike,et al.  Effects of visually simulated roll motion on vection and postural stabilization , 2007, Journal of NeuroEngineering and Rehabilitation.

[12]  Tatsuya Hirahara,et al.  Advanced version of a steerable dummy head that tracks human head movement in real time : TeleHead II , 2006 .

[13]  Rik Warren,et al.  Perception And Control Of Self-Motion: Implications For Visual Simulation Of Vehicular Locomotion , 1987 .

[14]  Iwaki Toshima,et al.  Sound Localization Using an Acoustical Telepresence Robot: TeleHead II , 2008, PRESENCE: Teleoperators and Virtual Environments.

[15]  Michiteru Kitazaki,et al.  Attentional Modulation of Self-Motion Perception , 2003, Perception.

[16]  Ernst Mach,et al.  Grundlinien der Lehre von den Bewegungsempfindungen , 1967 .

[17]  P. Baudonniere,et al.  Cognitive Effects on Visually Induced Body Motion in Children , 1995, Perception.

[18]  R. Dodge,et al.  Thresholds of Rotation. , 1923 .

[19]  R. W. Wood,et al.  The 'Haunted Swing' illusion. , 1895 .

[20]  Richard S. Frackowiak,et al.  Neural Correlates of Visual-Motion Perception as Object- or Self-motion , 2002, NeuroImage.

[21]  Shuichi Sakamoto,et al.  The effects of linearly moving sound images on self-motion perception , 2004 .

[22]  Jennifer L. Campos,et al.  Combined effects of auditory and visual cues on the perception of vection , 2013, Experimental Brain Research.

[23]  J. C. Middlebrooks Sound localization. , 2015, Handbook of clinical neurology.

[24]  Y. Nakajima,et al.  Perceptually Plausible Sounds Facilitate Visually Induced Self-Motion Perception (Vection) , 2012, Perception.

[25]  A. Väljamäe Auditorily-induced illusory self-motion: A review , 2009, Brain Research Reviews.

[26]  Mendel Kleiner,et al.  Auditory Presence, Individualized Head-Related Transfer Functions, and Illusory Ego-Motion in Virtual Environments , 2004 .

[27]  P. Young,et al.  The r?le of head movements in auditory localization. , 1931 .

[28]  Behrang Keshavarz,et al.  Illusory Self-Motion in Virtual Environments , 2014, Handbook of Virtual Environments, 2nd ed..

[29]  G. DeAngelis,et al.  Visual–Vestibular Integration for Self-Motion Perception , 2012 .