Travelling without moving: Auditory scene cues for translational self-motion

Creating a sense of illusory self-motion is crucial for many Virtual Reality applications and the auditory modality is an essential, but often neglected, component for such stimulations. In this paper, perceptual optimization of auditory-induced, translational self-motion (vection) simulation is studied using binaurally synthesized and reproduced sound fields. The results suggest that auditory scene consistency and ecologically validity makes a minimum set of acoustic cues sufficient for eliciting auditory-induced vection. Specifically, it was found that a focused attention task and sound objects’ motion characteristics (approaching or receding) play an important role in self-motion perception. In addition, stronger sensations for auditory induced self-translation than for previously investigated self-rotation also suggest a strong ecological validity bias, as translation is the most common movement direction.

[1]  A N Popper,et al.  Evolution of the ear and hearing: issues and questions. , 1997, Brain, behavior and evolution.

[2]  S. Carlile,et al.  Discrimination of sound source velocity in human listeners. , 2002, The Journal of the Acoustical Society of America.

[3]  Mendel Kleiner,et al.  Auditory Presence, Individualized Head-Related Transfer Functions, and Illusory Ego-Motion in Virtual Environments , 2004 .

[4]  William W. Gaver.  How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[5]  G J Andersen,et al.  Perception of self-motion: psychophysical and computational approaches. , 1986, Psychological bulletin.

[6]  Lawrence D. Rosenblum,et al.  Echolocating Distance by Moving and Stationary Listeners , 2000 .

[7]  C. F. Kao,et al.  The efficient assessment of need for cognition. , 1984, Journal of personality assessment.

[8]  Bill Kapralos,et al.  Auditory Cues in the Perception of Self Motion , 2004 .

[9]  J. Lackner,et al.  Induction of illusory self-rotation and nystagmus by a rotating sound-field. , 1977, Aviation, space, and environmental medicine.

[10]  C D Frith,et al.  Modulating irrelevant motion perception by varying attentional load in an unrelated task. , 1997, Science.

[11]  Asif A Ghazanfar,et al.  Multisensory Integration of Looming Signals by Rhesus Monkeys , 2004, Neuron.

[12]  D W Grantham,et al.  Detection and discrimination of simulated motion of auditory targets in the horizontal plane. , 1986, The Journal of the Acoustical Society of America.

[13]  D R Perrott,et al.  Discrimination of moving events which accelerate or decelerate over the listening interval. , 1993, The Journal of the Acoustical Society of America.

[14]  D. Moore,et al.  Auditory Neuroscience: The Salience of Looming Sounds , 2003, Current Biology.

[15]  Tammo Houtgast,et al.  Auditory distance perception in rooms , 1999, Nature.

[16]  N Lavie,et al.  Attentional demands of perception of passive self-motion in darkness , 1999, Neuropsychologia.

[17]  Alexander H. Wertheim,et al.  The Direct versus Inferential controversy revisited , 2000 .

[18]  Shuichi Sakamoto,et al.  The effects of linearly moving sound images on self-motion perception , 2004 .

[19]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[20]  R. Dodge,et al.  Thresholds of Rotation. , 1923 .

[21]  M MICHAELK.,et al.  The Doppler effect is not what you think it is : Dramatic pitch change due to dynamic intensity change , 2002 .

[22]  John G. Neuhoff,et al.  An Adaptive Bias in the Perception of Looming Auditory Motion , 2001 .

[23]  P. Sheehan,et al.  A shortened form of Betts' questionnaire upon mental imagery. , 1967, Journal of clinical psychology.

[24]  L. Rosenblum,et al.  Relative Effectiveness of Three Stimulus Variables for Locating a Moving Sound Source , 1987, Perception.

[25]  Jack M. Loomis,et al.  Auditory distance perception by translating observers , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[26]  R. S. McGowan,et al.  An Acoustic Variable Specifying Time-to-Contact , 1991 .

[27]  J. Neuhoff,et al.  The audible facing angle , 2001 .

[28]  D Rosenblum Lawrence,et al.  Auditory Reachability: An Affordance Approach to the Perception of Sound Source Distance , 1996 .

[29]  S Krafczyk,et al.  Interaction between perceived self-motion and object-motion impairs vehicle guidance. , 1984, Science.

[30]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[31]  J. Rauschecker,et al.  Perception of Sound-Source Motion by the Human Brain , 2002, Neuron.

[32]  Mendel Kleiner,et al.  Sonic self-avatars and self-motion in virtual environments , 2005 .

[33]  R A Lutfi,et al.  Correlational analysis of acoustic cues for the discrimination of auditory motion. , 1999, The Journal of the Acoustical Society of America.

[34]  Daniel Västfjäll,et al.  Perception of Self-motion and Presence in Auditory Virtual Environments , 2004 .