Quadri-stability of a spatially ambiguous auditory illusion

In addition to vision, audition plays an important role in sound localization in our world. One way we estimate the motion of an auditory object moving towards or away from us is from changes in volume intensity. However, the human auditory system has unequally distributed spatial resolution, including difficulty distinguishing sounds in front vs. behind the listener. Here, we introduce a novel quadri-stable illusion, the Transverse-and-Bounce Auditory Illusion, which combines front-back confusion with changes in volume levels of a nonspatial sound to create ambiguous percepts of an object approaching and withdrawing from the listener. The sound can be perceived as traveling transversely from front to back or back to front, or “bouncing” to remain exclusively in front of or behind the observer. Here we demonstrate how human listeners experience this illusory phenomenon by comparing ambiguous and unambiguous stimuli for each of the four possible motion percepts. When asked to rate their confidence in perceiving each sound’s motion, participants reported equal confidence for the illusory and unambiguous stimuli. Participants perceived all four illusory motion percepts, and could not distinguish the illusion from the unambiguous stimuli. These results show that this illusion is effectively quadri-stable. In a second experiment, the illusory stimulus was looped continuously in headphones while participants identified its perceived path of motion to test properties of perceptual switching, locking, and biases. Participants were biased towards perceiving transverse compared to bouncing paths, and they became perceptually locked into alternating between front-to-back and back-to-front percepts, perhaps reflecting how auditory objects commonly move in the real world. This multi-stable auditory illusion opens opportunities for studying the perceptual, cognitive, and neural representation of objects in motion, as well as exploring multimodal perceptual awareness.

[1]  Daniel Pressnitzer,et al.  Effects of self-motion on auditory scene analysis , 2012, Proceedings of the National Academy of Sciences.

[2]  John G. Neuhoff,et al.  An Adaptive Bias in the Perception of Looming Auditory Motion , 2001 .

[3]  I. G. Andreeva,et al.  Auditory aftereffects of approaching and withdrawing sound sources: Dependence on the trajectory and location of adapting stimuli , 2013, Journal of Evolutionary Biochemistry and Physiology.

[4]  L. Rayleigh,et al.  XII. On our perception of sound direction , 1907 .

[5]  H. Ehrsson.  The Experimental Induction of Out-of-Body Experiences , 2007, Science.

[6]  M. Mühlau,et al.  Neural correlates of spontaneous percept switches in ambiguous stimuli: an event‐related functional magnetic resonance imaging study , 2008, The European journal of neuroscience.

[7]  Michael K McBeath,et al.  Bias to Experience Approaching Motion in a Three-Dimensional Virtual Environment , 2004, Perception.

[8]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[9]  Matthew McAdam,et al.  The viewing-from-above bias and the silhouette illusion , 2010, i-Perception.

[10]  A. Small.  Loudness perception of signals of monotonically changing sound pressure. , 1977, The Journal of the Acoustical Society of America.

[11]  D. Deutsch.  Some new pitch paradoxes and their implications. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  F L Wightman,et al.  Headphone simulation of free-field listening. I: Stimulus synthesis. , 1989, The Journal of the Acoustical Society of America.

[13]  E. B. Newman,et al.  The localization of actual sources of sound. , 1936 .

[14]  R. Shepard.  Circularity in Judgments of Relative Pitch , 1964 .

[15]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[16]  A. Reinhardt-Rutland.  Perceptual asymmetries associated with changing-loudness aftereffects , 2004, Perception & psychophysics.

[17]  A. Reinhardt-Rutland.  Asymmetrical perception of changing intensity in short tonal stimuli: duration of stimulus. , 1996, The Journal of general psychology.

[18]  Anderson Tr,et al.  The accuracy of absolute localization judgments for speech stimuli. , 1995 .

[19]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[20]  W. Ehrenstein,et al.  The Growing-Louder Effect in Short Diotic Stimuli , 1996, Perceptual and motor skills.

[21]  B. Shinn-Cunningham,et al.  Tori of confusion: binaural localization cues for sources within reach of a listener. , 2000, The Journal of the Acoustical Society of America.

[22]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[23]  F L Wightman,et al.  Resolution of front-back ambiguity in spatial hearing by listener and source movement. , 1999, The Journal of the Acoustical Society of America.

[24]  W. O. Brimijoin,et al.  The role of head movements and signal spectrum in an auditory front/back illusion , 2012, i-Perception.

[25]  John M. Chowning,et al.  THE SIMULATION OF MOVING SOUND SOURCES , 1970 .

[26]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[27]  A Psychophysiological Study of Auditory Illusions of Approach and Withdrawal in the Context of the Perceptual Environment , 2007, The Spanish Journal of Psychology.

[28]  James A. Caviness,et al.  Persistent Fear Responses in Rhesus Monkeys to the Optical Stimulus of "Looming" , 1962, Science.

[29]  R H Gilkey,et al.  The accuracy of absolute localization judgments for speech stimuli. , 1995, Journal of vestibular research : equilibrium & orientation.

[30]  G. Rees,et al.  The Neural Bases of Multistable Perception , 2022 .

[31]  D R Begault,et al.  Headphone Localization of Speech , 1993, Human factors.

[32]  Nico Orlandi.  Visual Switching: The Illusion of Instantaneity and Visual Search , 2012 .

[33]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[34]  E. Spelke,et al.  Infants' knowledge of object motion and human action. , 1995 .

[35]  A. Ames.  Visual perception and the rotating trapezoidal window , 1951 .

[36]  W. Metzger.  Beobachtungen über phänomenale Identität , 1934 .

[37]  Aude Oliva,et al.  Spatial Frequency Integration During Active Perception: Perceptual Hysteresis When an Object Recedes , 2012, Front. Psychology.

[38]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[39]  L. Rosenblum,et al.  Relative Effectiveness of Three Stimulus Variables for Locating a Moving Sound Source , 1987, Perception.