Auditory Time-Interval Perception as Causal Inference on Sound Sources

Perception of a temporal pattern in a sub-second time scale is fundamental to conversation, music perception, and other kinds of sound communication. However, its mechanism is not fully understood. A simple example is hearing three successive sounds with short time intervals. The following misperception of the latter interval is known: underestimation of the latter interval when the former is a little shorter or much longer than the latter, and overestimation of the latter when the former is a little longer or much shorter than the latter. Although this misperception of auditory time intervals for simple stimuli might be a cue to understanding the mechanism of time-interval perception, there exists no model that comprehensively explains it. Considering a previous experiment demonstrating that illusory perception does not occur for stimulus sounds with different frequencies, it might be plausible to think that the underlying mechanism of time-interval perception involves a causal inference on sound sources: herein, different frequencies provide cues for different causes. We construct a Bayesian observer model of this time-interval perception. We introduce a probabilistic variable representing the causality of sounds in the model. As prior knowledge, the observer assumes that a single sound source produces periodic and short time intervals, which is consistent with several previous works. We conducted numerical simulations and confirmed that our model can reproduce the misperception of auditory time intervals. A similar phenomenon has also been reported in visual and tactile modalities, though the time ranges for these are wider. This suggests the existence of a common mechanism for temporal pattern perception over modalities. This is because these different properties can be interpreted as a difference in time resolutions, given that the time resolutions for vision and touch are lower than those for audition.

[1]  Daniel Goldreich,et al.  A Bayesian Perceptual Model Replicates the Cutaneous Rabbit and Other Tactile Spatiotemporal Illusions , 2007, PloS one.

[2]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[3]  Konrad Kording,et al.  Annals of the New York Academy of Sciences Bayesian Models: the Structure of the World, Uncertainty, Behavior, and the Brain , 2022 .

[4]  D. Deutsch.  Two-channel listening to musical scales. , 1975, The Journal of the Acoustical Society of America.

[5]  Maria Concetta Morrone,et al.  Temporal mechanisms of multimodal binding , 2009, Proceedings of the Royal Society B: Biological Sciences.

[6]  C. Spence,et al.  Audiotactile interactions in temporal perception , 2011, Psychonomic bulletin & review.

[7]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[8]  Ulrik R. Beierholm,et al.  Causal inference in perception , 2010, Trends in Cognitive Sciences.

[9]  Y. Nakajima,et al.  Does Time-Shrinking Take Place in Visual Temporal Patterns? , 2000, Perception.

[10]  Yoshitaka Nakajima,et al.  A New Illusion of Time Perception , 1991 .

[11]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[12]  L. Pinneo.  On noise in the nervous system. , 1966, Psychological review.

[13]  Yoshitaka Nakajima,et al.  Time-shrinking: A discontinuity in the perception of auditory temporal patterns , 1992, Perception & psychophysics.

[14]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[15]  J. Vroomen,et al.  Perception of intersensory synchrony: A tutorial review , 2010, Attention, perception & psychophysics.

[16]  G ten Hoopen,et al.  Auditory spatial alternation transforms auditory time. , 1983, Journal of experimental psychology. Human perception and performance.

[17]  Junji Watanabe,et al.  Somatotopic dominance in tactile temporal processing , 2010, Experimental Brain Research.

[18]  Yoshitaka Nakajima,et al.  On the robustness of time-shrinking , 1999 .

[19]  Simon Grondin,et al.  Discrimination of time intervals presented in sequences: spatial effects with multiple auditory sources. , 2007, Human movement science.

[20]  Yoshitaka Nakajima,et al.  The category of 1:1 ratio caused by assimilation of two neighboring empty time intervals. , 2007, Human movement science.

[21]  Jan B. F. van Erp,et al.  Time-Shrinking and the Design of Tactons , 2008, EuroHaptics.

[22]  Ryota Miyauchi,et al.  Bilateral Assimilation of Two Neighboring Empty Time Intervals , 2005 .

[23]  Yoshitaka Nakajima,et al.  Time-Shrinking and Categorical Temporal Ratio Perception: Evidence for a 1:1 Temporal Category , 2006 .

[24]  Yoshitaka Nakajima,et al.  Electrophysiological evidence of auditory temporal perception related to the assimilation between two neighboring time intervals , 2009 .

[25]  Kazuyuki Aihara,et al.  Bayesian Inference Explains Perception of Unity and Ventriloquism Aftereffect: Identification of Common Sources of Audiovisual Stimuli , 2007, Neural Computation.

[26]  Yoshitaka Nakajima,et al.  Time-Shrinking: The Process of Unilateral Temporal Assimilation , 2004, Perception.