The Duration of Uncertain Times: Audiovisual Information about Intervals Is Integrated in a Statistically Optimal Fashion

Often multisensory information is integrated in a statistically optimal fashion where each sensory source is weighted according to its precision. This integration scheme is statistically optimal because it theoretically results in unbiased perceptual estimates with the highest precision possible. There is a current lack of consensus about how the nervous system processes multiple sensory cues to elapsed time. In order to shed light upon this, we adopt a computational approach to pinpoint the integration strategy underlying duration estimation of audio/visual stimuli. One of the assumptions of our computational approach is that the multisensory signals redundantly specify the same stimulus property. Our results clearly show that despite claims to the contrary, perceived duration is the result of an optimal weighting process, similar to that adopted for estimates of space. That is, participants weight the audio and visual information to arrive at the most precise, single duration estimate possible. The work also disentangles how different integration strategies – i.e. considering the time of onset/offset of signals - might alter the final estimate. As such we provide the first concrete evidence of an optimal integration strategy in human duration estimates.

[1]  M Concetta Morrone,et al.  Saccadic eye movements cause compression of time as well as space , 2005, Nature Neuroscience.

[2]  Eli Brenner,et al.  Temporal information can influence spatial localization. , 2009, Journal of neurophysiology.

[3]  A. Angrilli,et al.  The influence of affective factors on time perception , 1997, Perception & psychophysics.

[4]  Shin'ya Nishida,et al.  Effect of the luminance signal on adaptation-based time compression. , 2011, Journal of vision.

[5]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[6]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[7]  John C. Rothwell,et al.  Illusory perceptions of space and time preserve cross-saccadic perceptual continuity , 2001, Nature.

[8]  J. Gibbon,et al.  Timing and time perception. , 1984, Annals of the New York Academy of Sciences.

[9]  Correction: The Duration of Uncertain Times: Audiovisual Information about Intervals Is Integrated in a Statistically Optimal Fashion , 2014, PLoS ONE.

[10]  S. Grondin,et al.  From physical time to the first and second moments of psychological time. , 2001, Psychological bulletin.

[11]  C. Gallistel,et al.  The Importance of Proving the Null , 2022 .

[12]  M. Landy,et al.  Weighted linear cue combination with possibly correlated error , 2003, Vision Research.

[13]  P. Christiaan Klink,et al.  Crossmodal duration perception involves perceptual grouping, temporal ventriloquism, and variable internal clock rates , 2010, Attention, perception & psychophysics.

[14]  Rolf Ulrich,et al.  Crossmodal temporal discrimination: Assessing the predictions of a general pacemaker-counter model , 2006, Perception & psychophysics.

[15]  Alfred B. Kristofferson,et al.  Psychophysical theories of duration discrimination , 1974 .

[16]  M Concetta Morrone,et al.  Neural mechanisms for timing visual events are spatially selective in real-world coordinates , 2007, Nature Neuroscience.

[17]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[18]  Simon Grondin,et al.  Sensory‐specific clock components and memory mechanisms: investigation with parallel timing , 2010, The European journal of neuroscience.

[19]  D. Eagleman Human time perception and its illusions , 2008, Current Opinion in Neurobiology.

[20]  D. Alais,et al.  Evidence for two interacting temporal channels in human visual processing , 2006, Vision Research.

[21]  Catalin V. Buhusi,et al.  What makes us tick? Functional and neural mechanisms of interval timing , 2005, Nature Reviews Neuroscience.

[22]  Jonathan D. Cohen,et al.  Optimal Temporal Risk Assessment , 2011, Front. Integr. Neurosci..

[23]  S. Klein,et al.  Spatial frequency channels in human vision as asymmetric (edge) mechanisms. , 1974, Vision research.

[24]  Patrick Haggard,et al.  Optimal integration of auditory and vibrotactile information for judgments of temporal order. , 2009, Journal of experimental psychology. Human perception and performance.

[25]  D. Burr,et al.  Auditory dominance over vision in the perception of interval duration , 2009, Experimental Brain Research.

[26]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[27]  W. Meck,et al.  Neuropsychological mechanisms of interval timing behavior. , 2000, BioEssays : news and reviews in molecular, cellular and developmental biology.

[28]  D. Burr,et al.  Optimal Encoding of Interval Timing in Expert Percussionists , 2011, The Journal of Neuroscience.

[29]  M. Treisman Temporal discrimination and the indifference interval. Implications for a model of the "internal clock". , 1963, Psychological monographs.

[30]  Massimiliano Di Luca,et al.  Recalibration of multisensory simultaneity: cross-modal transfer coincides with a change in perceptual latency. , 2009, Journal of vision.

[31]  Sheng He,et al.  Larger stimuli are judged to last longer. , 2007, Journal of vision.

[32]  David Whitaker,et al.  Duration channels mediate human time perception , 2011, Proceedings of the Royal Society B: Biological Sciences.

[33]  Madeleine Schlag-Rey,et al.  Voluntary action expands perceived duration of its sensory consequence , 2003, Experimental Brain Research.

[34]  R M Church,et al.  Properties of the Internal Clock a , 1984, Annals of the New York Academy of Sciences.

[35]  Martin Wiener,et al.  Multiple Mechanisms for Temporal Processing , 2011, Front. Integr. Neurosci..

[36]  Andrei Gorea,et al.  Ticks per thought or thoughts per tick? A selective review of time perception with hints on future research , 2011, Journal of Physiology-Paris.

[37]  D. Alais,et al.  Temporal ventriloquism in a purely temporal context. , 2011, Journal of experimental psychology. Human perception and performance.

[38]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .