Perceptual Distortions in Pitch and Time Reveal Active Prediction and Support for an Auditory Pitch-Motion Hypothesis

A number of accounts of human auditory perception assume that listeners use prior stimulus context to generate predictions about future stimulation. Here, we tested an auditory pitch-motion hypothesis that was developed from this perspective. Listeners judged either the time change (i.e., duration) or pitch change of a comparison frequency glide relative to a standard (referent) glide. Under a constant-velocity assumption, listeners were hypothesized to use the pitch velocity (Δf/Δt) of the standard glide to generate predictions about the pitch velocity of the comparison glide, leading to perceptual distortions along the to-be-judged dimension when the velocities of the two glides differed. These predictions were borne out in the pattern of relative points of subjective equality by a significant three-way interaction between the velocities of the two glides and task. In general, listeners’ judgments along the task-relevant dimension (pitch or time) were affected by expectations generated by the constant-velocity standard, but in an opposite manner for the two stimulus dimensions. When the comparison glide velocity was faster than the standard, listeners overestimated time change, but underestimated pitch change, whereas when the comparison glide velocity was slower than the standard, listeners underestimated time change, but overestimated pitch change. Perceptual distortions were least evident when the velocities of the standard and comparison glides were matched. Fits of an imputed velocity model further revealed increasingly larger distortions at faster velocities. The present findings provide support for the auditory pitch-motion hypothesis and add to a larger body of work revealing a role for active prediction in human auditory perception.

[1]  Karl J. Friston,et al.  Dynamic causal modelling of evoked responses: The role of intrinsic connections , 2007, NeuroImage.

[2]  Shinsuke Shimojo,et al.  Distortions of Subjective Time Perception Within and Across Senses , 2008, PloS one.

[3]  John G. Neuhoff,et al.  An Adaptive Bias in the Perception of Looming Auditory Motion , 2001 .

[4]  Noah MacKenzie The kappa effect in pitch/time context , 2007 .

[5]  Eric Keller,et al.  Prosodic aspects of speech , 1995 .

[6]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[7]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[8]  H. Woodrow,et al.  The temporal indifference interval determined by the method of mean error. , 1934 .

[9]  Laura C. Dilley,et al.  Distal prosodic context affects word segmentation and lexical processing , 2008 .

[10]  Mari Riess Jones,et al.  Effects of attentional set and rhythmic complexity on attending , 1996, Perception & psychophysics.

[11]  R. Frick Communicating emotion: The role of prosodic features. , 1985 .

[12]  Bill Jones,et al.  Space-time dependencies in psychophysical judgment of extent and duration: Algebraic models of the tau and kappa effects. , 1982 .

[13]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[14]  Bruno L. Giordano,et al.  Spatial representation of pitch height: the SMARC effect , 2006, Cognition.

[15]  Masami Ishihara,et al.  Horizontal spatial representations of time: Evidence for the STEARC effect , 2008, Cortex.

[16]  J. Morais,et al.  Spatial associations for musical stimuli: a piano in the head? , 2007, Journal of experimental psychology. Human perception and performance.

[17]  C. Krumhansl,et al.  Music psychology:tonal structures in perception and memory. , 1991, Annual review of psychology.

[18]  J. Devin McAuley,et al.  Modeling effects of rhythmic context on perceived duration: a comparison of interval and entrainment approaches to short-interval timing. , 2003, Journal of experimental psychology. Human perception and performance.

[19]  M. Jones,et al.  Attending to auditory events: The role of temporal organization. , 1993 .

[20]  Nathaniel S. Miller,et al.  Tempo sensitivity in isochronous tone sequences: The multiple-look model revisited , 2005, Perception & psychophysics.

[21]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[22]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[23]  Eric Keller,et al.  Fundamentals of speech synthesis and speech recognition: basic concepts, state-of-the-art and future challenges , 1995 .

[24]  Helga Lejeune,et al.  Vierordt's The Experimental Study of the Time Sense (1868) and its legacy , 2009 .

[25]  M. Grassi,et al.  The subjective duration of ramped and damped sounds , 2006, Perception & psychophysics.

[26]  Peter Q. Pfordresher,et al.  Tracking Musical Patterns using Joint Accent Structure , 1997 .

[27]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[29]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[30]  J. Devin McAuley,et al.  Evaluation of an imputed pitch velocity model of the auditory kappa effect. , 2009, Journal of experimental psychology. Human perception and performance.

[31]  P. Brakefield,et al.  The Male Sex Pheromone of the Butterfly Bicyclus anynana: Towards an Evolutionary Analysis , 2008, PloS one.

[32]  M. R. Jones,et al.  Time, our lost dimension: toward a new theory of perception, attention, and memory. , 1976, Psychological review.

[33]  Karl J. Friston,et al.  Behavioral / Systems / Cognitive Striatal Prediction Error Modulates Cortical Coupling , 2010 .

[34]  R. Schlauch,et al.  Duration discrimination and subjective duration for ramped and damped sounds. , 2001, The Journal of the Acoustical Society of America.

[35]  Peter E. Keller,et al.  Exogenous and endogenous response priming with auditory stimuli , 2006 .

[36]  S. McAdams,et al.  Auditory Cognition. (Book Reviews: Thinking in Sound. The Cognitive Psychology of Human Audition.) , 1993 .

[37]  Ralph Barnes,et al.  Expectancy, Attention, and Time , 2000, Cognitive Psychology.

[38]  J. Devin McAuley,et al.  Evaluation of an imputed pitch velocity model of the auditory tau effect , 2009, Attention, perception & psychophysics.

[39]  Karl Vierordt,et al.  Der Zeitsinn nach Versuchen , 1868 .

[40]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[41]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[42]  John G. Neuhoff,et al.  Perceptual bias for rising tones , 1998, Nature.

[43]  J. Devin McAuley,et al.  Velocity perception for sounds moving in frequency space , 2011, Attention, perception & psychophysics.

[44]  M. Jones,et al.  Effects of auditory pattern structure on anticipatory and reactive attending , 2006, Cognitive Psychology.

[45]  E. Schröger,et al.  Early electrophysiological indicators for predictive processing in audition: a review. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[46]  M. Jones,et al.  Temporal Aspects of Stimulus-Driven Attending in Dynamic Arrays , 2002, Psychological science.