Diversity in pitch perception revealed by task dependence

Pitch conveys critical information in speech, music and other natural sounds, and is conventionally defined as the perceptual correlate of a sound’s fundamental frequency (F0). Although pitch is widely assumed to be subserved by a single F0 estimation process, real-world pitch tasks vary enormously, raising the possibility of underlying mechanistic diversity. To probe pitch mechanisms, we conducted a battery of pitch-related music and speech tasks using conventional harmonic sounds and inharmonic sounds whose frequencies lack a common F0. Some pitch-related abilities—those relying on musical interval or voice recognition—were strongly impaired by inharmonicity, suggesting a reliance on F0. However, other tasks, including those dependent on pitch contours in speech and music, were unaffected by inharmonicity, suggesting a mechanism that tracks the frequency spectrum rather than the F0. The results suggest that pitch perception is mediated by several different mechanisms, only some of which conform to traditional notions of pitch.In a series of 11 experiments, the authors show that what has traditionally been considered 'pitch perception' is mediated by several different mechanisms.

[1]  Emily J. Allen,et al.  Representations of Pitch and Timbre Variation in Human Auditory Cortex , 2017, The Journal of Neuroscience.

[2]  Brian Roberts,et al.  Grouping and the pitch of a mistuned fundamental component: Effects of applying simultaneous multiple mistunings to the other harmonics , 2006, Hearing Research.

[3]  D. Schön,et al.  The music of speech: music training facilitates pitch processing in both music and language. , 2004, Psychophysiology.

[4]  R. Carlyon,et al.  The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. , 1994, The Journal of the Acoustical Society of America.

[5]  Aniruddh D. Patel,et al.  Songbirds use spectral shape, not pitch, for sound pattern recognition , 2016, Proceedings of the National Academy of Sciences.

[6]  Robert P Carlyon,et al.  Across-frequency interference effects in fundamental frequency discrimination: questioning evidence for two pitch mechanisms. , 2004, The Journal of the Acoustical Society of America.

[7]  HIDEKI KAWAHARA,et al.  Technical foundations of TANDEM-STRAIGHT, a speech analysis, modification and synthesis framework , 2011 .

[8]  Mireille Besson,et al.  Musicians Detect Pitch Violation in a Foreign Language Better Than Nonmusicians: Behavioral and Electrophysiological Evidence , 2007, Journal of Cognitive Neuroscience.

[9]  David P. Corina,et al.  Perception of long-distance coarticulation: An event-related potential and behavioral study , 2011, Applied Psycholinguistics.

[10]  R. Patterson,et al.  The Processing of Temporal Pitch and Melody Information in Auditory Cortex , 2002, Neuron.

[11]  Andrew J Oxenham,et al.  Does fundamental-frequency discrimination measure virtual pitch discrimination? , 2010, The Journal of the Acoustical Society of America.

[12]  A. Oxenham,et al.  Further evidence that fundamental-frequency difference limens measure pitch discrimination. , 2012, The Journal of the Acoustical Society of America.

[13]  Richard J. H. Smith,et al.  Sensorineural Hearing Loss , 2015, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[14]  S Shamma,et al.  The case of the missing pitch templates: how harmonic templates emerge in the early auditory system. , 2000, The Journal of the Acoustical Society of America.

[15]  Kerry M. M. Walker,et al.  Neural Ensemble Codes for Stimulus Periodicity in Auditory Cortex , 2010, The Journal of Neuroscience.

[16]  P J Bailey,et al.  Spectral regularity as a factor distinct from harmonic relations in auditory grouping. , 1996, Journal of experimental psychology. Human perception and performance.

[17]  Daniel P. W. Ellis,et al.  Inharmonic speech: a tool for the study of speech perception and separation , 2012, SAPA@INTERSPEECH.

[18]  Hermann von Helmholtz,et al.  On the Sensations of Tone , 1954 .

[19]  Hideki Kawahara,et al.  Tandem-STRAIGHT: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, F0, and aperiodicity estimation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  C Kaernbach,et al.  Psychophysical evidence against the autocorrelation theory of auditory temporal processing. , 1998, The Journal of the Acoustical Society of America.

[21]  Josh H. McDermott,et al.  Individual Differences Reveal the Basis of Consonance , 2010, Current Biology.

[22]  M. Scherg,et al.  Structural and functional asymmetry of lateral Heschl's gyrus reflects pitch perception preference , 2005, Nature Neuroscience.

[23]  B. L. Cardozo,et al.  Pitch of the Residue , 1962 .

[24]  Laurel J. Trainor,et al.  A Comparison of Contour and Interval Processing in Musicians and Nonmusicians Using Event‐Related Potentials , 1999 .

[25]  Josh H McDermott,et al.  Headphone screening to facilitate web-based auditory experiments , 2017, Attention, Perception, & Psychophysics.

[26]  Josh H McDermott,et al.  Music Perception, Pitch, and the Auditory System This Review Comes from a Themed Issue on Sensory Systems Edited Pitch Relations across Time—relative Pitch Relative Pitch—behavioral Evidence Neural Mechanisms of Relative Pitch Representation of Simultaneous Pitches— Chords and Polyphony Summary and , 2022 .

[27]  Josh H. McDermott,et al.  Distortion products in auditory fMRI research: Measurements and solutions , 2016, NeuroImage.

[28]  F. D’Antonio,et al.  Musical cognition in Alzheimer's disease: application of the Montreal Battery of Evaluation of Amusia , 2016, Annals of the New York Academy of Sciences.

[29]  Pascal Belin,et al.  Human voice perception , 2011, Current Biology.

[30]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. , 1996, Journal of neurophysiology.

[31]  J. Smurzyński,et al.  Pitch identification and discrimination for complex tones with many harmonics , 1990 .

[32]  B. Delgutte,et al.  Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase invariance, pitch circularity, rate pitch, and the dominance region for pitch. , 1996, Journal of neurophysiology.

[33]  Carla Teixeira Lopes,et al.  TIMIT Acoustic-Phonetic Continuous Speech Corpus , 2012 .

[34]  Robert J Zatorre,et al.  Influence of tonal context and timbral variation on perception of pitch , 2002, Perception & Psychophysics.

[35]  Josh H McDermott,et al.  PSYCHOLOGICAL SCIENCE Research Article Is Relative Pitch Specific to Pitch? , 2022 .

[36]  Hideki Kawahara,et al.  STRAIGHT, exploitation of the other aspect of VOCODER: Perceptually isomorphic decomposition of speech sounds , 2006 .

[37]  A. Faulkner Pitch discrimination of harmonic complex signals: residue pitch or multiple component discriminations? , 1985, The Journal of the Acoustical Society of America.

[38]  Daniel Pressnitzer,et al.  Tuning properties of the auditory frequency-shift detectors. , 2009, The Journal of the Acoustical Society of America.

[39]  B C Moore,et al.  Frequency discrimination of complex tones with overlapping and non-overlapping harmonics. , 1990, The Journal of the Acoustical Society of America.

[40]  Josh H McDermott,et al.  Musical intervals and relative pitch: frequency resolution, not interval resolution, is special. , 2010, The Journal of the Acoustical Society of America.

[41]  C. Micheyl,et al.  Neural Representation of Harmonic Complex Tones in Primary Auditory Cortex of the Awake Monkey , 2013, The Journal of Neuroscience.

[42]  Ernst Terhardt,et al.  Calculating virtual pitch , 1979, Hearing Research.

[43]  W. Dowling,et al.  Contour, interval, and pitch recognition in memory for melodies. , 1971, The Journal of the Acoustical Society of America.

[44]  Josh H. McDermott,et al.  Cortical Pitch Regions in Humans Respond Primarily to Resolved Harmonics and Are Located in Specific Tonotopic Regions of Anterior Auditory Cortex , 2013, The Journal of Neuroscience.

[45]  Andrew J Oxenham,et al.  The relationship between frequency selectivity and pitch discrimination: sensorineural hearing loss. , 2006, The Journal of the Acoustical Society of America.

[46]  I. Peretz,et al.  Varieties of Musical Disorders , 2003, Annals of the New York Academy of Sciences.

[47]  Jonathan G. Fiscus,et al.  DARPA TIMIT:: acoustic-phonetic continuous speech corpus CD-ROM, NIST speech disc 1-1.1 , 1993 .

[48]  W. T. Peake,et al.  Experiments in Hearing , 1963 .

[49]  Josh H. McDermott,et al.  Distinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel Decomposition , 2015, Neuron.

[50]  David Temperley,et al.  A Probabilistic Model of Melody Perception , 2008, ISMIR.

[51]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[52]  J. Licklider “Periodicity” Pitch and “Place” Pitch , 1954 .

[53]  L. Rayleigh,et al.  The theory of sound , 1894 .

[54]  Andrew J Oxenham,et al.  A Neural Representation of Pitch Salience in Nonprimary Human Auditory Cortex Revealed with Functional Magnetic Resonance Imaging , 2004, The Journal of Neuroscience.

[55]  Andrew J Oxenham,et al.  Perceptual grouping affects pitch judgments across time and frequency. , 2011, Journal of experimental psychology. Human perception and performance.

[56]  G. Békésy,et al.  Experiments in Hearing , 1963 .

[57]  J. Sloboda The Musical Mind: The Cognitive Psychology of Music , 1987 .

[58]  Xiaoqin Wang,et al.  Harmonic template neurons in primate auditory cortex underlying complex sound processing , 2017, Proceedings of the National Academy of Sciences.

[59]  D. Bendor,et al.  The neuronal representation of pitch in primate auditory cortex , 2005, Nature.

[60]  Maneesh Sahani,et al.  Prior context in audition informs binding and shapes simple features , 2017, Nature Communications.

[61]  Liberty S. Hamilton,et al.  Intonational speech prosody encoding in the human auditory cortex , 2017, Science.

[62]  Aniruddh D. Patel Can nonlinguistic musical training change the way the brain processes speech? The expanded OPERA hypothesis , 2014, Hearing Research.

[63]  Ray Meddis,et al.  Virtual pitch and phase sensitivity of a computer model of the auditory periphery , 1991 .

[64]  J. L. Goldstein An optimum processor theory for the central formation of the pitch of complex tones. , 1973, The Journal of the Acoustical Society of America.

[65]  R. Fay,et al.  Pitch : neural coding and perception , 2005 .

[66]  Al Yonovitz,et al.  Behavioral and electrophysiological evidence for backward masking , 2016 .

[67]  A. Oxenham,et al.  Influence of musical and psychoacoustical training on pitch discrimination , 2006, Hearing Research.

[68]  B. Moore,et al.  Thresholds for hearing mistuned partials as separate tones in harmonic complexes. , 1986, The Journal of the Acoustical Society of America.

[69]  S McAdams,et al.  Hearing a mistuned harmonic in an otherwise periodic complex tone. , 1990, The Journal of the Acoustical Society of America.

[70]  M. Tervaniemi,et al.  Pitch discrimination accuracy in musicians vs nonmusicians: an event-related potential and behavioral study , 2005, Experimental Brain Research.