The Role of the Auditory Brainstem in Processing Musically Relevant Pitch

Neuroimaging work has shed light on the cerebral architecture involved in processing the melodic and harmonic aspects of music. Here, recent evidence is reviewed illustrating that subcortical auditory structures contribute to the early formation and processing of musically relevant pitch. Electrophysiological recordings from the human brainstem and population responses from the auditory nerve reveal that nascent features of tonal music (e.g., consonance/dissonance, pitch salience, harmonic sonority) are evident at early, subcortical levels of the auditory pathway. The salience and harmonicity of brainstem activity is strongly correlated with listeners’ perceptual preferences and perceived consonance for the tonal relationships of music. Moreover, the hierarchical ordering of pitch intervals/chords described by the Western music practice and their perceptual consonance is well-predicted by the salience with which pitch combinations are encoded in subcortical auditory structures. While the neural correlates of consonance can be tuned and exaggerated with musical training, they persist even in the absence of musicianship or long-term enculturation. As such, it is posited that the structural foundations of musical pitch might result from innate processing performed by the central auditory system. A neurobiological predisposition for consonant, pleasant sounding pitch relationships may be one reason why these pitch combinations have been favored by composers and listeners for centuries. It is suggested that important perceptual dimensions of music emerge well before the auditory signal reaches cerebral cortex and prior to attentional engagement. While cortical mechanisms are no doubt critical to the perception, production, and enjoyment of music, the contribution of subcortical structures implicates a more integrated, hierarchically organized network underlying music processing within the brain.

[1]  E. M. Burns Intervals, Scales, and Tuning , 1999 .

[2]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[3]  S. Trehub,et al.  Infant music perception: Domain-general or domain-specific mechanisms? , 2006, Cognition.

[4]  W. S. Rhode Interspike intervals as a correlate of periodicity pitch in cat cochlear nucleus. , 1995, The Journal of the Acoustical Society of America.

[5]  Gavin M. Bidelman,et al.  Musicians demonstrate experience-dependent brainstem enhancement of musical scale features within continuously gliding pitch , 2011, Neuroscience Letters.

[6]  Gavin M. Bidelman,et al.  Neural Correlates of Consonance, Dissonance, and the Hierarchy of Musical Pitch in the Human Brainstem , 2009, The Journal of Neuroscience.

[7]  I. Peretz,et al.  Musical scale properties are automatically processed in the human auditory cortex , 2006, Brain Research.

[8]  Vesa Välimäki,et al.  Neural representations of the hierarchical scale pitch structure , 2007 .

[9]  G. Langner,et al.  Neural processing and representation of periodicity pitch. , 1997, Acta oto-laryngologica. Supplementum.

[10]  Takashi X. Fujisawa,et al.  The Psychophysics of Harmony Perception: Harmony is a Three-Tone Phenomenon , 2006 .

[11]  Martin Ebeling,et al.  Neuronal periodicity detection as a basis for the perception of consonance: a mathematical model of tonal fusion. , 2008, The Journal of the Acoustical Society of America.

[12]  Terence W. Picton,et al.  Envelope and spectral frequency-following responses to vowel sounds , 2008, Hearing Research.

[13]  Erika Skoe,et al.  Neural Processing of Speech Sounds in ASD and First-Degree Relatives , 2010, Journal of Autism and Developmental Disorders.

[14]  E. Schellenberg,et al.  Sensory consonance and the perceptual similarity of complex-tone harmonic intervals: tests of adult and infant listeners. , 1996, The Journal of the Acoustical Society of America.

[15]  Carl Schachter,et al.  Harmony And Voice Leading , 1978 .

[16]  J. L. Goldstein An optimum processor theory for the central formation of the pitch of complex tones. , 1973, The Journal of the Acoustical Society of America.

[17]  I. Peretz,et al.  Congenital amusia: a group study of adults afflicted with a music-specific disorder. , 2002, Brain : a journal of neurology.

[18]  Nicole M. Russo,et al.  Musical experience shapes human brainstem encoding of linguistic pitch patterns , 2007, Nature Neuroscience.

[19]  Takashi X. Fujisawa,et al.  The perception of harmonic triads: an fMRI study , 2011, Brain Imaging and Behavior.

[20]  Constantine Frithiof Malmberg,et al.  The perception of consonance and dissonance , 1918 .

[21]  Gavin M. Bidelman,et al.  Cross-domain Effects of Music and Language Experience on the Representation of Pitch in the Human Auditory Brainstem , 2011, Journal of Cognitive Neuroscience.

[22]  J. L. Goldstein,et al.  The Central Origin of the Pitch of Complex Tones: Evidence from Musical Interval Recognition , 1972 .

[23]  Josh H. McDermott,et al.  The basis of musical consonance as revealed by congenital amusia , 2012, Proceedings of the National Academy of Sciences.

[24]  B. Delgutte,et al.  Neurobiological Foundations for the Theory of Harmony in Western Tonal Music , 2001, Annals of the New York Academy of Sciences.

[25]  Gerald Langner,et al.  Topographic Representation of Periodicity Information: The 2nd Neural Axis of the Auditory System , 2005 .

[26]  Hideko Takeshita,et al.  Preference for consonant music over dissonant music by an infant chimpanzee , 2009, Primates.

[27]  David Huron,et al.  Tonal Consonance versus Tonal Fusion in Polyphonic Sonorities , 1991 .

[28]  E. Terhardt,et al.  Algorithm for extraction of pitch and pitch salience from complex tonal signals , 1982 .

[29]  Daniel I. Brooks,et al.  Chord Discrimination by Pigeons , 2010 .

[30]  E. Schellenberg,et al.  Frequency ratios and the perception of tone patterns , 1994, Psychonomic bulletin & review.

[31]  D. Purves,et al.  The Statistical Structure of Human Speech Sounds Predicts Musical Universals , 2003, The Journal of Neuroscience.

[32]  Laurel J. Trainor,et al.  Infants' perception of good and bad melodies. , 1990 .

[33]  K. James,et al.  Neural correlates of the Pythagorean ratio rules , 2007, Neuroreport.

[34]  R. Zatorre,et al.  Functional specificity in the right human auditory cortex for perceiving pitch direction. , 2000, Brain : a journal of neurology.

[35]  Consonance and Dissonance , 1913 .

[36]  M. Scherg,et al.  A Source Analysis of the Late Human Auditory Evoked Potentials , 1989, Journal of Cognitive Neuroscience.

[37]  R. Plomp,et al.  The connotation of musical consonance , 1962 .

[38]  Josh H. McDermott,et al.  THE ORIGINS OF MUSIC: INNATENESS, UNIQUENESS, AND EVOLUTION , 2005 .

[39]  Steven Greenberg,et al.  Neural temporal coding of low pitch. I. Human frequency-following responses to complex tones , 1987, Hearing Research.

[40]  Paul C. Boomsliter,et al.  The Long Pattern Hypothesis in Harmony and Hearing , 1961 .

[41]  E. Terhardt On the perception of periodic sound fluctuations (roughness) , 1974 .

[42]  Frank H. Slaymaker,et al.  Chords from Tones Having Stretched Partials , 1970 .

[43]  B. Delgutte,et al.  Pitch of complex tones: rate-place and interspike interval representations in the auditory nerve. , 2005, Journal of neurophysiology.

[44]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[45]  D. Purves,et al.  A Biological Rationale for Musical Scales , 2009, PloS one.

[46]  Tsutomu Nakada,et al.  Cortical processing of musical consonance: an evoked potential study , 2003, Neuroreport.

[47]  G. Bidelman,et al.  Tone Language Speakers and Musicians Share Enhanced Perceptual and Cognitive Abilities for Musical Pitch: Evidence for Bidirectionality between the Domains of Language and Music , 2013, PloS one.

[48]  Timothy D. Griffiths,et al.  Orthogonal representation of sound dimensions in the primate midbrain , 2011, Nature Neuroscience.

[49]  Erika Skoe,et al.  Selective Subcortical Enhancement of Musical Intervals in Musicians , 2009, The Journal of Neuroscience.

[50]  N. Kraus,et al.  The scalp-recorded brainstem response to speech: neural origins and plasticity. , 2010, Psychophysiology.

[51]  Laurel H Carney,et al.  A phenomenological model of the synapse between the inner hair cell and auditory nerve: long-term adaptation with power-law dynamics. , 2009, The Journal of the Acoustical Society of America.

[52]  Mireille Besson,et al.  SENSORY CONSONANCE: An ERP Study , 2005 .

[53]  M. Sams,et al.  Musicians have enhanced subcortical auditory and audiovisual processing of speech and music , 2007, Proceedings of the National Academy of Sciences.

[54]  Tsutomu Nakada,et al.  Central auditory processing of noncontextual consonance in music: an evoked potential study. , 2010, The Journal of the Acoustical Society of America.

[55]  Ernst Mach,et al.  Sensations of tone. , 1897 .

[56]  Josh H McDermott,et al.  Music Perception, Pitch, and the Auditory System This Review Comes from a Themed Issue on Sensory Systems Edited Pitch Relations across Time—relative Pitch Relative Pitch—behavioral Evidence Neural Mechanisms of Relative Pitch Representation of Simultaneous Pitches— Chords and Polyphony Summary and , 2022 .

[57]  M. Scherg,et al.  Intracerebral Sources of Human Auditory-Evoked Potentials , 1999, Audiology and Neurotology.

[58]  A R Palmer,et al.  Phase‐locked responses to pure tones in guinea pig auditory cortex , 2000, Neuroreport.

[59]  A. Krishnan,et al.  Musicians and tone-language speakers share enhanced brainstem encoding but not perceptual benefits for musical pitch , 2011, Brain and Cognition.

[60]  I. Peretz,et al.  Universal Recognition of Three Basic Emotions in Music , 2009, Current Biology.

[61]  A. Krishnan,et al.  Effects of reverberation on brainstem representation of speech in musicians and non-musicians , 2010, Brain Research.

[62]  Ananthanarayan Krishnan,et al.  Enhanced brainstem encoding predicts musicians’ perceptual advantages with pitch , 2011, The European journal of neuroscience.

[63]  A. Krishnan,et al.  Binaural Interaction in the Human Frequency-Following Response: Effects of Interaural Intensity Difference , 1998, Audiology and Neurotology.

[64]  A. Izumi,et al.  Japanese monkeys perceive sensory consonance of chords. , 2000, The Journal of the Acoustical Society of America.

[65]  Roger A. Kendall,et al.  Comparative Music Perception and Cognition , 1999 .

[66]  G C Galbraith,et al.  Two-channel brain-stem frequency-following responses to pure tone and missing fundamental stimuli. , 1994, Electroencephalography and clinical neurophysiology.

[67]  Gavin M Bidelman,et al.  Auditory-nerve responses predict pitch attributes related to musical consonance-dissonance for normal and impaired hearing. , 2011, The Journal of the Acoustical Society of America.

[68]  R. Zatorre,et al.  Music, the food of neuroscience? , 2005, Nature.

[69]  Christopher J. Plack,et al.  Subcortical Plasticity Following Perceptual Learning in a Pitch Discrimination Task , 2011, Journal of the Association for Research in Otolaryngology.

[70]  M. Besson,et al.  Different Brain Mechanisms Mediate Sensitivity to Sensory Consonance and Harmonic Context: Evidence from Auditory Event-Related Brain Potentials , 2001, Journal of Cognitive Neuroscience.

[71]  A. Kameoka,et al.  Consonance theory part I: consonance of dyads. , 1969, The Journal of the Acoustical Society of America.

[72]  Christopher J. Plack,et al.  The Frequency Following Response (FFR) May Reflect Pitch-Bearing Information But is Not a Direct Representation of Pitch , 2011, Journal of the Association for Research in Otolaryngology.

[73]  James Tenney,et al.  A history of consonance and dissonance , 1988 .

[74]  J. Bharucha,et al.  Music Perception and Cognition , 2002 .

[75]  Muhammad S A Zilany,et al.  Modeling auditory-nerve responses for high sound pressure levels in the normal and impaired auditory periphery. , 2006, The Journal of the Acoustical Society of America.

[76]  Martin Braun Auditory midbrain laminar structure appears adapted to f 0 extraction: further evidence and implications of the double critical bandwidth , 1999, Hearing Research.

[77]  R. Plomp,et al.  Tonal consonance and critical bandwidth. , 1965, The Journal of the Acoustical Society of America.

[78]  W. Sethares Local consonance and the relationship between timbre and scale , 1993 .

[79]  K. Kaga,et al.  Binaural interaction of a beating frequency-following response. , 1980, Audiology : official organ of the International Society of Audiology.

[80]  C. Krumhansl Music as Cognition. , 1987 .

[81]  Laurel J. Trainor,et al.  Preference for Sensory Consonance in 2- and 4-Month-Old Infants , 2002 .

[82]  L. Trainor Science & Music: The neural roots of music , 2008, Nature.

[83]  David L. McPherson,et al.  Binaural interaction in auditory evoked potentials: Brainstem, middle- and long-latency components , 1993, Hearing Research.

[84]  I. Peretz,et al.  The amusic brain: in tune, out of key, and unaware. , 2009, Brain : a journal of neurology.

[85]  M Steinschneider,et al.  Consonance and dissonance of musical chords: neural correlates in auditory cortex of monkeys and humans. , 2001, Journal of neurophysiology.

[86]  Mieczyslaw Kolinski,et al.  Consonance and Dissonance , 1962 .

[87]  R. G. Crowder,et al.  Tonal fusion of consonant musical intervals: The oomph in Stumpf , 1987, Perception & psychophysics.

[88]  Josh H. McDermott,et al.  Individual Differences Reveal the Basis of Consonance , 2010, Current Biology.

[89]  J. T. Marsh,et al.  Far-field recorded frequency-following responses: evidence for the locus of brainstem sources. , 1975, Electroencephalography and clinical neurophysiology.

[90]  J. M. Troost,et al.  Ascending and Descending Melodic Intervals: Statistical Findings and Their Perceptual Relevance , 1989 .

[91]  Marc Leman,et al.  The Cortical Topography of Tonal Structures Underlying Western Music , 2002, Science.

[92]  Michelle R. Molis,et al.  Perception of dissonance by people with normal hearing and sensorineural hearing loss. , 2005, The Journal of the Acoustical Society of America.

[93]  Alan C. Evans,et al.  Musical Training Shapes Structural Brain Development , 2009, The Journal of Neuroscience.

[94]  A. Kameoka,et al.  Consonance theory part II: consonance of complex tones and its calculation method. , 1969, The Journal of the Acoustical Society of America.

[95]  Claude Alain,et al.  The Influence of Lifelong Musicianship on Neurophysiological Measures of Concurrent Sound Segregation , 2013, Journal of Cognitive Neuroscience.

[96]  Ludovico Minati,et al.  Functional MRI/Event-related potential study of sensory consonance and dissonance in musicians and nonmusicians , 2009, Neuroreport.

[97]  H Pratt,et al.  Sources of frequency following responses (FFR) in man. , 1977, Electroencephalography and clinical neurophysiology.

[98]  M. Besson,et al.  Musical training influences linguistic abilities in 8-year-old children: more evidence for brain plasticity. , 2009, Cerebral cortex.

[99]  L. Collet,et al.  The temporal relationship between speech auditory brainstem responses and the acoustic pattern of the phoneme /ba/ in normal-hearing adults , 2008, Clinical Neurophysiology.

[100]  S. Watanabe,et al.  Discrimination of consonance and dissonance in Java sparrows , 2005, Behavioural Processes.

[101]  Gavin M Bidelman,et al.  Brainstem correlates of behavioral and compositional preferences of musical harmony , 2011, Neuroreport.