Differential Processing of Consonance and Dissonance within the Human Superior Temporal Gyrus

The auditory cortex is well-known to be critical for music perception, including the perception of consonance and dissonance. Studies on the neural correlates of consonance and dissonance perception have largely employed non-invasive electrophysiological and functional imaging techniques in humans as well as neurophysiological recordings in animals, but the fine-grained spatiotemporal dynamics within the human auditory cortex remain unknown. We recorded electrocorticographic (ECoG) signals directly from the lateral surface of either the left or right temporal lobe of eight patients undergoing neurosurgical treatment as they passively listened to highly consonant and highly dissonant musical chords. We assessed ECoG activity in the high gamma (γhigh, 70–150 Hz) frequency range within the superior temporal gyrus (STG) and observed two types of cortical sites of interest in both hemispheres: one type showed no significant difference in γhigh activity between consonant and dissonant chords, and another type showed increased γhigh responses to dissonant chords between 75 and 200 ms post-stimulus onset. Furthermore, a subset of these sites exhibited additional sensitivity towards different types of dissonant chords, and a positive correlation between changes in γhigh power and the degree of stimulus roughness was observed in both hemispheres. We also observed a distinct spatial organization of cortical sites in the right STG, with dissonant-sensitive sites located anterior to non-sensitive sites. In sum, these findings demonstrate differential processing of consonance and dissonance in bilateral STG with the right hemisphere exhibiting robust and spatially organized sensitivity toward dissonance.

[1]  Minna Huotilainen,et al.  Newborn infants' auditory system is sensitive to Western music chord categories , 2013, Front. Psychol..

[2]  Josh H. McDermott,et al.  Individual Differences Reveal the Basis of Consonance , 2010, Current Biology.

[3]  E. F. Chang,et al.  Sub-centimeter language organization in the human temporal lobe , 2011, Brain and Language.

[4]  R. Patterson,et al.  Analyzing Pitch Chroma and Pitch Height in the Human Brain , 2003, Annals of the New York Academy of Sciences.

[5]  Mark A. Chevillet,et al.  Functional Correlates of the Anterolateral Processing Hierarchy in Human Auditory Cortex , 2011, The Journal of Neuroscience.

[6]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.

[7]  R. Plomp,et al.  Tonal consonance and critical bandwidth. , 1965, The Journal of the Acoustical Society of America.

[8]  R. Parncutt Harmony: A Psychoacoustical Approach , 1989 .

[9]  Hermann L. F. Helmholtz,et al.  On the Sensations of Tone as a Physiological Basis for the Theory of Music , 2005 .

[10]  R. Patterson,et al.  The Processing of Temporal Pitch and Melody Information in Auditory Cortex , 2002, Neuron.

[11]  D. Perani,et al.  Functional specializations for music processing in the human newborn brain , 2010, Proceedings of the National Academy of Sciences.

[12]  Otto Muzik,et al.  In vivo animation of auditory-language-induced gamma-oscillations in children with intractable focal epilepsy , 2008, NeuroImage.

[13]  E. Terhardt Psychoacoustic evaluation of musical sounds , 1978, Perception & psychophysics.

[14]  E. Niebur,et al.  Neural Correlates of High-Gamma Oscillations (60–200 Hz) in Macaque Local Field Potentials and Their Potential Implications in Electrocorticography , 2008, The Journal of Neuroscience.

[15]  A. Friederici,et al.  Brain Indices of Music Processing: Nonmusicians are Musical , 2000, Journal of Cognitive Neuroscience.

[16]  Arthur Gretton,et al.  Low-Frequency Local Field Potentials and Spikes in Primary Visual Cortex Convey Independent Visual Information , 2008, The Journal of Neuroscience.

[17]  M. Berger,et al.  High gamma activity in response to deviant auditory stimuli recorded directly from human cortex. , 2005, Journal of neurophysiology.

[18]  G. Curio,et al.  ECoG high gamma activity reveals distinct cortical representations of lyrics passages, harmonic and timbre-related changes in a rock song , 2014, Front. Hum. Neurosci..

[19]  W. Thompson,et al.  Affective evaluation of simultaneous tone combinations in congenital amusia , 2015, Neuropsychologia.

[20]  R. Irizarry,et al.  Electrocorticographic gamma activity during word production in spoken and sign language , 2001, Neurology.

[21]  Andrew J Oxenham,et al.  A Neural Representation of Pitch Salience in Nonprimary Human Auditory Cortex Revealed with Functional Magnetic Resonance Imaging , 2004, The Journal of Neuroscience.

[22]  Josh H. McDermott,et al.  Cortical Pitch Regions in Humans Respond Primarily to Resolved Harmonics and Are Located in Specific Tonotopic Regions of Anterior Auditory Cortex , 2013, The Journal of Neuroscience.

[23]  M. Baulac,et al.  An Intracranial EEG Study of the Neural Dynamics of Musical Valence Processing. , 2015, Cerebral cortex.

[24]  J. Rauschecker,et al.  Hierarchical Organization of the Human Auditory Cortex Revealed by Functional Magnetic Resonance Imaging , 2001, Journal of Cognitive Neuroscience.

[25]  R. Zatorre,et al.  Spectral and temporal processing in human auditory cortex. , 2001, Cerebral cortex.

[26]  Tatsuya Daikoku,et al.  The variation of hemodynamics relative to listening to consonance or dissonance during chord progression , 2012, Neurological research.

[27]  I. Fried,et al.  Coupling Between Neuronal Firing, Field Potentials, and fMRI in Human Auditory Cortex , 2005, Science.

[28]  E. Terhardt Pitch, consonance, and harmony. , 1974, The Journal of the Acoustical Society of America.

[29]  N. Barbaro,et al.  Spatiotemporal Dynamics of Word Processing in the Human Brain , 2007, Front. Neurosci..

[30]  Laurel J. Trainor,et al.  Preference for Sensory Consonance in 2- and 4-Month-Old Infants , 2002 .

[31]  B. Gordon,et al.  Induced electrocorticographic gamma activity during auditory perception. Brazier Award-winning article, 2001. , 2001, Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology.

[32]  E. Schellenberg,et al.  Frequency ratios and the discrimination of pure tone sequences , 1994, Perception & psychophysics.

[33]  Constantine Frithiof Malmberg,et al.  The perception of consonance and dissonance , 1918 .

[34]  M. Earnest,et al.  Cortical deafness , 1977, Neurology.

[35]  Brian N. Pasley,et al.  Reconstructing Speech from Human Auditory Cortex , 2012, PLoS biology.

[36]  D. Purves,et al.  The Statistical Structure of Human Speech Sounds Predicts Musical Universals , 2003, The Journal of Neuroscience.

[37]  S. Kuriki,et al.  Spatiotemporal characteristics of the neural activities processing consonant/dissonant tones in melody , 2005, Experimental Brain Research.

[38]  Gerwin Schalk,et al.  Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening , 2012, NeuroImage.

[39]  Robert J. Zatorre,et al.  Depth electrode recordings show double dissociation between pitch processing in lateral Heschl’s gyrus and sound onset processing in medial Heschl’s gyrus , 2008, Experimental Brain Research.

[40]  I. Peretz,et al.  Brain organization for music processing. , 2005, Annual review of psychology.

[41]  Hans Strasburger,et al.  Applying Psychoacoustics in Composition: "Harmonic" Progressions of "Nonharmonic" Sonorities , 1994 .

[42]  Ludovico Minati,et al.  Functional MRI/Event-related potential study of sensory consonance and dissonance in musicians and nonmusicians , 2009, Neuroreport.

[43]  Hermann L. F. Helmholtz,et al.  On the Sensations of Tone as a Physiological Basis for the Theory of Music: ON THE BEATS OF SIMPLE TONES , 2022 .

[44]  K. James,et al.  Neural correlates of the Pythagorean ratio rules , 2007, Neuroreport.

[45]  W. Newsome,et al.  Local Field Potential in Cortical Area MT: Stimulus Tuning and Behavioral Correlations , 2006, The Journal of Neuroscience.

[46]  I. Peretz,et al.  Cortical Correlates of Acquired Deafness to Dissonance , 2003, Annals of the New York Academy of Sciences.

[47]  I. Peretz,et al.  Cortical deafness to dissonance. , 2001, Brain : a journal of neurology.

[48]  B. Gordon,et al.  Induced electrocorticographic gamma activity during auditory perception , 2001, Clinical Neurophysiology.

[49]  John Broadhouse The Student's Helmholtz. Musical Acoustics; Or, The Phenomena of Sound, as Connected with Music , 1881 .

[50]  Timm Rosburg,et al.  Sensory gating of auditory evoked and induced gamma band activity in intracranial recordings , 2006, NeuroImage.

[51]  Brian N. Pasley,et al.  Transcranial Magnetic Stimulation Elicits Coupled Neural and Hemodynamic Consequences , 2007, Science.

[52]  M. Besson,et al.  Different Brain Mechanisms Mediate Sensitivity to Sensory Consonance and Harmonic Context: Evidence from Auditory Event-Related Brain Potentials , 2001, Journal of Cognitive Neuroscience.

[53]  J. Bharucha,et al.  Music Perception and Cognition Following Bilateral Lesions of Auditory Cortex , 1990, Journal of Cognitive Neuroscience.

[54]  I. Peretz,et al.  Universal Recognition of Three Basic Emotions in Music , 2009, Current Biology.

[55]  S. S. Stevens,et al.  Critical Band Width in Loudness Summation , 1957 .

[56]  R. Ilmoniemi,et al.  Functional Specialization of the Human Auditory Cortex in Processing Phonetic and Musical Sounds: A Magnetoencephalographic (MEG) Study , 1999, NeuroImage.

[57]  M Steinschneider,et al.  Consonance and dissonance of musical chords: neural correlates in auditory cortex of monkeys and humans. , 2001, Journal of neurophysiology.

[58]  John MacCallum,et al.  Real-Time Analysis of sensory Dissonance , 2008, ICMC.

[59]  Michael H Kohrman,et al.  ECoG gamma activity during a language task: differentiating expressive and receptive speech areas. , 2008, Brain : a journal of neurology.

[60]  E. Terhardt On the perception of periodic sound fluctuations (roughness) , 1974 .

[61]  Martha Guernsey,et al.  The Role of Consonance and Dissonance in Music , 1928 .

[62]  Katrin Krumbholz,et al.  Evidence for Pitch Chroma Mapping in Human Auditory Cortex , 2012, Cerebral cortex.

[63]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .