Music and Language Perception: Expectations, Structural Integration, and Cognitive Sequencing

Music can be described as sequences of events that are structured in pitch and time. Studying music processing provides insight into how complex event sequences are learned, perceived, and represented by the brain. Given the temporal nature of sound, expectations, structural integration, and cognitive sequencing are central in music perception (i.e., which sounds are most likely to come next and at what moment should they occur?). This paper focuses on similarities in music and language cognition research, showing that music cognition research provides insight into the understanding of not only music processing but also language processing and the processing of other structured stimuli. The hypothesis of shared resources between music and language processing and of domain-general dynamic attention has motivated the development of research to test music as a means to stimulate sensory, cognitive, and motor processes.

[1]  Barbara Tillmann,et al.  The Influence of Task-Irrelevant Music on Language Processing: Syntactic and Semantic Structures , 2011, Front. Psychology.

[2]  Jeffrey L. Birk,et al.  The costs and benefits of tonal centers for chord processing. , 2003, Journal of experimental psychology. Human perception and performance.

[3]  J. H. Neely Semantic priming effects in visual word recognition: A selective review of current findings and theories. , 1991 .

[4]  Thomas R. Barrick,et al.  Voxel-Based Morphometry Reveals Increased Gray Matter Density in Broca's Area in Male Symphony Orchestra Musicians , 2002, NeuroImage.

[5]  Ray Jackendoff,et al.  Parallels and Nonparallels between Language and Music , 2009 .

[6]  Fred Lerdahl,et al.  Tonal Pitch Space , 2001 .

[7]  E. Kaan,et al.  The brain circuitry of syntactic comprehension , 2002, Trends in Cognitive Sciences.

[8]  Jeffrey L. Birk,et al.  Tonal centers and expectancy: facilitation or inhibition of chords at the top of the harmonic hierarchy? , 2008, Journal of experimental psychology. Human perception and performance.

[9]  Stefan Koelsch,et al.  Musical training modulates the development of syntax processing in children , 2009, NeuroImage.

[10]  Axel Cleeremans,et al.  Implicit learning out of the lab: the case of orthographic regularities. , 2001, Journal of experimental psychology. General.

[11]  V. Bruce,et al.  Identity priming in the recognition of familiar faces. , 1985, British journal of psychology.

[12]  J. Gabrieli,et al.  Effects of Semantic and Associative Relatedness on Automatic Priming , 1998 .

[13]  E. Schellenberg,et al.  Arousal, Mood, and The Mozart Effect , 2001, Psychological science.

[14]  Barbara Tillmann,et al.  Implicit learning of tonality: A self-organizing approach , 2000 .

[15]  B. Tillmann,et al.  Tonal Priming Beyond Tonics , 2009 .

[16]  Sylvie Belleville,et al.  Dissociations Entre Musique et Langage Apres Atteinte Cerebrale: Un Nouveau Cas D'amusie Sans Aphasie , 1997 .

[17]  Barbara Tillmann,et al.  Effect of harmonic relatedness on the detection of temporal asynchronies , 2002, Perception & psychophysics.

[18]  Mark A. Schmuckler,et al.  The performance of global expectations. , 1990 .

[19]  E. Schellenberg,et al.  Children's implicit knowledge of harmony in Western music. , 2005, Developmental science.

[20]  Robert F. Port,et al.  Meter and speech , 2003, J. Phonetics.

[21]  M. Cheung,et al.  Music training improves verbal memory , 1998, Nature.

[22]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[23]  Sonja A. Kotz,et al.  Event-related Brain Potentials Suggest a Late Interaction of Meter and Syntax in the P600 , 2009, Journal of Cognitive Neuroscience.

[24]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[25]  D. Schön,et al.  Musician Children Detect Pitch Violations in Both Music and Language Better than Nonmusician Children: Behavioral and Electrophysiological Approaches , 2006 .

[26]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[27]  Stefan Koelsch,et al.  Shared neural resources between music and language indicate semantic processing of musical tension-resolution patterns. , 2008, Cerebral cortex.

[28]  C. Krumhansl Part I: Ethology/Evolution—Do Animals Have Music or Something Else?: Introduction , 2005 .

[29]  Sonja A. Kotz,et al.  Entrainment of syntactic processing? ERP-responses to predictable time intervals during syntactic reanalysis , 2008, Brain Research.

[30]  Michael A. Arbib,et al.  The syntactic motor system , 2005 .

[31]  Mark Steedman,et al.  A Generative Grammar for Jazz Chord Sequences , 1984 .

[32]  E. Schellenberg,et al.  Music Lessons Enhance IQ , 2004, Psychological science.

[33]  Stefan Koelsch,et al.  Children with Specific Language Impairment Also Show Impairment of Music-syntactic Processing , 2008, Journal of Cognitive Neuroscience.

[34]  Scott T. Grafton,et al.  Swinging in the brain: shared neural substrates for behaviors related to sequencing and music , 2003, Nature Neuroscience.

[35]  Peter Ford Dominey,et al.  Human brain potentials reveal similar processing of non-linguistic abstract structure and linguistic syntactic structure , 2002, Neurophysiologie Clinique/Clinical Neurophysiology.

[36]  Mireille Besson,et al.  Behavioural and event-related potentials evidence for pitch discrimination deficits in dyslexic children: Improvement after intensive phonic intervention , 2007, Neuropsychologia.

[37]  Norman H Freeman,et al.  Regulation of division of labour between cognitive systems controlling action , 2000, Cognition.

[38]  B. Tillmann Implicit Investigations of Tonal Knowledge in Nonmusician Listeners , 2005, Annals of the New York Academy of Sciences.

[39]  Angela D. Friederici,et al.  On the role of phonological short-term memory in sentence processing: ERP single case evidence on modality-specific effects , 2005, Cognitive neuropsychology.

[40]  R J Wise,et al.  Separate neural subsystems within 'Wernicke's area'. , 2001, Brain : a journal of neurology.

[41]  Sophie K. Scott,et al.  Identifying separate neural sub-systems within 'Wernicke's area' , 2001 .

[42]  Terry Winograd,et al.  Linguistics and the computer analysis of tonal harmony , 1968 .

[43]  Aniruddh D. Patel,et al.  Musical syntactic processing in agrammatic Broca's aphasia , 2008 .

[44]  Barbara Tillmann,et al.  The influence of musical relatedness on timbre discrimination , 2006 .

[45]  M. Jones,et al.  Temporal Aspects of Stimulus-Driven Attending in Dynamic Arrays , 2002, Psychological science.

[46]  B. Tillmann,et al.  Sensory versus cognitive components in harmonic priming. , 2003, Journal of experimental psychology. Human perception and performance.

[47]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[48]  Sonja A. Kotz,et al.  Modulation of the Lexical–Semantic Network by Auditory Semantic Priming: An Event-Related Functional MRI Study , 2002, NeuroImage.

[49]  M. Tettamanti,et al.  Broca's Area: a Supramodal Hierarchical Processor? , 2006, Cortex.

[50]  Barbara Tillmann,et al.  A module for syntactic processing in music? , 2006, Trends in Cognitive Sciences.

[51]  M. I. Núñez-Peña,et al.  P600 related to rule violation in an arithmetic task. , 2004, Brain research. Cognitive brain research.

[52]  Peter M. Todd,et al.  Modeling the Perception of Tonal Structure with Neural Nets , 1989 .

[53]  A. Friederici,et al.  Differentiating ERAN and MMN: An ERP study , 2001, Neuroreport.

[54]  Hugo Quené,et al.  Effects of Timing Regularity and Metrical Expectancy on Spoken-Word Perception , 2005, Phonetica.

[55]  Heinrich Schenker,et al.  Neue musikalische Theorien und Phantasien , 1906 .

[56]  I. Peretz,et al.  Harmonic priming in an amusic patient: The power of implicit tasks , 2007, Cognitive neuropsychology.

[57]  R. Jackendoff Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[58]  J. Bharucha,et al.  Reaction time and musical expectancy: priming of chords. , 1986, Journal of experimental psychology. Human perception and performance.

[59]  Mark Steedman,et al.  Plans, Affordances, And Combinatory Grammar , 2002 .

[60]  M. Besson,et al.  Musical training influences linguistic abilities in 8-year-old children: more evidence for brain plasticity. , 2009, Cerebral cortex.

[61]  M. R. Jones,et al.  Time, our lost dimension: toward a new theory of perception, attention, and memory. , 1976, Psychological review.

[62]  M. Paule,et al.  Repeated acquisition and the assessment of centrally acting compounds. , 1996, Brain research. Cognitive brain research.

[63]  J. Coull fMRI studies of temporal attention: allocating attention within, or towards, time. , 2004, Brain research. Cognitive brain research.

[64]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[65]  Keith E. Stanovich,et al.  Source of Inhibition in Experiments on the Effect of Sentence Context on Word Recognition. , 1982 .

[66]  Alice C. Roy,et al.  Encoding of human action in Broca's area. , 2009, Brain : a journal of neurology.

[67]  Stefan Koelsch,et al.  Bach Speaks: A Cortical “Language-Network” Serves the Processing of Music , 2002, NeuroImage.

[68]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[69]  T. McNamara Semantic Priming: Perspectives from Memory and Word Recognition , 2005 .

[70]  B. Tillmann,et al.  Repetition priming: Is music special? , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[71]  Mayumi Adachi,et al.  Expectancy in melody: tests of children and adults. , 2002, Journal of experimental psychology. General.

[72]  Stefan Koelsch,et al.  Cognitive priming in sung and instrumental music: Activation of inferior frontal cortex , 2006, NeuroImage.

[73]  E. Bigand,et al.  Global context effects on musical expectancy , 1997, Perception & psychophysics.

[74]  Z. Harris,et al.  Foundations of language , 1941 .

[75]  A. Friederici,et al.  Time Perception and Motor Timing: A Common Cortical and Subcortical Basis Revealed by fMRI , 2000, NeuroImage.

[76]  R. Gómez,et al.  Infant artificial language learning and language acquisition , 2000, Trends in Cognitive Sciences.

[77]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[78]  C. Fiebach,et al.  The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. , 2003, Cerebral cortex.

[79]  G. Schlaug,et al.  Effects of Music Training on the Child's Brain and Cognitive Development , 2005, Annals of the New York Academy of Sciences.

[80]  B. Tillmann,et al.  Effect of global structure and temporal organization on chord processing , 1999 .

[81]  B. Tillmann,et al.  Priming in melody perception: tracking down the strength of cognitive expectations. , 2010, Journal of experimental psychology. Human perception and performance.

[82]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[83]  M. Besson,et al.  AN EVENT-RELATED POTENTIAL (ERP) STUDY OF MUSICAL EXPECTANCY : COMPARISON OF MUSICIANS WITH NONMUSICIANS , 1995 .

[84]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[85]  Barbara Tillmann,et al.  Influence of tonal and temporal expectations on chord processing and on completion judgments of chord sequences , 2006, Psychological research.

[86]  Stefan Koelsch,et al.  Interaction between Syntax Processing in Language and in Music: An ERP Study , 2005, Journal of Cognitive Neuroscience.

[87]  S. Bookheimer,et al.  Dissociating Neural Mechanisms of Temporal Sequencing and Processing Phonemes , 2003, Neuron.

[88]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[89]  James C. Carlsen Some factors which influence melodic expectancy , 1981 .

[90]  M. Thaut,et al.  Rhythmic auditory-motor facilitation of gait patterns in patients with Parkinson's disease. , 1997, Journal of neurology, neurosurgery, and psychiatry.

[91]  Martin Rohrmeier,et al.  Towards a generative syntax of tonal harmony , 2011 .

[92]  Justyna Humięcka-Jakubowska,et al.  Sweet Anticipation : Music and , 2006 .

[93]  C. Krumhansl Cognitive Foundations of Musical Pitch , 1990 .

[94]  A. Friederici,et al.  Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. , 1993, Brain research. Cognitive brain research.

[95]  Weijia Ni,et al.  Sentence complexity and input modality effects in sentence comprehension: an fMRI study , 2004, NeuroImage.

[96]  Peter Ford Dominey,et al.  COGNITIVE NEUROSCIENCE: Dissociable ERP profiles for processing rules vs instances in a cognitive sequencing task , 2000 .

[97]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[98]  G. Schlaug The Brain of Musicians , 2001, Annals of the New York Academy of Sciences.

[99]  Morten H. Christiansen,et al.  Impaired artificial grammar learning in agrammatism , 2010, Cognition.

[100]  N. Pearlmutter,et al.  Constraints on sentence comprehension , 1998, Trends in Cognitive Sciences.

[101]  I. Peretz,et al.  Music listening enhances cognitive recovery and mood after middle cerebral artery stroke. , 2008, Brain : a journal of neurology.

[102]  Mireille Besson,et al.  Musicians Detect Pitch Violation in a Foreign Language Better Than Nonmusicians: Behavioral and Electrophysiological Evidence , 2007, Journal of Cognitive Neuroscience.

[103]  Alan C. Evans,et al.  Musical Training Shapes Structural Brain Development , 2009, The Journal of Neuroscience.

[104]  P. Janata,et al.  Activation of the inferior frontal cortex in musical priming. , 2003, Annals of the New York Academy of Sciences.

[105]  L. R. Smith,et al.  Music training and mathematics achievement. , 1999, Adolescence.

[106]  Karl Magnus Petersson,et al.  Artificial syntactic violations activate Broca's region , 2004 .

[107]  B Tillmann,et al.  Global context effect in normal and scrambled musical sequences. , 2001, Journal of experimental psychology. Human perception and performance.

[108]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[109]  Jamshed J. Bharucha,et al.  Event hierarchies, tonal hierarchies, and assimilation: A reply to Deutsch and Dowling. , 1984 .

[110]  J. Bharucha,et al.  Implicit knowledge versus psychoacoustic similarity in priming of chords , 1998 .

[111]  R. Peereman,et al.  Musical structure modulates semantic priming in vocal music , 2005, Cognition.

[112]  J. Fuster The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[113]  A. Friederici The Time Course of Syntactic Activation During Language Processing: A Model Based on Neuropsychological and Neurophysiological Data , 1995, Brain and Language.

[114]  Gary L. Dannenbring,et al.  Semantic priming and the word repetition effect in a lexical decision task. , 1982 .

[115]  Aniruddh D. Patel,et al.  Making psycholinguistics musical: Self-paced reading time evidence for shared processing of linguistic and musical syntax , 2009, Psychonomic bulletin & review.

[116]  K. Overy Dyslexia and Music , 2003, Annals of the New York Academy of Sciences.

[117]  Christopher M. Conway,et al.  The Importance of Sound for Cognitive Sequencing Abilities , 2009, Current directions in psychological science.

[118]  D. Sammler,et al.  Untangling syntactic and sensory processing: an ERP study of music perception. , 2007, Psychophysiology.

[119]  A New Approach to Rhythm Cueing of Cognitive Functions , 2009, Annals of the New York Academy of Sciences.

[120]  Michael H. Thaut,et al.  Music Listening and Music Making in the Treatment of Neurological Disorders and Impairments , 2010 .

[121]  J. Bharucha Music Cognition and Perceptual Facilitation: A Connectionist Framework , 1987 .

[122]  M. Thaut,et al.  Neural Basis of Rhythmic Timing Networks in the Human Brain , 2003, Annals of the New York Academy of Sciences.

[123]  B. Tillmann,et al.  Tonal expectations influence pitch perception , 2008, Perception & psychophysics.

[124]  M A Schmuckler,et al.  Harmonic and rhythmic influences on musical expectancy , 1994, Perception & psychophysics.

[125]  A. Cutler Segmentation problems, rhythmic solutions * , 1994 .

[126]  J. Jonides,et al.  On the Cost and Benefit of Cost and Benefit , 1984 .

[127]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[128]  B Tillmann,et al.  Shared structural and temporal integration resources for music and arithmetic processing. , 2012, Acta psychologica.

[129]  Morten H. Christiansen,et al.  Neural Responses to Structural Incongruencies in Language and Statistical Learning Point to Similar Underlying Mechanisms , 2007 .

[130]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[131]  B Tillmann,et al.  The effect of harmonic context on phoneme monitoring in vocal music , 2001, Cognition.

[132]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.