Syntax in Action Has Priority over Movement Selection in Piano Playing: An ERP Study

Complex human behavior is hierarchically organized. Whether or not syntax plays a role in this organization is currently under debate. The present ERP study uses piano performance to isolate syntactic operations in action planning and to demonstrate their priority over nonsyntactic levels of movement selection. Expert pianists were asked to execute chord progressions on a mute keyboard by copying the posture of a performing model hand shown in sequences of photos. We manipulated the final chord of each sequence in terms of Syntax (congruent/incongruent keys) and Manner (conventional/unconventional fingering), as well as the strength of its predictability by varying the length of the Context (five-chord/two-chord progressions). The production of syntactically incongruent compared to congruent chords showed a response delay that was larger in the long compared to the short context. This behavioral effect was accompanied by a centroparietal negativity in the long but not in the short context, suggesting that a syntax-based motor plan was prepared ahead. Conversely, the execution of the unconventional manner was not delayed as a function of Context and elicited an opposite electrophysiological pattern (a posterior positivity). The current data support the hypothesis that motor plans operate at the level of musical syntax and are incrementally translated to lower levels of movement selection.

[1]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[2]  L. H. Shaffer,et al.  Performances of Chopin, Bach, and Bartok: Studies in motor programming , 1981, Cognitive Psychology.

[3]  Andrea Moro,et al.  On the similarity between syntax and actions , 2014, Trends in Cognitive Sciences.

[4]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[5]  D A Rosenbaum,et al.  Hierarchical control of rapid movement sequences. , 1983, Journal of experimental psychology. Human perception and performance.

[6]  G. Novembre,et al.  Syntax in a pianist's hand: ERP signatures of “embodied” syntax processing in music , 2013, Cortex.

[7]  Aniruddh D. Patel,et al.  Structural integration in language and music: Evidence for a shared system , 2009, Memory & cognition.

[8]  Yiannis Aloimonos,et al.  The minimalist grammar of action , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[9]  Luciano Fadiga,et al.  Role of Broca's area in encoding sequential human actions: a virtual lesion study , 2009, Neuroreport.

[10]  D. V. von Cramon,et al.  Motor-learning-related changes in piano players and non-musicians revealed by functional magnetic-resonance signals , 1999, Experimental Brain Research.

[11]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[12]  Martin Rohrmeier,et al.  Towards a generative syntax of tonal harmony , 2011 .

[13]  Peter E. Keller What movement force reveals about cognitive processes in music performance , 2012 .

[14]  H. Bekkering,et al.  Imitation of gestures in children is goal-directed. , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[15]  A. Friederici The brain basis of language processing: from structure to function. , 2011, Physiological reviews.

[16]  Aniruddh D. Patel,et al.  Making psycholinguistics musical: Self-paced reading time evidence for shared processing of linguistic and musical syntax , 2009, Psychonomic bulletin & review.

[17]  Jonah Katz,et al.  The Identity Thesis for Language and Music , 2011 .

[18]  Peter E. Keller,et al.  A grammar of action generates predictions in skilled musicians , 2011, Consciousness and Cognition.

[19]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[20]  Barbara Tillmann,et al.  Music and Language Perception: Expectations, Structural Integration, and Cognitive Sequencing , 2012, Top. Cogn. Sci..

[21]  Ewald Moser,et al.  The preparation and readiness for voluntary movement: a high-field event-related fMRI study of the Bereitschafts-BOLD response , 2003, NeuroImage.

[22]  W. Walter,et al.  Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain , 1964, Nature.

[23]  Caroline Palmer,et al.  Incremental planning in sequence production. , 2003, Psychological review.

[24]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[25]  T. Gunter,et al.  Let's face the music: a behavioral and electrophysiological exploration of score reading. , 2003, Psychophysiology.

[26]  Miguel Fernandez-del-Olmo,et al.  Movement observation specifies motor programs activated by the action observed objective , 2011, Neuroscience Letters.

[27]  Rosalee K. Meyer,et al.  Conceptual and Motor Learning in Music Performance , 2000, Psychological science.

[28]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[29]  Iris van Rooij,et al.  Hierarchies in Action and Motor Control , 2012, Journal of Cognitive Neuroscience.

[30]  Stefan Koelsch,et al.  Interaction between Syntax Processing in Language and in Music: An ERP Study , 2005, Journal of Cognitive Neuroscience.

[31]  L. Craighero,et al.  Broca's Area in Language, Action, and Music , 2009, Annals of the New York Academy of Sciences.

[32]  J. Mazziotta,et al.  Modulation of motor and premotor activity during imitation of target-directed actions. , 2002, Cerebral cortex.

[33]  R. Barry,et al.  Effects of pre-stimulus processing on subsequent events in a warned Go/NoGo paradigm: response preparation, execution and inhibition. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  P. Haggard Human volition: towards a neuroscience of will , 2008, Nature Reviews Neuroscience.

[35]  P. Perruchet,et al.  Implicit learning and statistical learning: one phenomenon, two approaches , 2006, Trends in Cognitive Sciences.

[36]  K. Lashley The problem of serial order in behavior , 1951 .

[37]  R. Schmidt A schema theory of discrete motor skill learning. , 1975 .

[38]  J. Summers,et al.  Current status of the motor program: revisited. , 2009, Human movement science.

[39]  Carlos M. Gómez,et al.  P3a and P3b components associated to the neurocognitive evaluation of invalidly cued targets , 2008, Neuroscience Letters.

[40]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[41]  A. Friederici,et al.  Brain Indices of Music Processing: Nonmusicians are Musical , 2000, Journal of Cognitive Neuroscience.

[42]  L. H. Shaffer,et al.  Performances of Chopin, Bach, and Bartok: Studies in motor programming , 1984, Cognitive Psychology.

[43]  I. Jentzsch,et al.  Spatiotemporal source localisation reveals involvement of medial premotor areas in movement reprogramming , 2002, Experimental Brain Research.

[44]  S. Keele,et al.  The Structure of Motor Programs , 1976 .

[45]  S. Koelsch Music-syntactic processing and auditory memory: similarities and differences between ERAN and MMN. , 2009, Psychophysiology.

[46]  A. Meltzoff,et al.  Does the End Justify the Means? A PET Exploration of the Mechanisms Involved in Human Imitation , 2002, NeuroImage.

[47]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[48]  Yiannis Aloimonos,et al.  The syntax of human actions and interactions , 2012, Journal of Neurolinguistics.

[49]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[50]  Richard Parncutt,et al.  Talking Fingers: An Interview Study of Pianists' Views on Fingering , 1997 .

[51]  Scott T. Grafton Embodied Cognition and the Simulation of Action to Understand Others , 2009, Annals of the New York Academy of Sciences.

[52]  H. Bekkering,et al.  Action generation and action perception in imitation: an instance of the ideomotor principle. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[53]  Luigi Cattaneo,et al.  Representation of Goal and Movements without Overt Motor Behavior in the Human Motor Cortex: A Transcranial Magnetic Stimulation Study , 2009, The Journal of Neuroscience.

[54]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[55]  S. Koelsch Neural substrates of processing syntax and semantics in music , 2005, Current Opinion in Neurobiology.

[56]  Andrea Moro,et al.  Response to Pulvermüller: the syntax of actions and other metaphors , 2014, Trends in Cognitive Sciences.

[57]  W. Fitch,et al.  Annals of the New York Academy of Sciences Hierarchical Processing in Music, Language, and Action: Lashley Revisited , 2022 .

[58]  J. Bortz,et al.  Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler , 2006 .

[59]  Richard Parncutt,et al.  Determinants of finger choice in piano sight-reading. , 1998 .

[60]  Scott T. Grafton,et al.  Evidence for a distributed hierarchy of action representation in the brain. , 2007, Human movement science.

[61]  Richard Parncutt,et al.  Piano Technique and Fingering in the Eighteenth and Nineteenth Centuries: Bringing a Forgotten Method Back to Life , 1996, British Journal of Music Education.

[62]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[63]  Ricarda I. Schubotz,et al.  Prediction, Cognition and the Brain , 2009, Front. Hum. Neurosci..

[64]  Ivan Rektor Parallel Information Processing in Motor Systems: Intracerebral Recordings of Readiness Potential and CNV in Human Subjects , 2000, Neural plasticity.

[65]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[66]  Wolfgang Prinz,et al.  When hearing turns into playing: Movement induction by auditory stimuli in pianists , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[67]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[68]  A. Friederici,et al.  Are left fronto-temporal brain areas a prerequisite for normal music-syntactic processing? , 2011, Cortex.

[69]  Stefan Koelsch,et al.  Co-localizing linguistic and musical syntax with intracranial EEG , 2013, NeuroImage.

[70]  F. Pulvermüller The syntax of action , 2014, Trends in Cognitive Sciences.

[71]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[72]  Emanuel Donchin,et al.  The P300 component of the event-related brain potential as an index of information processing , 1982, Biological Psychology.

[73]  L. Jäncke,et al.  Extensive training of elementary finger tapping movements changes the pattern of motor cortex excitability , 2006, Experimental Brain Research.

[74]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[75]  S. Koelsch,et al.  Predictive information processing in music cognition. A critical review. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[76]  Alice C. Roy,et al.  Encoding of human action in Broca's area. , 2009, Brain : a journal of neurology.