A conceptual review on action-perception coupling in the musicians’ brain: what is it good for?

Experience with a sensorimotor task, such as practicing a piano piece, leads to strong coupling of sensory (visual or auditory) and motor cortices. Here we review behavioral and neurophysiological (M/EEG, TMS and fMRI) research exploring this topic using the brain of musicians as a model system. Our review focuses on a recent body of evidence suggesting that this form of coupling might have (at least) two cognitive functions. First, it leads to the generation of equivalent predictions (concerning both when and what event is more likely to occur) during both perception and production of music. Second, it underpins the common coding of perception and action that supports the integration of the motor output of multiple musicians’ in the context of joint musical tasks. Essentially, training-based coupling of perception and action might scaffold the human ability to represent complex (structured) actions and to entrain multiple agents—via reciprocal prediction and adaptation—in the pursuit of shared goals.

[1]  María Herrojo Ruiz,et al.  EEG oscillatory patterns are associated with error prediction during music performance and are altered in musician's dystonia , 2011, NeuroImage.

[2]  M. Bangert,et al.  Mapping perception to action in piano practice: a longitudinal DC-EEG study , 2003, BMC Neuroscience.

[3]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  Kate E. Watkins,et al.  Learning to play a melody: An fMRI study examining the formation of auditory-motor associations , 2012, NeuroImage.

[5]  S. Rossi,et al.  Frequency-Dependent Tuning of the Human Motor System Induced by Transcranial Oscillatory Potentials , 2011, The Journal of Neuroscience.

[6]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[7]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[8]  R. Schubotz Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[9]  S. Koelsch,et al.  Effects of musical expertise on the early right anterior negativity: an event-related brain potential study. , 2002, Psychophysiology.

[10]  Peter Erhard,et al.  Transmodal Sensorimotor Networks during Action Observation in Professional Pianists , 2005, Journal of Cognitive Neuroscience.

[11]  Istvan Molnar-Szakacs,et al.  Being Together in Time: Musical Experience and the Mirror Neuron System , 2009 .

[12]  Walter A. Siebel,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.12 December 2005 Towards , 2022 .

[13]  H. Spencer The Principles of Psychology - Vol. I , 2016 .

[14]  María Herrojo Ruiz,et al.  Detecting wrong notes in advance: neuronal correlates of error monitoring in pianists. , 2009, Cerebral cortex.

[15]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[16]  Derek Hoiem,et al.  Action Recognition , 2014, Computer Vision, A Reference Guide.

[17]  Caroline Palmer,et al.  Incremental planning in sequence production. , 2003, Psychological review.

[18]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[19]  A. Wing,et al.  Optimal feedback correction in string quartet synchronization , 2014, Journal of The Royal Society Interface.

[20]  W. Prinz A common-coding approach to perception and action , 1990 .

[21]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[22]  Hans-Jochen Heinze,et al.  Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction , 2006, NeuroImage.

[23]  H. Bekkering,et al.  The mirror neuron system is more active during complementary compared with imitative action , 2007, Nature Neuroscience.

[24]  Caroline Palmer,et al.  Temporal coordination and adaptation to rate change in music performance. , 2011, Journal of experimental psychology. Human perception and performance.

[25]  A. Friederici,et al.  Brain Indices of Music Processing: Nonmusicians are Musical , 2000, Journal of Cognitive Neuroscience.

[26]  Peter E. Keller What movement force reveals about cognitive processes in music performance , 2012 .

[27]  Giacomo Novembre,et al.  Distinguishing self and other in joint action. Evidence from a musical paradigm. , 2012, Cerebral cortex.

[28]  Wolfgang Prinz,et al.  When hearing turns into playing: Movement induction by auditory stimuli in pianists , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[29]  Hermann Lotze Medicinische Psychologie, oder, Physiologie der Seele , 2006 .

[30]  B. Ross,et al.  Evidence for training-induced crossmodal reorganization of cortical functions in trumpet players , 2003, Neuroreport.

[31]  V. Gallese Bodily selves in relation: embodied simulation as second-person perspective on intersubjectivity , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[32]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[33]  B. Repp,et al.  Sensorimotor synchronization: A review of recent research (2006–2012) , 2013, Psychonomic Bulletin & Review.

[34]  E. Saltzman,et al.  Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired Actions , 2007, The Journal of Neuroscience.

[35]  Mark H. Davis Measuring individual differences in empathy: Evidence for a multidimensional approach. , 1983 .

[36]  L. Fadiga,et al.  Sensorimotor communication in professional quartets , 2014, Neuropsychologia.

[37]  Istvan Molnar-Szakacs,et al.  Music and mirror neurons: from motion to 'e'motion. , 2006, Social cognitive and affective neuroscience.

[38]  Peter E. Keller,et al.  Exogenous and endogenous response priming with auditory stimuli , 2006 .

[39]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[40]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[41]  F. Perrin,et al.  Sensorimotor Learning Enhances Expectations During Auditory Perception. , 2015, Cerebral cortex.

[42]  Robert J. Zatorre,et al.  Repetition Suppression in Auditory–Motor Regions to Pitch and Temporal Structure in Music , 2013, Journal of Cognitive Neuroscience.

[43]  K. Kiehl,et al.  Error processing and the rostral anterior cingulate: an event-related fMRI study. , 2000, Psychophysiology.

[44]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[45]  C. Bellebaum,et al.  Your Error’s Got me Feeling – How Empathy Relates to the Electrophysiological Correlates of Performance Monitoring , 2012, Front. Hum. Neurosci..

[46]  Jens Haueisen,et al.  Involuntary Motor Activity in Pianists Evoked by Music Perception , 2001, Journal of Cognitive Neuroscience.

[47]  Uta Noppeney,et al.  Long-term music training tunes how the brain temporally binds signals from multiple senses , 2011, Proceedings of the National Academy of Sciences.

[48]  C. Palmer,et al.  Synchronization of Timing and Motion 435 , 2022 .

[49]  R. Schmidt A schema theory of discrete motor skill learning. , 1975 .

[50]  W. Prinz Perception and Action Planning , 1997 .

[51]  Peter E Keller,et al.  Mental imagery in music performance: underlying mechanisms and potential benefits , 2012, Annals of the New York Academy of Sciences.

[52]  I. Cross,et al.  Long-term musical group interaction has a positive influence on empathy in children , 2013 .

[53]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[54]  Norihiro Sadato,et al.  Learned audio-visual cross-modal associations in observed piano playing activate the left planum temporale. An fMRI study. , 2004, Brain research. Cognitive brain research.

[55]  Claudio Del Percio,et al.  Brains “in concert”: Frontal oscillatory alpha rhythms and empathy in professional musicians , 2012, NeuroImage.

[56]  E Altenmüller,et al.  Cross‐modal plasticity of the motor cortex while listening to a rehearsed musical piece , 2006, The European journal of neuroscience.

[57]  Sibylle C. Herholz,et al.  Audio-Tactile Integration and the Influence of Musical Training , 2014, PloS one.

[58]  Caroline Palmer,et al.  Effects of hearing the past, present, or future during music performance , 2006, Perception & psychophysics.

[59]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[60]  Janeen D. Loehr,et al.  Monitoring Individual and Joint Action Outcomes in Duet Music Performance , 2013, Journal of Cognitive Neuroscience.

[61]  Peter E. Keller,et al.  Joint action in music performance , 2008 .

[62]  Peter E. Keller,et al.  The Perception of Musical Spontaneity in Improvised and Imitated Jazz Performances , 2011, Front. Psychology.

[63]  P. Keller,et al.  Searching for Roots of Entrainment and Joint Action in Early Musical Interactions , 2012, Front. Hum. Neurosci..

[64]  Stefan Koelsch,et al.  Nobody Is Perfect: ERP Effects Prior to Performance Errors in Musicians Indicate Fast Monitoring Processes , 2009, PloS one.

[65]  K. Lashley The problem of serial order in behavior , 1951 .

[66]  Christian Keysers,et al.  Somatosensation in social perception , 2010, Nature Reviews Neuroscience.

[67]  L. Craighero,et al.  Broca's Area in Language, Action, and Music , 2009, Annals of the New York Academy of Sciences.

[68]  Peter E Keller,et al.  The planning and execution of short auditory sequences , 2006, Psychonomic bulletin & review.

[69]  J. Witt,et al.  Listening to music primes space: pianists, but not novices, simulate heard actions , 2015, Psychological research.

[70]  Jessica A. Grahn,et al.  Feeling the Beat: Premotor and Striatal Interactions in Musicians and Nonmusicians during Beat Perception , 2009, The Journal of Neuroscience.

[71]  Robert J. Zatorre,et al.  Interactions between auditory and dorsal premotor cortex during synchronization to musical rhythms , 2006, NeuroImage.

[72]  Giacomo Novembre,et al.  Motor simulation and the coordination of self and other in real-time joint action. , 2014, Social cognitive and affective neuroscience.

[73]  P. Keller,et al.  Knowing too little or too much: the effects of familiarity with a co-performer's part on interpersonal coordination in musical ensembles , 2013, Front. Psychol..

[74]  Karl J. Friston,et al.  The mirror-neuron system: a Bayesian perspective. , 2007, Neuroreport.

[75]  W. Prinz,et al.  The Ideomotor approach to action control: Implications for skilled performance , 2004 .

[76]  Stefan Koelsch,et al.  Processing Expectancy Violations during Music Performance and Perception: An ERP Study , 2010, Journal of Cognitive Neuroscience.

[77]  Salvatore Maria Aglioti,et al.  Somatotopic mapping of piano fingering errors in sensorimotor experts: TMS studies in pianists and visually trained musically naives. , 2014, Cerebral cortex.

[78]  A. Greenwald,et al.  Sensory feedback mechanisms in performance control: with special reference to the ideo-motor mechanism. , 1970, Psychological review.

[79]  Robert Zivadinov,et al.  Brain responses to altered auditory feedback during musical keyboard production: An fMRI study , 2014, Brain Research.

[80]  M. Raab,et al.  Empathy in sports, exercise, and the performing arts , 2014 .

[81]  Maurizio Mancini,et al.  The movements made by performers in a skilled quartet: a distinctive pattern, and the function that it serves , 2013, Front. Psychol..

[82]  Instrument specificity in experienced musicians , 2007, Quarterly journal of experimental psychology.

[83]  Michael J. Hove,et al.  Rhythm in joint action: psychological and neurophysiological mechanisms for real-time interpersonal coordination , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[84]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[85]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[86]  Aniruddh D. Patel,et al.  The evolutionary neuroscience of musical beat perception: the Action Simulation for Auditory Prediction (ASAP) hypothesis , 2013, Front. Syst. Neurosci..

[87]  G. Novembre,et al.  Syntax in a pianist's hand: ERP signatures of “embodied” syntax processing in music , 2013, Cortex.

[88]  J. Morais,et al.  Spatial associations for musical stimuli: a piano in the head? , 2007, Journal of experimental psychology. Human perception and performance.

[89]  P. Keller,et al.  Neural correlates of auditory temporal predictions during sensorimotor synchronization , 2011, Front. Hum. Neurosci..

[90]  Natalie Sebanz,et al.  Prediction in Joint Action: What, When, and Where , 2009, Top. Cogn. Sci..

[91]  Peter E. Keller,et al.  Learning piano melodies in visuo-motor or audio-motor training conditions and the neural correlates of their cross-modal transfer , 2012, NeuroImage.

[92]  Wolfgang Prinz,et al.  Action-effect coupling in pianists , 2005, Psychological research.

[93]  Peter E. Keller,et al.  A grammar of action generates predictions in skilled musicians , 2011, Consciousness and Cognition.

[94]  Stefan Koelsch,et al.  Brain and Music , 2012 .

[95]  P. Keller,et al.  Auditory imagery shapes movement timing and kinematics: evidence from a musical task. , 2010, Journal of experimental psychology. Human perception and performance.

[96]  Michael J. Hove,et al.  Musical groove modulates motor cortex excitability: A TMS investigation , 2013, Brain and Cognition.

[97]  Peter Q Pfordresher,et al.  Auditory feedback in music performance: the role of melodic structure and musical skill. , 2005, Journal of experimental psychology. Human perception and performance.

[98]  Raymond H. Cuijpers,et al.  Joint Action: Neurocognitive Mechanisms Supporting Human Interaction , 2009, Top. Cogn. Sci..

[99]  Robert J. Zatorre,et al.  Musical Training as a Framework for Brain Plasticity: Behavior, Function, and Structure , 2012, Neuron.

[100]  E. J. Capaldi,et al.  A review of contemporary ideomotor theory. , 2010, Psychological bulletin.

[101]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[102]  E. Maris,et al.  Somatosensory Demands Modulate Muscular Beta Oscillations, Independent of Motor Demands , 2013, Journal of Neuroscience.

[103]  Á. Pascual-Leone,et al.  The Brain That Plays Music and Is Changed by It , 2001, Annals of the New York Academy of Sciences.

[104]  B. Repp,et al.  Pianists duet better when they play with themselves: On the possible role of action simulation in synchronization , 2007, Consciousness and Cognition.

[105]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[106]  E. Thorndike Ideo-motor action. , 1913 .

[107]  J. Cole,et al.  Enacting Intersubjectivity: A Cognitive and Social Perspective on the Study of Interactions , 2008 .

[108]  R. Hari,et al.  Synchronous cortical oscillatory activity during motor action , 2003, Current Opinion in Neurobiology.

[109]  W. James,et al.  The Principles of Psychology. , 1983 .

[110]  P. Keller,et al.  Action Planning in Sequential Skills: Relations to Music Performance , 2008, Quarterly journal of experimental psychology.

[111]  L. Craighero,et al.  Leadership in Orchestra Emerges from the Causal Relationships of Movement Kinematics , 2012, PloS one.

[112]  Armin Stock,et al.  A short history of ideo-motor action , 2004, Psychological research.