Performance monitoring of self and other in a turn-taking piano duet: A dual-EEG study

ABSTRACT During joint action tasks, expectations for outcomes of one’s own and other’s actions are collectively monitored. Recent evidence suggests that trait empathy levels may also influence performance monitoring processes. The present study investigated how outcome expectation and empathy interact during a turn-taking piano duet task, using simultaneous electroencephalography (EEG) recording. During the performances, one note in each player’s part was altered in pitch to elicit the feedback-related negativity (FRN) and subsequent P3 complex. Pianists memorized and performed pieces containing either a similar or dissimilar sequence as their partner. For additional blocks, pianists also played both sequence types with an audio-only computer partner. The FRN and P3a were larger in response to self than other, while P3b occurred only in response to self, suggesting greater online monitoring of self- compared to other-produced actions during turn-taking joint action. P3a was larger when pianists played a similar sequence as their partner. Finally, as trait empathy level increased, FRN in response to self decreased. This association was absent for FRN in response to other. This may reflect that highly-empathetic musicians during joint performance could use a strategy to suppress exclusive focus on self-monitoring.

[1]  Rongjun Yu,et al.  Brain responses to outcomes of one's own and other's performance in a gambling task , 2006, Neuroreport.

[2]  Yiwen Wang,et al.  Social distance influences the outcome evaluation of cooperation and conflict: Evidence from event-related potentials , 2017, Neuroscience Letters.

[3]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[4]  Deborah Talmi,et al.  The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors , 2013, The Journal of Neuroscience.

[5]  Christian Keysers,et al.  The anthropomorphic brain: The mirror neuron system responds to human and robotic actions , 2007, NeuroImage.

[6]  M. Iacoboni Imitation, empathy, and mirror neurons. , 2009, Annual review of psychology.

[7]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[8]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[9]  Qiang Shen,et al.  Empathic responses to others’ gains and losses: An electrophysiological investigation , 2011, NeuroImage.

[10]  Matthew Wright,et al.  Audio and Gesture Latency Measurements on Linux and OSX , 2004, ICMC.

[11]  K. Scherer,et al.  Temporal dynamics of event-related potentials related to goal conduciveness and power appraisals. , 2013, Psychophysiology.

[12]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[13]  Sukhvinder S. Obhi,et al.  Sense of agency in joint action: influence of human and computer co-actors , 2011, Experimental Brain Research.

[14]  R. Passingham,et al.  Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation , 2006, Current Biology.

[15]  Rudolf Stark,et al.  The influence of expertise on brain activation of the action observation network during anticipation of tennis and volleyball serves , 2014, Front. Hum. Neurosci..

[16]  Clay B. Holroyd,et al.  Responsibility modulates neural mechanisms of outcome processing: an ERP study. , 2011, Psychophysiology.

[17]  Roshan Cools,et al.  Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning , 2011, Journal of Cognitive Neuroscience.

[18]  R. Simons,et al.  To err is autonomic: error-related brain potentials, ANS activity, and post-error compensatory behavior. , 2003, Psychophysiology.

[19]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[20]  Peter E. Keller,et al.  What can music tell us about social interaction? , 2015, Trends in Cognitive Sciences.

[21]  Xiaolin Zhou,et al.  Modulation of the brain activity in outcome evaluation by interpersonal relationship: An ERP study , 2010, Neuropsychologia.

[22]  Clare Press,et al.  Neuroscience and Biobehavioral Reviews Action Observation and Robotic Agents: Learning and Anthropomorphism , 2022 .

[23]  Kazuo Hiraki,et al.  Whose loss is it? Human electrophysiological correlates of non-self reward processing , 2009, Social neuroscience.

[24]  E. Saltzman,et al.  Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired Actions , 2007, The Journal of Neuroscience.

[25]  Leonie Koban,et al.  Effects of social context and predictive relevance on action outcome monitoring , 2012, Cognitive, Affective, & Behavioral Neuroscience.

[26]  Giacomo Novembre,et al.  Distinguishing self and other in joint action. Evidence from a musical paradigm. , 2012, Cerebral cortex.

[27]  U. Castiello,et al.  The Human Premotor Cortex Is 'Mirror' Only for Biological Actions , 2004, Current Biology.

[28]  Giacomo Novembre,et al.  Motor simulation and the coordination of self and other in real-time joint action. , 2014, Social cognitive and affective neuroscience.

[29]  Janeen D. Loehr,et al.  It's not just my fault: Neural correlates of feedback processing in solo and joint action , 2015, Biological Psychology.

[30]  Günther Knoblich,et al.  Action identity: Evidence from self-recognition, prediction, and coordination , 2003, Consciousness and Cognition.

[31]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[32]  C. Heyes,et al.  Sensorimotor experience enhances automatic imitation of robotic action , 2007, Proceedings of the Royal Society B: Biological Sciences.

[33]  Leonie Koban,et al.  Brain systems underlying the affective and social monitoring of actions: An integrative review , 2014, Neuroscience & Biobehavioral Reviews.

[34]  Sidney J Segalowitz,et al.  The error-related negativity is related to risk taking and empathy in young men. , 2009, Psychophysiology.

[35]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[36]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[37]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[38]  Janeen D. Loehr,et al.  Monitoring Individual and Joint Action Outcomes in Duet Music Performance , 2013, Journal of Cognitive Neuroscience.

[39]  Mario Carlo Severo,et al.  Goal impact influences the evaluative component of performance monitoring: Evidence from ERPs , 2017, Biological Psychology.

[40]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[41]  G. Pourtois,et al.  Goal relevance influences performance monitoring at the level of the FRN and P3 components. , 2016, Psychophysiology.

[42]  Geoffrey L. Cohen,et al.  The Psychology of Self‐defense: Self‐Affirmation Theory , 2006 .

[43]  Adrian G. Fischer,et al.  Neural mechanisms and temporal dynamics of performance monitoring , 2014, Trends in Cognitive Sciences.

[44]  Johannes Hewig,et al.  The Feedback-related Negativity Reflects the Combination of Instantaneous and Long-term Values of Decision Outcomes , 2017, Journal of Cognitive Neuroscience.

[45]  Bernhard Ross,et al.  Sound-Making Actions Lead to Immediate Plastic Changes of Neuromagnetic Evoked Responses and Induced β-Band Oscillations during Perception , 2017, The Journal of Neuroscience.

[46]  M. Bangert,et al.  Mapping perception to action in piano practice: a longitudinal DC-EEG study , 2003, BMC Neuroscience.

[47]  U. Sailer,et al.  Human Neuroscience , 2022 .

[48]  Clay B. Holroyd,et al.  Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance , 2004, Neuroscience & Biobehavioral Reviews.

[49]  Y. Paulignan,et al.  An Interference Effect of Observed Biological Movement on Action , 2003, Current Biology.

[50]  C. Bellebaum,et al.  Empathy and feedback processing in active and observational learning , 2013, Cognitive, affective & behavioral neuroscience.

[51]  I. Daum,et al.  The feedback-related negativity is modulated by feedback probability in observational learning , 2011, Behavioural Brain Research.

[52]  Sari R. R. Nijssen,et al.  Joint Action: Mental Representations, Shared Information and General Mechanisms for Coordinating with Others , 2017, Front. Psychol..

[53]  M. Brass,et al.  Automatic Imitation of Physically Impossible Movements , 2010 .

[54]  Craig A. Smith,et al.  Appraisal theory: Overview, assumptions, varieties, controversies. , 2001 .

[55]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[56]  Lauren V. Hadley,et al.  Causal Role of Motor Simulation in Turn-Taking Behavior , 2015, The Journal of Neuroscience.

[57]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[58]  Kazuo Okanoya,et al.  Feedback-based error monitoring processes during musical performance: An ERP study , 2008, Neuroscience Research.

[59]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[60]  Caroline Palmer,et al.  Auditory N1 reveals planning and monitoring processes during music performance. , 2017, Psychophysiology.

[61]  J. Polich,et al.  P3a and P3b from typical auditory and visual stimuli , 1999, Clinical Neurophysiology.

[62]  C. Bellebaum,et al.  Your Error’s Got me Feeling – How Empathy Relates to the Electrophysiological Correlates of Performance Monitoring , 2012, Front. Hum. Neurosci..

[63]  Emily S. Cross,et al.  The shaping of social perception by stimulus and knowledge cues to human animacy , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[64]  Lincoln J. Colling,et al.  The effect of movement kinematics on predicting the timing of observed actions , 2014, Experimental Brain Research.

[65]  S. Baron-Cohen,et al.  The Empathy Quotient: An Investigation of Adults with Asperger Syndrome or High Functioning Autism, and Normal Sex Differences , 2004, Journal of autism and developmental disorders.

[66]  Christian Bellebaum,et al.  It was not MY fault: event-related brain potentials in active and observational learning from feedback. , 2010, Cerebral cortex.

[67]  Alison L. Chasteen,et al.  Your mistakes are mine: Self-other overlap predicts neural response to observed errors , 2010 .

[68]  A. Moors Can cognitive methods be used to study the unique aspect of emotion: An appraisal theorist's answer , 2007 .

[69]  Qiang Liu,et al.  The influence of the diffusion of responsibility effect on outcome evaluations: Electrophysiological evidence from an ERP study , 2010, NeuroImage.

[70]  Stefan Koelsch,et al.  Processing Expectancy Violations during Music Performance and Perception: An ERP Study , 2010, Journal of Cognitive Neuroscience.

[71]  J. Mazziotta,et al.  Grasping the Intentions of Others with One's Own Mirror Neuron System , 2005, PLoS biology.

[72]  F. Ebner,et al.  Coping with Self-Threat and the Evaluation of Self-Related Traits: An fMRI Study , 2015, PloS one.

[73]  S. Baldwin,et al.  Empathy and error processing. , 2010, Psychophysiology.