Auditory N1 reveals planning and monitoring processes during music performance.

The current study investigated the relationship between planning processes and feedback monitoring during music performance, a complex task in which performers prepare upcoming events while monitoring their sensory outcomes. Theories of action planning in auditory-motor production tasks propose that the planning of future events co-occurs with the perception of auditory feedback. This study investigated the neural correlates of planning and feedback monitoring by manipulating the contents of auditory feedback during music performance. Pianists memorized and performed melodies at a cued tempo in a synchronization-continuation task while the EEG was recorded. During performance, auditory feedback associated with single melody tones was occasionally substituted with tones corresponding to future (next), present (current), or past (previous) melody tones. Only future-oriented altered feedback disrupted behavior: Future-oriented feedback caused pianists to slow down on the subsequent tone more than past-oriented feedback, and amplitudes of the auditory N1 potential elicited by the tone immediately following the altered feedback were larger for future-oriented than for past-oriented or noncontextual (unrelated) altered feedback; larger N1 amplitudes were associated with greater slowing following altered feedback in the future condition only. Feedback-related negativities were elicited in all altered feedback conditions. In sum, behavioral and neural evidence suggests that future-oriented feedback disrupts performance more than past-oriented feedback, consistent with planning theories that posit similarity-based interference between feedback and planning contents. Neural sensory processing of auditory feedback, reflected in the N1 ERP, may serve as a marker for temporal disruption caused by altered auditory feedback in auditory-motor production tasks.

[1]  F. Perrin,et al.  Sensorimotor Learning Enhances Expectations During Auditory Perception. , 2015, Cerebral cortex.

[2]  E. Altenmüller,et al.  Task-Irrelevant Auditory Feedback Facilitates Motor Performance in Musicians , 2012, Front. Psychology.

[3]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[4]  I. Daum,et al.  It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations , 2010, Neuropsychologia.

[5]  F. Guenther,et al.  A theoretical investigation of reference frames for the planning of speech movements. , 1998, Psychological review.

[6]  R. Simons,et al.  To err is autonomic: error-related brain potentials, ANS activity, and post-error compensatory behavior. , 2003, Psychophysiology.

[7]  Caroline Palmer,et al.  Sensorimotor mechanisms in music performance: actions that go partially wrong , 2012, Annals of the New York Academy of Sciences.

[8]  W. Neill,et al.  Inhibitory and facilitatory processes in selective attention. , 1977 .

[9]  Stefan Koelsch,et al.  Processing Expectancy Violations during Music Performance and Perception: An ERP Study , 2010, Journal of Cognitive Neuroscience.

[10]  Yanni Liu,et al.  Loss feedback negativity elicited by single- versus conjoined-feature stimuli , 2009, Neuroreport.

[11]  Edwaed W. Large.  Dynamic programming for the analysis of serial behaviors , 1993 .

[12]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[13]  W. Levelt,et al.  Monitoring and self-repair in speech , 1983, Cognition.

[14]  Caroline Palmer,et al.  Speed, Accuracy, and Serial Order in Sequence Production , 2007, Cogn. Sci..

[15]  Josep Marco-Pallarés,et al.  Functional neural dynamics underlying auditory event-related N1 and N1 suppression response , 2007, NeuroImage.

[16]  C. Palmer,et al.  Auditory feedback and memory for music performance: Sound evidence for an encoding effect , 2003, Memory & cognition.

[17]  Erich Schröger,et al.  The N1-suppression effect for self-initiated sounds is independent of attention , 2012, BMC Neuroscience.

[18]  Elia Formisano,et al.  The Sensory Consequences of Speaking: Parametric Neural Cancellation during Speech in Auditory Cortex , 2011, PloS one.

[19]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[20]  Ray Jackendoff,et al.  An overview of hierarchical structure in music , 1983 .

[21]  E. Schröger,et al.  Early electrophysiological indicators for predictive processing in audition: a review. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  Edward M Bernat,et al.  Time-frequency theta and delta measures index separable components of feedback processing in a gambling task. , 2015, Psychophysiology.

[23]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.

[24]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[25]  H. Loess.  Proactive inhibition in short-term memory , 1964 .

[26]  Janeen D. Loehr,et al.  Monitoring Individual and Joint Action Outcomes in Duet Music Performance , 2013, Journal of Cognitive Neuroscience.

[27]  John Brown.  Some Tests of the Decay Theory of Immediate Memory , 1958 .

[28]  Doreen Eichel.  Phonetics The Science Of Speech Production , 2016 .

[29]  Eckart Altenmüller,et al.  Classical conditioned responses to absent tones , 2006, BMC Neuroscience.

[30]  Victor S Ferreira,et al.  Language production. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[31]  Kazuo Okanoya,et al.  Feedback-based error monitoring processes during musical performance: An ERP study , 2008, Neuroscience Research.

[32]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[33]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[34]  Peter Q. Pfordresher,et al.  Effects of delayed auditory feedback on timing of music performance , 2002, Psychological research.

[35]  O. Bertrand,et al.  Time-frequency digital filtering based on an invertible wavelet transform: an application to evoked potentials , 1994, IEEE Transactions on Biomedical Engineering.

[36]  Bernhard Hommel,et al.  Codes and their vicissitudes , 2001 .

[37]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[38]  Srikantan S. Nagarajan,et al.  Motor-induced Suppression of the Auditory Cortex , 2009, Journal of Cognitive Neuroscience.

[39]  G. Dell,et al.  Language production and serial order: a functional analysis and a model. , 1997, Psychological review.

[40]  J. A. Pruszynski,et al.  Neural correlates , 2023 .

[41]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[42]  E. Schröger,et al.  Selective suppression of self-initiated sounds in an auditory stream: An ERP study. , 2011, Psychophysiology.

[43]  Norbert Kathmann,et al.  Neural correlates of feedback processing in decision-making under risk , 2012, Front. Hum. Neurosci..

[44]  A. Pavlovic,et al.  The anterior cingulate cortex , 2009 .

[45]  B. Underwood,et al.  Proactive inhibition in short-term retention of single items , 1962 .

[46]  Scott A. Huettel,et al.  Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards , 2008, Journal of Cognitive Neuroscience.

[47]  Adrian R. Willoughby,et al.  Are all medial frontal negativities created equal ? Toward a richer empirical basis for theories of action monitoring , 2003 .

[48]  Carles Escera,et al.  An electrophysiological and behavioral investigation of involuntary attention towards auditory frequency, duration and intensity changes. , 2002, Brain research. Cognitive brain research.

[49]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[50]  William J. Gehring,et al.  Perceptual properties of feedback stimuli influence the feedback-related negativity in the flanker gambling task. , 2014, Psychophysiology.

[51]  P. Rabbitt.  Errors and error correction in choice-response tasks. , 1966, Journal of experimental psychology.

[52]  C Palmer,et al.  Range of planning in music performance. , 1995, Journal of experimental psychology. Human perception and performance.

[53]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[54]  C. Drake,et al.  Skill acquisition in music performance: relations between planning and temporal control , 2000, Cognition.

[55]  C. Palmer,et al.  Units of knowledge in music performance. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[56]  Wim Fias,et al.  Post-error slowing: An orienting account , 2009, Cognition.

[57]  C. Carter,et al.  Anterior cingulate cortex and conflict detection: An update of theory and data , 2007, Cognitive, affective & behavioral neuroscience.

[58]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[59]  S A Finney,et al.  FTAP: A Linux-based program for tapping and music experiments , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[60]  S. Finney,et al.  Auditory Feedback and Musical Keyboard Performance , 1997 .

[61]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[62]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.

[63]  Clay B. Holroyd,et al.  Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance , 2004, Neuroscience & Biobehavioral Reviews.

[64]  Shiwei Jia,et al.  Detecting perceptual conflict by the feedback-related negativity in brain potentials , 2007, Neuroreport.

[65]  J. Horváth.  Action-related auditory ERP attenuation: Paradigms and hypotheses , 2015, Brain Research.

[66]  Barbara Tillmann,et al.  Sensory, Cognitive, and Sensorimotor Learning Effects in Recognition Memory for Music , 2016, Journal of Cognitive Neuroscience.

[67]  C. Larson,et al.  Error-dependent modulation of speech-induced auditory suppression for pitch-shifted voice feedback , 2011, BMC Neuroscience.

[68]  N. Yeung,et al.  On the ERN and the significance of errors. , 2005, Psychophysiology.

[69]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[70]  Marcus Cheetham,et al.  Development of ERN together with an internal model of audio-motor associations , 2013, Front. Hum. Neurosci..

[71]  Victoria A. Fromkin,et al.  The Non-Anomalous Nature of Anomalous Utterances , 1971 .

[72]  Peter Howell,et al.  Assessment of Some Contemporary Theories of Stuttering That Apply to Spontaneous Speech. , 2004, Contemporary issues in communication science and disorders : CICSD.

[73]  Caroline Palmer,et al.  Effects of hearing the past, present, or future during music performance , 2006, Perception & psychophysics.

[74]  Sander Nieuwenhuis,et al.  Mediofrontal negativities in the absence of responding. , 2005, Brain research. Cognitive brain research.

[75]  Terence W. Picton,et al.  Effects of Attention on Neuroelectric Correlates of Auditory Stream Segregation , 2006, Journal of Cognitive Neuroscience.

[76]  Nicola K. Ferdinand,et al.  The Processing of Unexpected Positive Response Outcomes in the Mediofrontal Cortex , 2012, The Journal of Neuroscience.

[77]  Nicola K. Ferdinand,et al.  Different aspects of performance feedback engage different brain areas: Disentangling valence and expectancy in feedback processing , 2014, Scientific Reports.

[78]  John J. B. Allen,et al.  Theta lingua franca: a common mid-frontal substrate for action monitoring processes. , 2012, Psychophysiology.

[79]  B. Repp.  Effects of Auditory Feedback Deprivation on Expressive Piano Performance , 1999 .

[80]  Peter Q Pfordresher,et al.  Auditory feedback in music performance: Evidence for a dissociation of sequencing and timing. , 2003, Journal of experimental psychology. Human perception and performance.

[81]  Caroline Palmer,et al.  Incremental planning in sequence production. , 2003, Psychological review.

[82]  Wei-Ping Zhu,et al.  Trial-to-trial tracking of excitatory and inhibitory synaptic conductance using Gaussian-mixture Kalman filtering , 2013, BMC Neuroscience.

[83]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[84]  Peter Q. Pfordresher,et al.  The experience of agency in sequence production with altered auditory feedback , 2012, Consciousness and Cognition.