Selective and divided attention modulates auditory–vocal integration in the processing of pitch feedback errors

Speakers rapidly adjust their ongoing vocal productions to compensate for errors they hear in their auditory feedback. It is currently unclear what role attention plays in these vocal compensations. This event‐related potential (ERP) study examined the influence of selective and divided attention on the vocal and cortical responses to pitch errors heard in auditory feedback regarding ongoing vocalisations. During the production of a sustained vowel, participants briefly heard their vocal pitch shifted up two semitones while they actively attended to auditory or visual events (selective attention), or both auditory and visual events (divided attention), or were not told to attend to either modality (control condition). The behavioral results showed that attending to the pitch perturbations elicited larger vocal compensations than attending to the visual stimuli. Moreover, ERPs were likewise sensitive to the attentional manipulations: P2 responses to pitch perturbations were larger when participants attended to the auditory stimuli compared to when they attended to the visual stimuli, and compared to when they were not explicitly told to attend to either the visual or auditory stimuli. By contrast, dividing attention between the auditory and visual modalities caused suppressed P2 responses relative to all the other conditions and caused enhanced N1 responses relative to the control condition. These findings provide strong evidence for the influence of attention on the mechanisms underlying the auditory–vocal integration in the processing of pitch feedback errors. In addition, selective attention and divided attention appear to modulate the neurobehavioral processing of pitch feedback errors in different ways.

[1]  Michael F. Neelon,et al.  The effects of auditory attention measured from human electrocorticograms , 2006, Clinical Neurophysiology.

[2]  E. Chang,et al.  Human cortical sensorimotor network underlying feedback control of vocal pitch , 2013, Proceedings of the National Academy of Sciences.

[3]  C. Larson,et al.  Vocalization-induced enhancement of the auditory cortex responsiveness during voice F0 feedback perturbation , 2009, Clinical Neurophysiology.

[4]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[5]  C. Larson,et al.  Error-dependent modulation of speech-induced auditory suppression for pitch-shifted voice feedback , 2011, BMC Neuroscience.

[6]  B R Rosen,et al.  Modulation of auditory and visual cortex by selective attention is modality-dependent. , 1996, Neuroreport.

[7]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[8]  Dani Byrd,et al.  Auditory Selective Attention: An fMRI Investigation , 1996, NeuroImage.

[9]  T W Picton,et al.  Human auditory evoked potentials. II. Effects of attention. , 1974, Electroencephalography and clinical neurophysiology.

[10]  T. Klingberg Concurrent performance of two working memory tasks: potential mechanisms of interference. , 1998, Cerebral cortex.

[11]  Daniel H. Mathalon,et al.  Action planning and predictive coding when speaking , 2014, NeuroImage.

[12]  Risto N t nen Attention and brain function , 1992 .

[13]  Robert J. Zatorre,et al.  Experience-dependent neural substrates involved in vocal pitch regulation during singing , 2008, NeuroImage.

[14]  R. Burkard Human Auditory Evoked Potentials , 2010 .

[15]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  B. Shinn-Cunningham,et al.  Task-modulated “what” and “where” pathways in human auditory cortex , 2006, Proceedings of the National Academy of Sciences.

[17]  R. Knight,et al.  Gating of somatosensory input by human prefrontal cortex , 1990, Brain Research.

[18]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[19]  C. Larson,et al.  Left-hemisphere activation is associated with enhanced vocal pitch error detection in musicians with absolute pitch , 2014, Brain and Cognition.

[20]  Emily Q. Wang,et al.  Effect of tonal native language on voice fundamental frequency responses to pitch feedback perturbations during sustained vocalizations. , 2010, The Journal of the Acoustical Society of America.

[21]  A. Bonnel,et al.  Divided attention between simultaneous auditory and visual signals , 1998, Perception & psychophysics.

[22]  S. Yantis,et al.  Control of Attention Shifts between Vision and Audition in Human Cortex , 2004, The Journal of Neuroscience.

[23]  R. Näätänen,et al.  Attention and mismatch negativity. , 1993, Psychophysiology.

[24]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  Jeffery A. Jones,et al.  ERP correlates of online monitoring of auditory feedback during vocalization. , 2009, Psychophysiology.

[26]  J Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. I. Simple and choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[27]  R. Kawashima,et al.  Selective Visual and Auditory Attention Toward Utterances—A PET Study , 1999, NeuroImage.

[28]  Jeffrey R. Binder,et al.  Attentional and linguistic interactions in speech perception , 2008, NeuroImage.

[29]  Peng Liu,et al.  Attention Modulates Cortical Processing of Pitch Feedback Errors in Voice Control , 2015, Scientific Reports.

[30]  Satrajit S. Ghosh,et al.  Focal Manipulations of Formant Trajectories Reveal a Role of Auditory Feedback in the Online Control of Both Within-Syllable and Between-Syllable Speech Timing , 2011, The Journal of Neuroscience.

[31]  S. Hillyard,et al.  Modulation of early auditory processing during selective listening to rapidly presented tones. , 1991, Electroencephalography and clinical neurophysiology.

[32]  Jennifer L. Mozolic,et al.  Cross-modal deactivations during modality-specific selective attention , 2008, BMC neurology.

[33]  M. Petrides The role of the mid-dorsolateral prefrontal cortex in working memory , 2000, Experimental Brain Research.

[34]  Lisa D. Sanders,et al.  Neurophysiological evidence for selective auditory attention deficits in children with specific language impairment , 2006, Brain Research.

[35]  F. Bloom,et al.  Modulation of early sensory processing in human auditory cortex during auditory selective attention. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Robert J. Zatorre,et al.  The Role of the Dorsolateral Prefrontal Cortex in Bimodal Divided Attention: Two Transcranial Magnetic Stimulation Studies , 2007, Journal of Cognitive Neuroscience.

[37]  Heidi E Kirsch,et al.  Single-Trial Speech Suppression of Auditory Cortex Activity in Humans , 2010, The Journal of Neuroscience.

[38]  Emily Q. Wang,et al.  ERP correlates of language-specific processing of auditory pitch feedback during self-vocalization , 2012, Brain and Language.

[39]  Christian Kaufmann,et al.  Human prefrontal and sensory cortical activity during divided attention tasks , 2003, Human brain mapping.

[40]  J. Ford,et al.  Fine-tuning of auditory cortex during speech production. , 2005, Psychophysiology.

[41]  R. Zatorre,et al.  Attention to simultaneous unrelated auditory and visual events: behavioral and neural correlates. , 2005, Cerebral cortex.

[42]  Jeffery A. Jones,et al.  The developmental trajectory of vocal and event‐related potential responses to frequency‐altered auditory feedback , 2013, The European journal of neuroscience.

[43]  P. Jolicoeur Restricted attentional capacity between sensory modalities , 1999, Psychonomic bulletin & review.

[44]  Jeffery A. Jones,et al.  The predictability of frequency‐altered auditory feedback changes the weighting of feedback and feedforward input for speech motor control , 2014, The European journal of neuroscience.

[45]  E. Yund,et al.  Attentional modulation of human auditory cortex , 2004, Nature Neuroscience.

[46]  Robert T. Knight,et al.  Prefrontal cortex gating of auditory transmission in humans , 1989, Brain Research.

[47]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[48]  D. Woods,et al.  Attention modulates auditory pattern memory as indexed by event-related brain potentials. , 1997, Psychophysiology.

[49]  C. Larson,et al.  Instructing subjects to make a voluntary response reveals the presence of two components to the audio-vocal reflex , 1999, Experimental Brain Research.

[50]  F. Bloom,et al.  Magnetoencephalographic recordings demonstrate attentional modulation of mismatch-related neural activity in human auditory cortex. , 1998, Psychophysiology.

[51]  J. Rauschecker,et al.  Attention‐related modulation of activity in primary and secondary auditory cortex , 1997, Neuroreport.

[52]  Clayton E. Curtis,et al.  The effects of prefrontal lesions on working memory performance and theory , 2004, Cognitive, affective & behavioral neuroscience.

[53]  Jeffery A. Jones,et al.  Attentional Demands Influence Vocal Compensations to Pitch Errors Heard in Auditory Feedback , 2014, PloS one.

[54]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[55]  Jeffery A. Jones,et al.  Auditory-motor adaptation to frequency-altered auditory feedback occurs when participants ignore feedback , 2013, BMC Neuroscience.

[56]  Robert J. Zatorre,et al.  Neural substrates for dividing and focusing attention between simultaneous auditory and visual events , 2006, NeuroImage.

[57]  D. Tucker,et al.  Scalp electrode impedance, infection risk, and EEG data quality , 2001, Clinical Neurophysiology.

[58]  I. Winkler,et al.  The role of attention in the formation of auditory streams , 2007, Perception & psychophysics.

[59]  Jeffery A. Jones,et al.  Dynamics of Vocalization-Induced Modulation of Auditory Cortical Activity at Mid-utterance , 2013, PloS one.

[60]  Jay J Bauer,et al.  Vocal responses to unanticipated perturbations in voice loudness feedback: an automatic mechanism for stabilizing voice amplitude. , 2006, The Journal of the Acoustical Society of America.

[61]  R. Näätänen Attention and brain function , 1992 .

[62]  S. Hillyard,et al.  Auditory evoked potentials during selective listening to dichotic speech messages , 1976 .

[63]  Jeffery A. Jones,et al.  Remapping Auditory-Motor Representations in Voice Production , 2005, Current Biology.

[64]  Mikko Sams,et al.  Attention-driven auditory cortex short-term plasticity helps segregate relevant sounds from noise , 2011, Proceedings of the National Academy of Sciences.

[65]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[66]  Riikka Möttönen,et al.  Attention Fine-Tunes Auditory–Motor Processing of Speech Sounds , 2014, The Journal of Neuroscience.