The cortical computations underlying feedback control in vocal production

Recent neurophysiological studies of speaking are beginning to elucidate the neural mechanisms underlying auditory feedback processing during vocalizations. Here we review how research findings impact our state feedback control (SFC) model of speech motor control. We will discuss the evidence for cortical computations that compare incoming feedback with predictions derived from motor efference copy. We will also review observations from auditory feedback perturbation studies that demonstrate clear evidence for a state estimate correction process, which drives compensatory motor behavioral responses. While there is compelling support for cortical computations in the SFC model, there are still several outstanding questions that await resolution by future neural investigations.

[1]  H. Fukuyama,et al.  Cortical processing mechanism for vocalization with auditory verbal feedback , 1997, Neuroreport.

[2]  Jay J Bauer,et al.  Vocal responses to unanticipated perturbations in voice loudness feedback: an automatic mechanism for stabilizing voice amplitude. , 2006, The Journal of the Acoustical Society of America.

[3]  J. Elman.  Effects of frequency-shifted feedback on the pitch of vocal productions. , 1981, The Journal of the Acoustical Society of America.

[4]  Keith Johnson,et al.  Partial Compensation for Altered Auditory Feedback: A Tradeoff with Somatosensory Feedback? , 2012, Language and speech.

[5]  Xiaoqin Wang,et al.  Dynamics of auditory-vocal interaction in monkey auditory cortex. , 2005, Cerebral cortex.

[6]  S. Nagarajan,et al.  Magnetoencephalographic evidence for a precise forward model in speech production , 2006, Neuroreport.

[7]  Emmanuel Guigon,et al.  Optimality, stochasticity, and variability in motor behavior , 2008, Journal of Computational Neuroscience.

[8]  Frank H. Guenther,et al.  A neural theory of speech acquisition and production , 2012, Journal of Neurolinguistics.

[9]  S. Scott.  The computational and neural basis of voluntary motor control and planning , 2012, Trends in Cognitive Sciences.

[10]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[11]  Heidi E Kirsch,et al.  Single-Trial Speech Suppression of Auditory Cortex Activity in Humans , 2010, The Journal of Neuroscience.

[12]  Srikantan S. Nagarajan,et al.  Neural evidence for state feedback control of speaking , 2013 .

[13]  Riitta Salmelin,et al.  Subject's own speech reduces reactivity of the human auditory cortex , 1999, Neuroscience Letters.

[14]  J. Ford,et al.  Neurophysiological evidence of corollary discharge dysfunction in schizophrenia. , 2001, The American journal of psychiatry.

[15]  Charles R. Larson,et al.  Interactions between auditory and somatosensory feedback for voice F0 control , 2008, Experimental Brain Research.

[16]  Hideki Kawahara,et al.  Transformed auditory feedback: Effects of fundamental frequency perturbation , 1993 .

[17]  Hidenao Fukuyama,et al.  Cortical activation by monaural speech sound stimulation demonstrated by positron emission tomography , 2006, Experimental Brain Research.

[18]  T A Burnett,et al.  Comparison of voice F0 responses to pitch-shift onset and offset conditions. , 2001, The Journal of the Acoustical Society of America.

[19]  F. Guenther,et al.  Vowel Category Boundaries Enhance Cortical and Behavioral Responses to Speech Feedback Alterations , 2013, The Journal of Neuroscience.

[20]  D. Ostry,et al.  Nonhomogeneous transfer reveals specificity in speech motor learning. , 2012, Journal of neurophysiology.

[21]  Daniel R. Hansen,et al.  Sensory-Motor Interactions for Vocal Pitch Monitoring in Non-Primary Human Auditory Cortex , 2013, PloS one.

[22]  Srikantan S. Nagarajan,et al.  A right-lateralized cortical network drives error correction to voice pitch feedback perturbation , 2013 .

[23]  G. Curio,et al.  Speaking modifies voice‐evoked activity in the human auditory cortex , 2000, Human brain mapping.

[24]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[25]  John F. Houde,et al.  Compensatory responses to brief perturbations of speech amplitude , 2005 .

[26]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[27]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[28]  Jeffery A. Jones,et al.  Auditory Feedback Control of Vocal Pitch during Sustained Vocalization: A Cross-Sectional Study of Adult Aging , 2011, PloS one.

[29]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[30]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[31]  F. Guenther,et al.  A theoretical investigation of reference frames for the planning of speech movements. , 1998, Psychological review.

[32]  Edward F Chang,et al.  Control of Spoken Vowel Acoustics and the Influence of Phonetic Context in Human Speech Sensorimotor Cortex , 2014, The Journal of Neuroscience.

[33]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[34]  Srikantan S. Nagarajan,et al.  Speech Production as State Feedback Control , 2011, Front. Hum. Neurosci..

[35]  Kevin G Munhall,et al.  Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. , 2006, The Journal of the Acoustical Society of America.

[36]  Keith Johnson,et al.  Phonetic Feature Encoding in Human Superior Temporal Gyrus , 2014, Science.

[37]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[38]  D. Poeppel,et al.  Health, USA Reviewed by: , 2010 .

[39]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[40]  Judith M Ford,et al.  Electrophysiological evidence of corollary discharge dysfunction in schizophrenia during talking and thinking. , 2004, Journal of psychiatric research.

[41]  Jeffery A. Jones,et al.  Perceptual calibration of F0 production: evidence from feedback perturbation. , 2000, The Journal of the Acoustical Society of America.

[42]  S. Nagarajan,et al.  What Does Motor Efference Copy Represent? Evidence from Speech Production , 2013, The Journal of Neuroscience.

[43]  K. Munhall,et al.  Compensation following real-time manipulation of formants in isolated vowels. , 2006, The Journal of the Acoustical Society of America.

[44]  C. Larson,et al.  Vocalization-induced enhancement of the auditory cortex responsiveness during voice F0 feedback perturbation , 2009, Clinical Neurophysiology.

[45]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[46]  S. Nagarajan,et al.  Speech target modulates speaking induced suppression in auditory cortex , 2009, BMC Neuroscience.

[47]  H. Pick,et al.  Reliability of sidetone amplification effect in vocal intensity. , 1975, Journal of communication disorders.

[48]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[49]  O. Jacobs,et al.  Introduction to Control Theory , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[50]  Simo Srkk,et al.  Bayesian Filtering and Smoothing , 2013 .

[51]  Srikantan S. Nagarajan,et al.  A bilateral cortical network responds to pitch perturbations in speech feedback , 2014, NeuroImage.

[52]  V. Gracco,et al.  Perceptual recalibration of speech sounds following speech motor learning. , 2009, The Journal of the Acoustical Society of America.

[53]  J. Greenlee,et al.  Human Auditory Cortical Activation during Self-Vocalization , 2011, PloS one.

[54]  Daniel R. Lametti,et al.  Sensory Preference in Speech Production Revealed by Simultaneous Alteration of Auditory and Somatosensory Feedback , 2012, The Journal of Neuroscience.

[55]  S. Scott.  Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[56]  Emanuel Todorov,et al.  Optimal Control Theory , 2006 .

[57]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[58]  E. Chang,et al.  Human cortical sensorimotor network underlying feedback control of vocal pitch , 2013, Proceedings of the National Academy of Sciences.

[59]  F H Guenther,et al.  Speech sound acquisition, coarticulation, and rate effects in a neural network model of speech production. , 1995, Psychological review.

[60]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[61]  Simo Särkkä,et al.  Bayesian Filtering and Smoothing , 2013, Institute of Mathematical Statistics textbooks.

[62]  C. Larson,et al.  Instructing subjects to make a voluntary response reveals the presence of two components to the audio-vocal reflex , 1999, Experimental Brain Research.

[63]  Gregory Hickok,et al.  The architecture of speech production and the role of the phoneme in speech processing , 2014, Language and cognitive processes.

[64]  J. Perkell,et al.  Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. , 2007, The Journal of the Acoustical Society of America.

[65]  Chi-Sang Poon,et al.  Internal models in sensorimotor integration: perspectives from adaptive control theory , 2005, Journal of neural engineering.

[66]  Kristofer E. Bouchard,et al.  Functional Organization of Human Sensorimotor Cortex for Speech Articulation , 2013, Nature.

[67]  G. Hickok.  Computational neuroanatomy of speech production , 2012, Nature Reviews Neuroscience.

[68]  D. Wolpert.  Computational approaches to motor control , 1997, Trends in Cognitive Sciences.

[69]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[70]  Gabriel Curio,et al.  Differential effects of overt, covert and replayed speech on vowel-evoked responses of the human auditory cortex , 1999, Neuroscience Letters.

[71]  Y Yonekura,et al.  Cortical speech processing mechanisms while vocalizing visually presented languages , 1996, Neuroreport.

[72]  Kevin G. Munhall,et al.  Children's Development of Self-Regulation in Speech Production , 2012, Current Biology.

[73]  Xiaoqin Wang,et al.  Sensory-motor interaction in the primate auditory cortex during self-initiated vocalizations. , 2003, Journal of neurophysiology.

[74]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[75]  Bill Rogers,et al.  Understanding the neural mechanisms involved in sensory control of voice production , 2012, NeuroImage.

[76]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[77]  Cathy J. Price,et al.  A Generative Model of Speech Production in Broca’s and Wernicke’s Areas , 2011, Front. Psychology.