Mental imagery of speech: linking motor and perceptual systems through internal simulation and estimation

The neural basis of mental imagery has been investigated by localizing the underlying neural networks, mostly in motor and perceptual systems, separately. However, how modality-specific representations are top-down induced and how the action and perception systems interact in the context of mental imagery is not well understood. Imagined speech production (“articulation imagery”), which induces the kinesthetic feeling of articulator movement and its auditory consequences, provides a new angle because of the concurrent involvement of motor and perceptual systems. On the basis of previous findings in mental imagery of speech, we argue for the following regarding the induction mechanisms of mental imagery and the interaction between motor and perceptual systems: (1) Two distinct top-down mechanisms, memory retrieval and motor simulation, exist to induce estimation in perceptual systems. (2) Motor simulation is sufficient to internally induce the representation of perceptual changes that would be caused by actual movement (perceptual associations); however, this simulation process only has modulatory effects on the perception of external stimuli, which critically depends on context and task demands. Considering the proposed simulation-estimation processes as common mechanisms for interaction between motor and perceptual systems, we outline how mental imagery (of speech) relates to perception and production, and how these hypothesized mechanisms might underpin certain neural disorders.

[1]  D. Wolpert,et al.  Abnormalities in the awareness and control of action. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[3]  M. Desmurget,et al.  A parietal-premotor network for movement intention and motor awareness , 2009, Trends in Cognitive Sciences.

[4]  J. Mazziotta,et al.  Mapping motor representations with positron emission tomography , 1994, Nature.

[5]  J. Abbs,et al.  Kinematic analysis of multiple movement coordination during speech in stutterers. , 1988, Brain : a journal of neurology.

[6]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[7]  David J. Ostry,et al.  Somatosensory function in speech perception , 2009, Proceedings of the National Academy of Sciences.

[8]  E. Scheerer Motor Theories of Cognitive Structure: A Historical Review , 1984 .

[9]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[10]  L. Buxbaum,et al.  On beyond mirror neurons: internal representations subserving imitation and recognition of skilled object-related actions in humans. , 2005, Brain research. Cognitive brain research.

[11]  Xiaoqin Wang,et al.  Sensory-motor interaction in the primate auditory cortex during self-initiated vocalizations. , 2003, Journal of neurophysiology.

[12]  K. Reilly,et al.  Disentangling motor execution from motor imagery with the phantom limb. , 2012, Brain : a journal of neurology.

[13]  Lori L. Holt,et al.  Reflections on mirror neurons and speech perception , 2009, Trends in Cognitive Sciences.

[14]  J. Decety,et al.  Comparative analysis of actual and mental movement times in two graphic tasks , 1989, Brain and Cognition.

[15]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.

[16]  P. Dechent,et al.  Is the human primary motor cortex involved in motor imagery? , 2004, Brain research. Cognitive brain research.

[17]  D. Poeppel,et al.  Speech perception at the interface of neurobiology and linguistics , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  O. Lindner Graded Motor Imagery for Pathologic Pain: A Randomized Controlled Trial , 2008 .

[19]  S. Kosslyn,et al.  Mental rotation of objects versus hands: neural mechanisms revealed by positron emission tomography. , 1998, Psychophysiology.

[20]  S. Kosslyn Mental images and the Brain , 2005, Cognitive neuropsychology.

[21]  R. Martin,et al.  Effects of five experimental treatments of stuttering. , 1979, Journal of speech and hearing research.

[22]  David Poeppel,et al.  TopoToolbox: Using Sensor Topography to Calculate Psychologically Meaningful Measures from Event-Related EEG/MEG , 2011, Comput. Intell. Neurosci..

[23]  R. Murray,et al.  Increased blood flow in Broca's area during auditory hallucinations in schizophrenia , 1993, The Lancet.

[24]  Samuel T. Moulton,et al.  Imagining predictions: mental imagery as mental emulation , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[26]  K. Heilman,et al.  Two forms of ideomotor apraxia , 1982, Neurology.

[27]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[28]  C. Schroeder,et al.  Somatosensory input to auditory association cortex in the macaque monkey. , 2001, Journal of neurophysiology.

[29]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[30]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[31]  S. Kosslyn Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[32]  Daniel R. Lametti,et al.  Sensory Preference in Speech Production Revealed by Simultaneous Alteration of Auditory and Somatosensory Feedback , 2012, The Journal of Neuroscience.

[33]  S M Kosslyn,et al.  Identifying objects seen from different viewpoints. A PET investigation. , 1994, Brain : a journal of neurology.

[34]  M. Bensafi,et al.  Olfactomotor activity during imagery mimics that during perception , 2003, Nature Neuroscience.

[35]  Xiaoqin Wang,et al.  Dynamics of auditory-vocal interaction in monkey auditory cortex. , 2005, Cerebral cortex.

[36]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[37]  S. Kosslyn,et al.  Imagining rotation by endogenous versus exogenous forces: Distinct neural mechanisms , 2001, Neuroreport.

[38]  G. Rizzolatti,et al.  The mirror neuron system. , 2009, Archives of neurology.

[39]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[40]  M. Jeannerod,et al.  The timing of mentally represented actions , 1989, Behavioural Brain Research.

[41]  D. Wolpert,et al.  Central cancellation of self-produced tickle sensation , 1998, Nature Neuroscience.

[42]  Seung-Schik Yoo,et al.  Neural substrates of tactile imagery: a functional MRI study , 2003, Neuroreport.

[43]  Riitta Salmelin,et al.  Subject's own speech reduces reactivity of the human auditory cortex , 1999, Neuroscience Letters.

[44]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[45]  J. Decety The neurophysiological basis of motor imagery , 1996, Behavioural Brain Research.

[46]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[47]  Gregory Hickok,et al.  Eight Problems for the Mirror Neuron Theory of Action Understanding in Monkeys and Humans , 2009, Journal of Cognitive Neuroscience.

[48]  Marc Jeannerod,et al.  Agency, simulation and self-identification , 2004 .

[49]  K. Sathian,et al.  Multisensory cortical processing of object shape and its relation to mental imagery , 2004, Cognitive, affective & behavioral neuroscience.

[50]  P. Haggard,et al.  The role of motor intention in motor awareness: an experimental study on anosognosia for hemiplegia. , 2008, Brain : a journal of neurology.

[51]  J B Poline,et al.  Partially overlapping neural networks for real and imagined hand movements. , 2000, Cerebral cortex.

[52]  M. Hallett,et al.  Functional properties of brain areas associated with motor execution and imagery. , 2003, Journal of neurophysiology.

[53]  S. Kosslyn,et al.  The role of area 17 in visual imagery: convergent evidence from PET and rTMS. , 1999, Science.

[54]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[55]  T. Nurmikko,et al.  Phantom limb pain, cortical reorganization and the therapeutic effect of mental imagery , 2008, Brain : a journal of neurology.

[56]  Frank H. Guenther,et al.  Unstable or Insufficiently Activated Internal Models and Feedback-Biased Motor Control as Sources of Dysfluency: A Theoretical Model of Stuttering , 2004 .

[57]  David Poeppel,et al.  Visual speech speeds up the neural processing of auditory speech. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[58]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[59]  Kevin G. Munhall,et al.  Functional Overlap between Regions Involved in Speech Perception and in Monitoring One's Own Voice during Speech Production , 2010, Journal of Cognitive Neuroscience.

[60]  R. Sperry Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[61]  Judith M Ford,et al.  Dissecting corollary discharge dysfunction in schizophrenia. , 2007, Psychophysiology.

[62]  M. Sommer,et al.  Corollary discharge across the animal kingdom , 2008, Nature Reviews Neuroscience.

[63]  Robert J. Zatorre,et al.  Mental Concerts: Musical Imagery and Auditory Cortex , 2005, Neuron.

[64]  Herta Flor,et al.  Phantom-limb pain: characteristics, causes, and treatment , 2002, The Lancet Neurology.

[65]  S. Gandevia,et al.  Movement imagery increases pain in people with neuropathic pain following complete thoracic spinal cord injury , 2008, PAIN®.

[66]  E. Procyk,et al.  Brain activity during observation of actions. Influence of action content and subject's strategy. , 1997, Brain : a journal of neurology.

[67]  M. Desmurget,et al.  Movement Intention After Parietal Cortex Stimulation in Humans , 2009, Science.

[68]  Hanjun Liu,et al.  Time-dependent Neural Processing of Auditory Feedback during Voice Pitch Error Detection , 2011, Journal of Cognitive Neuroscience.

[69]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[70]  Cathy J. Price,et al.  A Generative Model of Speech Production in Broca’s and Wernicke’s Areas , 2011, Front. Psychology.

[71]  G. DeAngelis,et al.  Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability , 2008, Neuron.

[72]  A. Sirigu,et al.  Motor and Visual Imagery as Two Complementary but Neurally Dissociable Mental Processes , 2001, Journal of Cognitive Neuroscience.

[73]  Y Agid,et al.  Congruent unilateral impairments for real and imagined hand movements , 1995, Neuroreport.

[74]  P. Halligan,et al.  Simulating sensory-motor incongruence in healthy volunteers: implications for a cortical model of pain. , 2005, Rheumatology.

[75]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[76]  R. Kahn,et al.  Auditory verbal hallucinations predominantly activate the right inferior frontal area. , 2008, Brain : a journal of neurology.

[77]  M. Petrides,et al.  Functional neuroimaging of odor imagery , 2005, NeuroImage.

[78]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[79]  Stefan Geyer,et al.  Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. , 2003, Journal of neurophysiology.

[80]  M P Rastatter,et al.  Effect of monaural and binaural altered auditory feedback on stuttering frequency. , 1997, The Journal of the Acoustical Society of America.

[81]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[82]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[83]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[84]  G. Deuschl,et al.  The motor system shows adaptive changes in complex regional pain syndrome. , 2007, Brain : a journal of neurology.

[85]  David J. M. Kraemer,et al.  Musical imagery: Sound of silence activates auditory cortex , 2005, Nature.

[86]  B. Neundörfer,et al.  Patterns of cortical reorganization in complex regional pain syndrome , 2003, Neurology.

[87]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[88]  A Thron,et al.  Playing piano in the mind--an fMRI study on music imagery and performance in pianists. , 2004, Brain research. Cognitive brain research.

[89]  V. Ramachandran,et al.  Touching the phantom limb , 1995, Nature.

[90]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[91]  Leslie G. Ungerleider,et al.  Visual Imagery of Famous Faces: Effects of Memory and Attention Revealed by fMRI , 2002, NeuroImage.

[92]  Dennis C. Tkach,et al.  Congruent Activity during Action and Action Observation in Motor Cortex , 2007, The Journal of Neuroscience.

[93]  G. Hickok Computational neuroanatomy of speech production , 2012, Nature Reviews Neuroscience.

[94]  Christopher R Fetsch,et al.  Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception , 2009, The Journal of Neuroscience.

[95]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[96]  S. Blakemore,et al.  The perception of self-produced sensory stimuli in patients with auditory hallucinations and passivity experiences: evidence for a breakdown in self-monitoring , 2000, Psychological Medicine.

[97]  J. Fisher Does Simulation Theory Really Involve Simulation? , 2006 .

[98]  Antonino Vallesi,et al.  Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex , 2009, PloS one.

[99]  J. Abbs,et al.  A Speech Motor Control Perspective on Stuttering: Preliminary Observations , 1987 .

[100]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[101]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[102]  Alan C. Evans,et al.  Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception , 1996, Journal of Cognitive Neuroscience.

[103]  S. Nagarajan,et al.  Speech target modulates speaking induced suppression in auditory cortex , 2009, BMC Neuroscience.

[104]  M. Jeannerod Mental imagery in the motor context , 1995, Neuropsychologia.

[105]  Liuba Papeo,et al.  Higher‐level motor processes , 2010, Annals of the New York Academy of Sciences.

[106]  Elizabeth Bates,et al.  Action comprehension in aphasia: linguistic and non-linguistic deficits and their lesion correlates , 2004, Neuropsychologia.

[107]  A. Giraud,et al.  Implicit Multisensory Associations Influence Voice Recognition , 2006, PLoS biology.

[108]  D. Poeppel,et al.  Health, USA Reviewed by: , 2010 .

[109]  Gabriel Curio,et al.  Quasi-movements: A novel motor–cognitive phenomenon , 2008, Neuropsychologia.

[110]  Judith M Ford,et al.  Relationship of imprecise corollary discharge in schizophrenia to auditory hallucinations. , 2007, Archives of general psychiatry.

[111]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[112]  F. Mauguière,et al.  Stimulation of the human cortex and the experience of pain: Wilder Penfield's observations revisited. , 2012, Brain : a journal of neurology.

[113]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[114]  Michael J Brammer,et al.  Engagement of brain areas implicated in processing inner speech in people with auditory hallucinations. , 2003, The British journal of psychiatry : the journal of mental science.

[115]  Patrick Haggard,et al.  Experimenting with the acting self , 2005, Cognitive neuropsychology.

[116]  C. Frith,et al.  Self-awareness and action , 2003, Current Opinion in Neurobiology.

[117]  A. Sirigu,et al.  The Mental Representation of Hand Movements After Parietal Cortex Damage , 1996, Science.

[118]  Satrajit S. Ghosh,et al.  Weak Responses to Auditory Feedback Perturbation during Articulation in Persons Who Stutter: Evidence for Abnormal Auditory-Motor Transformation , 2012, PloS one.

[119]  David E. Huber,et al.  Measures of Spatial Similarity and Response Magnitude in MEG and Scalp EEG , 2007, Brain Topography.

[120]  Andrew Stuart,et al.  The effect of frequency altered feedback on stuttering duration and type. , 2008, Journal of speech, language, and hearing research : JSLHR.