An fMRI investigation of syllable sequence production

Fluent speech comprises sequences that are composed from a finite alphabet of learned words, syllables, and phonemes. The sequencing of discrete motor behaviors has received much attention in the motor control literature, but relatively little has been focused directly on speech production. In this paper, we investigate the cortical and subcortical regions involved in organizing and enacting sequences of simple speech sounds. Sparse event-triggered functional magnetic resonance imaging (fMRI) was used to measure responses to preparation and overt production of non-lexical three-syllable utterances, parameterized by two factors: syllable complexity and sequence complexity. The comparison of overt production trials to preparation only trials revealed a network related to the initiation of a speech plan, control of the articulators, and to hearing one's own voice. This network included the primary motor and somatosensory cortices, auditory cortical areas, supplementary motor area (SMA), the precentral gyrus of the insula, and portions of the thalamus, basal ganglia, and cerebellum. Additional stimulus complexity led to increased engagement of the basic speech network and recruitment of additional areas known to be involved in sequencing non-speech motor acts. In particular, the left hemisphere inferior frontal sulcus and posterior parietal cortex, and bilateral regions at the junction of the anterior insula and frontal operculum, the SMA and pre-SMA, the basal ganglia, anterior thalamus, and the cerebellum showed increased activity for more complex stimuli. We hypothesize mechanistic roles for the extended speech production network in the organization and execution of sequences of speech sounds.

[1]  M. Mauk,et al.  Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Thomas E. Nichols,et al.  Combining voxel intensity and cluster extent with permutation test framework , 2004, NeuroImage.

[3]  F H Guenther,et al.  Speech sound acquisition, coarticulation, and rate effects in a neural network model of speech production. , 1995, Psychological review.

[4]  Prahlad Gupta,et al.  Serial position effects in nonword repetition , 2005 .

[5]  W Grodd,et al.  Opposite hemispheric lateralization effects during speaking and singing at motor cortex, insula and cerebellum , 2000, Neuroreport.

[6]  F. Guenther,et al.  A theoretical investigation of reference frames for the planning of speech movements. , 1998, Psychological review.

[7]  V Menon,et al.  Modality effects in verbal working memory: differential prefrontal and parietal responses to auditory and visual stimuli , 2004, NeuroImage.

[8]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[9]  Peter A. Bandettini,et al.  Experimental designs and processing strategies for fMRI studies involving overt verbal responses , 2004, NeuroImage.

[10]  S. Cobb Speech and Brain-Mechanisms. , 1960 .

[11]  Ming-Chyi Pai,et al.  Supplementary motor area aphasia: a case report , 1999, Clinical Neurology and Neurosurgery.

[12]  Willem J. M. Levelt,et al.  The neural correlates of language production , 2000 .

[13]  J. Kropotov,et al.  Selection of actions in the basal ganglia-thalamocortical circuits: review and model. , 1999, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  Juan Segui,et al.  The syllable’s role in speech production: Are syllables chunks, schemas, or both? , 1998 .

[15]  G. Salamon,et al.  Mutism and auditory agnosia due to bilateral insular damage—Role of the insula in human communication , 1995, Neuropsychologia.

[16]  K. Lashley The problem of serial order in behavior , 1951 .

[17]  N Burgess,et al.  Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study , 2000, Neuropsychologia.

[18]  John E. Desmond,et al.  Cerebrocerebellar networks during articulatory rehearsal and verbal working memory tasks , 2005, NeuroImage.

[19]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[20]  W. Penfield,et al.  Speech and Brain‐Mechanisms , 1960 .

[21]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[22]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[23]  M. Petrides Functional specialization within the dorsolateral frontal cortex for serial order memory , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[24]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[25]  Edward E. Smith,et al.  Dissociation of Storage and Rehearsal in Verbal Working Memory: Evidence From Positron Emission Tomography , 1996 .

[26]  Timothy Edward John Behrens,et al.  Changes in connectivity profiles define functionally distinct regions in human medial frontal cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Guinevere F. Eden,et al.  Meta-Analysis of the Functional Neuroanatomy of Single-Word Reading: Method and Validation , 2002, NeuroImage.

[28]  G. McCarthy,et al.  Functional organization of human supplementary motor cortex studied by electrical stimulation , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  J. Tanji,et al.  Both supplementary and presupplementary motor areas are crucial for the temporal organization of multiple movements. , 1998, Journal of neurophysiology.

[30]  R. Ivry,et al.  Temporal organization of "internal speech" as a basis for cerebellar modulation of cognitive functions. , 2004, Behavioral and cognitive neuroscience reviews.

[31]  S E Petersen,et al.  A positron emission tomography study of the short-term maintenance of verbal information , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  P. Strick,et al.  Motor areas of the medial wall: a review of their location and functional activation. , 1996, Cerebral cortex.

[33]  S. Öhman Coarticulation in VCV Utterances: Spectrographic Measurements , 1966 .

[34]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Martin Bachmann,et al.  Disruption of the murine IL-4 gene blocks Th2 cytokine responses , 1993, Nature.

[36]  J. A. Shafer,et al.  Understanding aphasia. , 1954, Archives of Physical Medicine and Rehabilitation.

[37]  A. L. Leiner,et al.  Cognitive and language functions of the human cerebellum , 1993, Trends in Neurosciences.

[38]  G. Dell,et al.  Syllable Structure in Speech Production: Are Syllables Chunks or Schemas? , 1995 .

[39]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[40]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[41]  Vincent J Schmithorst,et al.  Event‐related fMRI technique for auditory processing with hemodynamics unrelated to acoustic gradient noise , 2004, Magnetic resonance in medicine.

[42]  W. Cooper,et al.  Sentence Processing: Psycholinguistic Studies Presented to Merrill Garrett. , 1980 .

[43]  G. Rizzolatti,et al.  Corticocortical connections of area F3 (SMA‐proper) and area F6 (pre‐SMA) in the macaque monkey , 1993, The Journal of comparative neurology.

[44]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[45]  Hermann Ackermann,et al.  The contribution of the insula to motor aspects of speech production: A review and a hypothesis , 2004, Brain and Language.

[46]  J. R. Augustine Circuitry and functional aspects of the insular lobe in primates including humans , 1996, Brain Research Reviews.

[47]  A. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental brain research.

[48]  D Le Bihan,et al.  Postoperative speech disorder after medial frontal surgery , 2003, Neurology.

[49]  R. Turner,et al.  Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[50]  J. Tanji,et al.  Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. , 2000, Journal of neurophysiology.

[51]  Stephen Monsell,et al.  The Latency and Duration of Rapid Movement Sequences: Comparisons of Speech and Typewriting , 1978 .

[52]  Alan C. Evans,et al.  Three-Dimensional MRI Atlas of the Human Cerebellum in Proportional Stereotaxic Space , 1999, NeuroImage.

[53]  M. Honda,et al.  Both primary motor cortex and supplementary motor area play an important role in complex finger movement. , 1993, Brain : a journal of neurology.

[54]  W PENFIELD,et al.  The supplementary motor area of the cerebral cortex; a clinical and experimental study. , 1951, A.M.A. archives of neurology and psychiatry.

[55]  Richard K Peach,et al.  Phonemic characteristics of apraxia of speech resulting from subcortical hemorrhage. , 2004, Journal of communication disorders.

[56]  John E. Desmond,et al.  Load- and practice-dependent increases in cerebro-cerebellar activation in verbal working memory: an fMRI study , 2005, NeuroImage.

[57]  Michael J Brammer,et al.  Functional magnetic resonance imaging of verbal fluency and confrontation naming using compressed image acquisition to permit overt responses , 2003, Human brain mapping.

[58]  W. Grodd,et al.  Differential Contributions of Motor Cortex, Basal Ganglia, and Cerebellum to Speech Motor Control: Effects of Syllable Repetition Rate Evaluated by fMRI , 2001, NeuroImage.

[59]  Bruno B Averbeck,et al.  Parallel processing of serial movements in prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Jeffery A. Jones,et al.  Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory–auditory/orosensory internal models , 2004, NeuroImage.

[61]  Peter F. MacNeilage,et al.  The Production of Speech , 2011, Springer New York.

[62]  Bruce Crosson,et al.  Subcortical functions in language and memory , 1992 .

[63]  S. Lehéricy,et al.  3-D diffusion tensor axonal tracking shows distinct SMA and pre-SMA projections to the human striatum. , 2004, Cerebral cortex.

[64]  Pascal van Lieshout,et al.  Speech Motor Control in Normal and Disordered Speech: Future Developments in Theory and Methodology , 2004 .

[65]  Douglas C. Noll,et al.  Overt Verbal Responding during fMRI Scanning: Empirical Investigations of Problems and Potential Solutions , 1999, NeuroImage.

[67]  F. Flynn,et al.  Anatomy of the insula functional and clinical correlates , 1999 .

[68]  B. Rosen,et al.  Functional mapping of the human visual cortex by magnetic resonance imaging. , 1991, Science.

[69]  G. Schaltenbrand,et al.  The effects on speech and language of stereotactical stimulation in thalamus and corpus callosum , 1975, Brain and Language.

[70]  Stephen Grossberg,et al.  How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades , 2004, Neural Networks.

[71]  M. Erb,et al.  Sensorimotor mapping of the human cerebellum: fMRI evidence of somatotopic organization , 2001, Human brain mapping.

[72]  D. G. MacKay Spoonerisms: the structure of errors in the serial order of speech. , 1970, Neuropsychologia.

[73]  A. Aronson,et al.  Motor Speech Disorders , 2014 .

[74]  M Hallett,et al.  Stimulation over the human supplementary motor area interferes with the organization of future elements in complex motor sequences. , 1997, Brain : a journal of neurology.

[75]  Richard W Briggs,et al.  Left and right basal ganglia and frontal activity during language generation: Contributions to lexical, semantic, and phonological processes , 2003, Journal of the International Neuropsychological Society.

[76]  Robert T. Wertz,et al.  Apraxia of speech in adults: The disorder and its management , 1984 .

[77]  Yasuto Itoyama,et al.  Pure Anarthria with Predominantly Sequencing Errors in Phoneme Articulation: A Case Report , 2001, Cortex.

[78]  Wolfgang Prinz,et al.  Language perception and production , 1987 .

[79]  Nancy Helm Diagnostic and Treatment Issues of Apraxia , 2002 .

[80]  M. D’Esposito,et al.  Functional MRI studies of spatial and nonspatial working memory. , 1998, Brain research. Cognitive brain research.

[81]  J. Shuren,et al.  Insula and aphasia , 2004, Journal of Neurology.

[82]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[83]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[84]  E. Bullmore,et al.  Cerebral regions associated with verbal response initiation, suppression and strategy use , 2000, Neuropsychologia.

[85]  C Büchel,et al.  Brain regions involved in articulation , 1999, The Lancet.

[86]  Angela R Laird,et al.  Cerebellum and auditory function: An ALE meta‐analysis of functional neuroimaging studies , 2005, Human brain mapping.

[87]  Raymond D. Kent Research on speech motor control and its disorders: a review and prospective. , 2000, Journal of communication disorders.

[88]  Kevin Murphy,et al.  Speech production: Wernicke, Broca and beyond. , 2002, Brain : a journal of neurology.

[89]  M. Gazzaniga The new cognitive neurosciences, 2nd edition , 2002 .

[90]  H. Gross Errors in Linguistic Performance: Slips of the Tongue, Ear, Pen, and Hand , 1983 .

[91]  F. Guenther Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[92]  T. J. Grabowski Re-examining the Brain Regions Crucial for Orchestrating Speech Articulation , 2006 .

[93]  Bernhard Müller,et al.  Sparse imaging and continuous event‐related fMRI in the visual domain: A systematic comparison , 2005, Human brain mapping.

[94]  F. Donders,et al.  Over de snelheid van psychische Processen , 1868 .

[95]  Ellen Perecman,et al.  The frontal lobes revisited. , 1987 .

[96]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[97]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[98]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[99]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[100]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[101]  M. McNeil Clinical Management of Sensorimotor Speech Disorders , 2008 .

[102]  J A Fiez,et al.  Neuroimaging studies of speech an overview of techniques and methodological approaches. , 2001, Journal of communication disorders.

[103]  Hermann Ackermann,et al.  Speech deficits in ischaemic cerebellar lesions , 1992, Journal of Neurology.

[104]  S Jonas,et al.  The supplementary motor region and speech emission. , 1981, Journal of communication disorders.

[105]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[106]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[107]  Wolfram Ziegler,et al.  Psycholinguistic and Motor Theories of Apraxia of Speech , 2002, Seminars in speech and language.

[108]  U. Jürgens,et al.  The efferent and afferent connections of the supplementary motor area , 1984, Brain Research.

[109]  Stefanie Shattuck-Hufnagel,et al.  Sublexical Units and Suprasegmental Structure in Speech Production Planning , 1983 .

[110]  R. Ivry,et al.  The role of cerebellar structures in the execution of serial movements. , 1989, Brain : a journal of neurology.

[111]  M. Erb,et al.  fMRI reveals two distinct cerebral networks subserving speech motor control , 2005, Neurology.

[112]  J. Desmond,et al.  Lobular Patterns of Cerebellar Activation in Verbal Working-Memory and Finger-Tapping Tasks as Revealed by Functional MRI , 1997, The Journal of Neuroscience.

[113]  J. Tanji Sequential organization of multiple movements: involvement of cortical motor areas. , 2001, Annual review of neuroscience.

[114]  J Tanji,et al.  Role for cells in the presupplementary motor area in updating motor plans. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[115]  G. Stelmach Information processing in motor control and learning , 1978 .

[116]  J. M. Van Buren,et al.  Confusion and Disturbance of Speech from Stimulation in Vicinity of the Head of the Caudate Nucleus , 1963 .

[117]  Raymond D. Kent,et al.  A speaking task analysis of the dysarthria in cerebellar disease. , 1997, Folia phoniatrica et logopaedica : official organ of the International Association of Logopedics and Phoniatrics.

[118]  Philip Lieberman,et al.  Selective speech motor, syntax and cognitive deficits associated with bilateral damage to the putamen and the head of the caudate nucleus: a case study , 1998, Neuropsychologia.

[119]  H. Ackermann,et al.  Speech rate and rhythm in cerebellar dysarthria: an acoustic analysis of syllabic timing. , 1994, Folia phoniatrica et logopaedica : official organ of the International Association of Logopedics and Phoniatrics.

[120]  Willem J. M. Levelt,et al.  Effects of syllable frequency in speech production , 2006, Cognition.

[121]  Satrajit S. Ghosh,et al.  Region of interest based analysis of functional imaging data , 2003, NeuroImage.

[122]  U Klose,et al.  Functional lateralization of speech production at primary motor cortex: a fMRI study. , 1996, Neuroreport.

[123]  E. Isozaki,et al.  Apraxia of speech associated with an infarct in the precentral gyrus of the insula , 1999, Neuroradiology.

[124]  W. Levelt,et al.  Do speakers have access to a mental syllabary? , 1994, Cognition.

[125]  Aileen K. Ho,et al.  Sequence Heterogeneity in Parkinsonian Speech , 1998, Brain and Language.

[126]  J. Tanji,et al.  A motor area rostral to the supplementary motor area (presupplementary motor area) in the monkey: neuronal activity during a learned motor task. , 1992, Journal of neurophysiology.

[127]  Vincent L. Gracco,et al.  Imaging speech production using fMRI , 2005, NeuroImage.

[128]  J. Ashe,et al.  Anticipatory Activity in Primary Motor Cortex Codes Memorized Movement Sequences , 2005, Neuron.

[129]  V. Braitenberg,et al.  The detection and generation of sequences as a key to cerebellar function: Experiments and theory , 1997, Behavioral and Brain Sciences.

[130]  Stuart T Klapp,et al.  Reaction Time Analysis of Two Types of Motor Preparation for Speech Articulation: Action as a Sequence of Chunks , 2003, Journal of motor behavior.

[131]  Edward E. Smith,et al.  The Role of Parietal Cortex in Verbal Working Memory , 1998, The Journal of Neuroscience.

[132]  Terry M. Peters,et al.  3D statistical neuroanatomical models from 305 MRI volumes , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[133]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[134]  L. Shuster,et al.  An fMRI investigation of covertly and overtly produced mono- and multisyllabic words , 2005, Brain and Language.

[135]  Wolfram Ziegler,et al.  The role of the left mesial frontal cortex in fluent speech: Evidence from a case of left supplementary motor area hemorrhage , 1997, Neuropsychologia.

[136]  R W Cox,et al.  Event‐related fMRI of tasks involving brief motion , 1999, Human brain mapping.

[137]  J. Desmond,et al.  The role of left prefrontal cortex in language and memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[138]  N. Dronkers A new brain region for coordinating speech articulation , 1996, Nature.

[139]  W. Grodd,et al.  Articulatory/Phonetic Sequencing at the Level of the Anterior Perisylvian Cortex: A Functional Magnetic Resonance Imaging (fMRI) Study , 2000, Brain and Language.

[140]  P. MacNeilage,et al.  The frame/content theory of evolution of speech production , 1998, Behavioral and Brain Sciences.

[141]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[142]  R W Cox,et al.  Magnetic field changes in the human brain due to swallowing or speaking , 1998, Magnetic resonance in medicine.

[143]  Frank H. Guenther,et al.  A neural network model of speech acquisition and motor equivalent speech production , 2004, Biological Cybernetics.

[144]  Karl J. Friston,et al.  Conjunction revisited , 2005, NeuroImage.

[145]  M. Molinari,et al.  Verbal short-term store-rehearsal system and the cerebellum. Evidence from a patient with a right cerebellar lesion. , 1998, Brain : a journal of neurology.

[146]  R J Wise,et al.  Cerebral areas associated with motor control of speech in humans. , 1997, Journal of applied physiology.

[147]  E. Auerbach,et al.  Relative Shift in Activity from Medial to Lateral Frontal Cortex During Internally Versus Externally Guided Word Generation , 2001, Journal of Cognitive Neuroscience.

[148]  Cameron S Carter,et al.  Prefrontal Cortex Guides Context-Appropriate Responding during Language Production , 2004, Neuron.

[149]  W. T. Thach,et al.  Basal ganglia intrinsic circuits and their role in behavior , 1993, Current Opinion in Neurobiology.

[150]  K G Munhall,et al.  Functional imaging during speech production. , 2001, Acta psychologica.

[151]  Wolfgang Grodd,et al.  Hemispheric Lateralization Effects of Rhythm Implementation during Syllable Repetitions: An fMRI Study , 2002, NeuroImage.

[152]  H. E. Brown,et al.  Utilizing hemodynamic delay and dispersion to detect fMRI signal change without auditory interference: The behavior interleaved gradients technique , 1999, Magnetic resonance in medicine.

[153]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .