Short- and long-term reliability of language fMRI

ABSTRACT When using functional magnetic resonance imaging (fMRI) for mapping important language functions, a high test‐retest reliability is mandatory, both in basic scientific research and for clinical applications. We, therefore, systematically tested the short‐ and long‐term reliability of fMRI in a group of healthy subjects using a picture naming task and a sparse‐sampling fMRI protocol. We hypothesized that test‐retest reliability might be higher for (i) speech‐related motor areas than for other language areas and for (ii) the short as compared to the long intersession interval. 16 right‐handed subjects (mean age: 29 years) participated in three sessions separated by 2–6 (session 1 and 2, short‐term) and 21–34 days (session 1 and 3, long‐term). Subjects were asked to perform the same overt picture naming task in each fMRI session (50 black‐white images per session). Reliability was tested using the following measures: (i) Euclidean distances (ED) between local activation maxima and Centers of Gravity (CoGs), (ii) overlap volumes and (iii) voxel‐wise intraclass correlation coefficients (ICCs). Analyses were performed for three regions of interest which were chosen based on whole‐brain group data: primary motor cortex (M1), superior temporal gyrus (STG) and inferior frontal gyrus (IFG). Our results revealed that the activation centers were highly reliable, independent of the time interval, ROI or hemisphere with significantly smaller ED for the local activation maxima (6.45 Symbol 1.36mm) as compared to the CoGs (8.03 Symbol 2.01mm). In contrast, the extent of activation revealed rather low reliability values with overlaps ranging from 24% (IFG) to 56% (STG). Here, the left hemisphere showed significantly higher overlap volumes than the right hemisphere. Although mean ICCs ranged between poor (ICC<0.5) and moderate (ICC 0.5–0.74) reliability, highly reliable voxels (ICC>0.75) were found for all ROIs. Voxel‐wise reliability of the different ROIs was influenced by the intersession interval. Symbol. No caption available. Symbol. No caption available. Taken together, we could show that, despite of considerable ROI‐dependent variations of the extent of activation over time, highly reliable centers of activation can be identified using an overt picture naming paradigm.

[1]  Andreas Hennenlotter,et al.  The functional neuroanatomy of coordinated orofacial movements: Sparse sampling fMRI of whistling , 2005, NeuroImage.

[2]  John Duncan,et al.  The role of the right inferior frontal gyrus: inhibition and attentional control , 2010, NeuroImage.

[3]  Christian Grefkes,et al.  Mapping the hand, foot and face representations in the primary motor cortex — Retest reliability of neuronavigated TMS versus functional MRI , 2013, NeuroImage.

[4]  L. Portney,et al.  Foundations of Clinical Research: Applications to Practice , 2015 .

[5]  J. Fell,et al.  Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI , 2003, Neurology.

[6]  Mark E. Bastin,et al.  Single subject fMRI test–retest reliability metrics and confounding factors , 2013, NeuroImage.

[7]  H. E. Brown,et al.  Utilizing hemodynamic delay and dispersion to detect fMRI signal change without auditory interference: The behavior interleaved gradients technique , 1999, Magnetic resonance in medicine.

[8]  Santosh S Gupta.  fMRI for mapping language networks in neurosurgical cases , 2014, Indian Journal of Radiology and Imaging.

[9]  Susan Bookheimer,et al.  Pre-Surgical Language Mapping with Functional Magnetic Resonance Imaging , 2007, Neuropsychology Review.

[10]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[11]  E. Wassermann.  Risk and safety of repetitive transcranial magnetic stimulation: report and suggested guidelines from the International Workshop on the Safety of Repetitive Transcranial Magnetic Stimulation, June 5-7, 1996. , 1998, Electroencephalography and clinical neurophysiology.

[12]  Yves Rosseel,et al.  On the Definition of Signal-To-Noise Ratio and Contrast-To-Noise Ratio for fMRI Data , 2013, PloS one.

[13]  D. Gow.  The cortical organization of lexical knowledge: A dual lexicon model of spoken language processing , 2012, Brain and Language.

[14]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[15]  Kevin Murphy,et al.  How long to scan? The relationship between fMRI temporal signal to noise ratio and necessary scan duration , 2007, NeuroImage.

[16]  Josef P. Rauschecker,et al.  Functional Topography of Human Auditory Cortex , 2016, The Journal of Neuroscience.

[17]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[18]  Dave R. M. Langers,et al.  Robustness of intrinsic connectivity networks in the human brain to the presence of acoustic scanner noise , 2011, NeuroImage.

[19]  T. Sørensen,et al.  A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on Danish commons , 1948 .

[20]  Jason M. Johnson,et al.  Accuracy of Presurgical Functional MR Imaging for Language Mapping of Brain Tumors: A Systematic Review and Meta-Analysis. , 2017, Radiology.

[21]  David Poeppel,et al.  Pure word deafness and the bilateral processing of the speech code , 2001, Cogn. Sci..

[22]  Ernst Nennig,et al.  Localizing and lateralizing language in patients with brain tumors: feasibility of routine preoperative functional MR imaging in 81 consecutive patients. , 2007, Radiology.

[23]  Klaus Scheffler,et al.  fMRI of the auditory system: understanding the neural basis of auditory gestalt. , 2003, Magnetic resonance imaging.

[24]  Jonathan E. Peelle,et al.  Methodological challenges and solutions in auditory functional magnetic resonance imaging , 2014, Front. Neurosci..

[25]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[26]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[27]  Thomas M. Talavage,et al.  Reproducibility of fMRI activations associated with auditory sentence comprehension , 2011, NeuroImage.

[28]  N. Kanwisher,et al.  New method for fMRI investigations of language: defining ROIs functionally in individual subjects. , 2010, Journal of neurophysiology.

[29]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[30]  J. Desmond,et al.  Functional Specialization for Semantic and Phonological Processing in the Left Inferior Prefrontal Cortex , 1999, NeuroImage.

[31]  W. Penfield.  The Cerebral Cortex of Man , 1950 .

[32]  C. Brennan,et al.  Assessment of the Language Laterality Index in Patients with Brain Tumor Using Functional MR Imaging: Effects of Thresholding, Task Selection, and Prior Surgery , 2008, American Journal of Neuroradiology.

[33]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[34]  Thomas Picht,et al.  The value of preoperative functional cortical mapping using navigated TMS , 2016, Neurophysiologie Clinique/Clinical Neurophysiology.

[35]  N. F. Ramsey,et al.  Combined Analysis of Language Tasks in fMRI Improves Assessment of Hemispheric Dominance for Language Functions in Individual Subjects , 2001, NeuroImage.

[36]  Mathijs Raemaekers,et al.  Task and task‐free FMRI reproducibility comparison for motor network identification , 2014, Human brain mapping.

[37]  Simon J Graham,et al.  Reliability of Task-Based fMRI for Preoperative Planning: A Test-Retest Study in Brain Tumor Patients and Healthy Controls , 2016, PloS one.

[38]  J. Gore,et al.  Measurements of the Temporal fMRI Response of the Human Auditory Cortex to Trains of Tones , 1998, NeuroImage.

[39]  Mark E. Bastin,et al.  Adaptive thresholding for reliable topological inference in single subject fMRI analysis , 2012, Front. Hum. Neurosci..

[40]  A. Papanicolaou,et al.  Reliability and Validity of Functional Neuroimaging Techniques for Identifying Language-Critical Areas in Children and Adults , 2004, Developmental neuropsychology.

[41]  Steve C R Williams,et al.  Acoustic noise and functional magnetic resonance imaging: Current strategies and future prospects , 2002, Journal of magnetic resonance imaging : JMRI.

[42]  T. L. Davis,et al.  Language dominance determined by whole brain functional MRI in patients with brain lesions , 1999, Neurology.

[43]  Scott Holland,et al.  Reliability of fMRI for studies of language in post-stroke aphasia subjects , 2008, NeuroImage.

[44]  Michael B. Miller,et al.  fMRI reliability: Influences of task and experimental design , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[45]  Alan C. Evans,et al.  Event-Related fMRI of the Auditory Cortex , 1998, NeuroImage.

[46]  M. Buonocore,et al.  Intrasubject reproducibility of functional MR imaging activation in language tasks. , 2006, AJNR. American journal of neuroradiology.

[47]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[48]  Angela R Laird,et al.  Meta‐analyses of object naming: Effect of baseline , 2005, Human brain mapping.

[49]  T. Carr,et al.  Comparing cortical activations for silent and overt speech using event‐related fMRI , 2002, Human brain mapping.

[50]  A. Friederici.  The brain basis of language processing: from structure to function. , 2011, Physiological reviews.

[51]  Asaid Khateb,et al.  Variability of fMRI activation during a phonological and semantic language task in healthy subjects , 2004, Human brain mapping.

[52]  Raimi L. Quiton,et al.  Intersession reliability of fMRI activation for heat pain and motor tasks , 2014, NeuroImage: Clinical.

[53]  Allen R. Braun,et al.  Strategies for longitudinal neuroimaging studies of overt language production , 2009, NeuroImage.

[54]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[55]  M E Meyerand,et al.  Reliability of functional MR imaging with word-generation tasks for mapping Broca's area. , 2001, AJNR. American journal of neuroradiology.

[56]  Christoph Stippich,et al.  Presurgical motor, somatosensory and language fMRI: Technical feasibility and limitations in 491 patients over 13 years , 2016, European Radiology.

[57]  Diana L Miglioretti,et al.  Cortical Sites Critical for Speech Discrimination in Normal and Impaired Listeners , 2005, The Journal of Neuroscience.

[58]  H Duffau,et al.  Awake brain mapping of cortex and subcortical pathways in brain tumor surgery. , 2014, Journal of neurosurgical sciences.

[59]  S. Rombouts,et al.  Test-retest analysis with functional MR of the activated area in the human visual cortex. , 1997, AJNR. American journal of neuroradiology.

[60]  Stephen M. Wilson,et al.  Validity and reliability of four language mapping paradigms , 2016, NeuroImage: Clinical.

[61]  Marion Smits,et al.  Functional MR imaging of language processing: an overview of easy-to-implement paradigms for patient care and clinical research. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[62]  M Tynan R Stevens,et al.  Improving fMRI reliability in presurgical mapping for brain tumours , 2015, Journal of Neurology, Neurosurgery & Psychiatry.

[63]  I. Kaufman.  The Cerebral Cortex of Man: A Clinical Study of Localization of Function , 1951 .

[64]  E. Nam,et al.  Effects of scanner acoustic noise on intrinsic brain activity during auditory stimulation , 2015, Neuroradiology.

[65]  R. Töpper,et al.  The neural correlate of very‐long‐term picture priming , 2005, The European journal of neuroscience.

[66]  M. Wiesmann,et al.  Sensitivity and reliability of language laterality assessment with a free reversed association task—a fMRI study , 2010, European Radiology.

[67]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[68]  J. Tonn,et al.  Reproducibility of Activations in Broca Area with Two Language Tasks: A Functional MR Imaging Study , 2007, American Journal of Neuroradiology.

[69]  J. Binder,et al.  Functional magnetic resonance imaging of human auditory cortex , 1994, Annals of neurology.

[70]  A. Braun,et al.  Comparison of continuous overt speech fMRI using BOLD and arterial spin labeling , 2005, Human brain mapping.

[71]  Vincent L. Gracco,et al.  Imaging speech production using fMRI , 2005, NeuroImage.

[72]  Joseph A Maldjian,et al.  Multiple reproducibility indices for evaluation of cognitive functional MR imaging paradigms. , 2002, AJNR. American journal of neuroradiology.

[73]  H. Duffau,et al.  Intraoperative electrical stimulation in awake craniotomy: methodological aspects of current practice. , 2010, Neurosurgical focus.

[74]  N. F. Ramsey,et al.  Reproducibility of fMRI-Determined Language Lateralization in Individual Subjects , 2002, Brain and Language.

[75]  Peter Hagoort,et al.  The neurobiology of language beyond single words. , 2014, Annual review of neuroscience.

[76]  Emmanuel Mellet,et al.  Picture naming without Broca's and Wernicke's area , 2000, Neuroreport.

[77]  Simon B. Eickhoff,et al.  Differential modulation of motor network connectivity during movements of the upper and lower limbs , 2015, NeuroImage.

[78]  Alex Martin,et al.  Modulation of neural activity during object naming: effects of time and practice. , 2003, Cerebral cortex.