Impact of cognitive performance on the reproducibility of fMRI activation in schizophrenia.

BACKGROUND Longitudinal functional magnetic resonance imaging (fMRI) studies in patients with schizophrenia allow exploration of the course of the illness and brain activity after therapy. A crucial question, however, is whether fMRI findings are reliable, because they can be affected by performance deficits in patients with schizophrenia. Our aim was to evaluate the reproducibility of fMRI activations in highly integrated language areas in patients with schizophrenia, taking into account task performance. METHODS Ten patients with schizophrenia and 10 matched healthy controls were scanned twice, 21 months apart, while performing a story comprehension task. The reproducibility of the activations in each participant was evaluated globally by the percentage of spatial overlap between the 2 sessions and locally by a voxel-wise computation of the between-session relative standard deviation. We performed between-group comparisons both with and without the inclusion of comprehension scores (measuring task performance) as a covariate. RESULTS On average, patients with schizophrenia had significantly lower comprehension scores than controls (4.5/12 v. 7.8/12, p = 0.002). The mean spatial overlap between fMRI sessions was 30.6% in the patient group and 47.0% in the control group (p = 0.017). Locally, the lower reproducibility in patients was most prominent in the left posterior middle temporal gyrus, inferior frontal gyrus and medial prefrontal cortex (p < 0.001 uncorrected for multiple comparisons). Comprehension scores were positively correlated with both reproducibility measures in patients (overlap: r = 0.82, p = 0.004; relative standard deviation: several significant clusters at p < 0.001). When we included the comprehension scores as a covariate, most of the local between-group differences in reproducibility were removed, and the difference in overlap was not significant. LIMITATIONS Owing to the small sample size, we could not investigate the impact of clinical subtypes and different types of medications on reproducibility. CONCLUSION Our findings suggest that the greater variability in activation in patients with schizophrenia compared with controls concerns high-level areas and is mainly attributable to deficient task performance. Consequently, cognitive performance must be carefully controlled when longitudinal fMRI studies are undertaken.

[1]  R. Corcoran Inductive reasoning and the understanding of intention in schizophrenia , 2003, Cognitive neuropsychiatry.

[2]  Jacquie Kurland,et al.  Test-Retest Reliability of fMRI During Nonverbal Semantic Decisions in Moderate-Severe Nonfluent Aphasia Patients , 2005, Behavioural neurology.

[3]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[4]  Nick F. Ramsey,et al.  Test–retest reliability of fMRI activation during prosaccades and antisaccades , 2007, NeuroImage.

[5]  Andreas Heinz,et al.  Switching schizophrenia patients from typical neuroleptics to olanzapine: Effects on BOLD response during attention and working memory , 2008, European Neuropsychopharmacology.

[6]  C. Fahim,et al.  Restoration of frontal activation during a treatment with quetiapine: an fMRI study of blunted affect in schizophrenia , 2005, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[7]  Ellen Vos,et al.  Theory of mind in schizophrenia: meta-analysis. , 2007, The British journal of psychiatry : the journal of mental science.

[8]  Charles R. G. Guttmann,et al.  Functional MRI of auditory verbal working memory: long-term reproducibility analysis , 2004, NeuroImage.

[9]  J. A. Frost,et al.  Language dominance in neurologically normal and epilepsy subjects , 1999 .

[10]  S. Rombouts,et al.  Test-retest analysis with functional MR of the activated area in the human visual cortex. , 1997, AJNR. American journal of neuroradiology.

[11]  Enrico Simonotto,et al.  Repeatability of motor and working-memory tasks in healthy older volunteers: assessment at functional MR imaging. , 2004, Radiology.

[12]  Joseph A Maldjian,et al.  Multiple reproducibility indices for evaluation of cognitive functional MR imaging paradigms. , 2002, AJNR. American journal of neuroradiology.

[13]  M. First,et al.  The Structured Clinical Interview for DSM-III-R (SCID). I: History, rationale, and description. , 1992, Archives of general psychiatry.

[14]  Steven L. Small,et al.  Test–retest reliability in fMRI of language: Group and task effects , 2007, Brain and Language.

[15]  T. Parrish,et al.  Neural activity of inferences during story comprehension , 2006, Brain Research.

[16]  Tyrone D. Cannon,et al.  A follow-up magnetic resonance imaging study of schizophrenia. Relationship of neuroanatomical changes to clinical and neurobehavioral measures. , 1998, Archives of general psychiatry.

[17]  C. Terwee,et al.  When to use agreement versus reliability measures. , 2006, Journal of clinical epidemiology.

[18]  P. Renshaw,et al.  Functional magnetic resonance imaging studies of schizophrenic patients during word production: effects of d-cycloserine , 2005, Psychiatry Research: Neuroimaging.

[19]  Evelyn C. Ferstl,et al.  What Does the Frontomedian Cortex Contribute to Language Processing: Coherence or Theory of Mind? , 2002, NeuroImage.

[20]  Jing Z. Liu,et al.  Reproducibility of fMRI at 1.5 T in a strictly controlled motor task , 2004, Magnetic resonance in medicine.

[21]  S. Kay,et al.  The positive and negative syndrome scale (PANSS) for schizophrenia. , 1987, Schizophrenia bulletin.

[22]  K. Kiehl,et al.  Reproducibility of the hemodynamic response to auditory oddball stimuli: A six‐week test–retest study , 2003, Human brain mapping.

[23]  P F Liddle,et al.  Changes in distributed neural circuitry function in patients with first-episode schizophrenia , 2004, British Journal of Psychiatry.

[24]  Russell A. Poldrack,et al.  Long-term test–retest reliability of functional MRI in a classification learning task , 2006, NeuroImage.

[25]  M. Buonocore,et al.  Intrasubject reproducibility of functional MR imaging activation in language tasks. , 2006, AJNR. American journal of neuroradiology.

[26]  Jiang Xu,et al.  Language in context: emergent features of word, sentence, and narrative comprehension , 2005, NeuroImage.

[27]  S. Rauch,et al.  Schizophrenic subjects show aberrant fMRI activation of dorsolateral prefrontal cortex and basal ganglia during working memory performance , 2000, Biological Psychiatry.

[28]  B. Mazoyer,et al.  Stability of functional language lateralization over time in schizophrenia patients , 2007, Schizophrenia Research.

[29]  Marc Laruelle,et al.  Functional neuroimaging and electrophysiology biomarkers for clinical trials for cognition in schizophrenia. , 2005, Schizophrenia bulletin.

[30]  S. Lawrie,et al.  fMRI changes over time and reproducibility in unmedicated subjects at high genetic risk of schizophrenia , 2008, Psychological Medicine.

[31]  T. V. van Erp,et al.  Reproducibility of visual activation in functional MR imaging and effects of postprocessing. , 2000, AJNR. American journal of neuroradiology.

[32]  G. Fesl,et al.  Reproducibility of activation in four motor paradigms , 2006, Journal of Neurology.

[33]  C. Dickey,et al.  Long-Term Reproducibility Analysis of Fmri using Hand Motor Task , 2005, The International journal of neuroscience.

[34]  J. Callicott,et al.  Functional lateralization of the sensorimotor cortex in patients with schizophrenia: effects of treatment with olanzapine , 2004, Biological Psychiatry.

[35]  N Jon Shah,et al.  Assessment of reliability in functional imaging studies , 2003, Journal of magnetic resonance imaging : JMRI.

[36]  N. F. Ramsey,et al.  Reproducibility of fMRI-Determined Language Lateralization in Individual Subjects , 2002, Brain and Language.

[37]  R. Mar The neuropsychology of narrative: story comprehension, story production and their interrelation , 2004, Neuropsychologia.

[38]  Lisa T. Eyler,et al.  Review of longitudinal functional neuroimaging studies of drug treatments in patients with schizophrenia , 2005, Schizophrenia Research.

[39]  F. Chollet,et al.  Within-Session and Between-Session Reproducibility of Cerebral Sensorimotor Activation: A Test–Retest Effect Evidenced with Functional Magnetic Resonance Imaging , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[40]  E. Bullmore,et al.  Differences in frontal cortical activation by a working memory task after substitution of risperidone for typical antipsychotic drugs in patients with schizophrenia. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Karl J. Friston,et al.  Variability in fMRI: An Examination of Intersession Differences , 2000, NeuroImage.

[42]  B. Mazoyer,et al.  Atypical hemispheric specialization for language in right-handed schizophrenia patients , 2005, Biological Psychiatry.

[43]  Sylvie Belleville,et al.  Test–retest reliability of fMRI verbal episodic memory paradigms in healthy older adults and in persons with mild cognitive impairment , 2009, Human brain mapping.

[44]  Mark Hallett,et al.  The variability of serial fMRI data: Correlation between a visual and a motor task , 2000, Neuroreport.

[45]  Dc Washington Diagnostic and Statistical Manual of Mental Disorders, 4th Ed. , 1994 .

[46]  S. Rauch,et al.  Test-retest reliability of a functional MRI working memory paradigm in normal and schizophrenic subjects. , 2001, The American journal of psychiatry.

[47]  Andreas Schulze-Bonhage,et al.  The reliability of fMRI activations in the medial temporal lobes in a verbal episodic memory task , 2005, NeuroImage.

[48]  Stephen M Smith,et al.  Variability in fMRI: A re‐examination of inter‐session differences , 2005, Human brain mapping.

[49]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[50]  R. Cox,et al.  Test-retest precision of functional MR in sensory and motor task activation. , 1996, AJNR. American journal of neuroradiology.

[51]  Nathalie Tzourio-Mazoyer,et al.  Reproducibility of fMRI activations during a story listening task in patients with schizophrenia , 2011, Schizophrenia Research.

[52]  Gabriele Lohmann,et al.  Within-subject variability of BOLD response dynamics , 2003, NeuroImage.

[53]  T. Kimberley,et al.  Reliability of fMRI during a Continuous Motor Task: Assessment of Analysis Techniques , 2008, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[54]  S. Rombouts,et al.  Within-subject reproducibility of visual activation patterns with functional magnetic resonance imaging using multislice echo planar imaging. , 1998, Magnetic resonance imaging.

[55]  J. Fell,et al.  Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI , 2003, Neurology.

[56]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[57]  M E Meyerand,et al.  Reliability of functional MR imaging with word-generation tasks for mapping Broca's area. , 2001, AJNR. American journal of neuroradiology.

[58]  Jonathan D. Cohen,et al.  Lateral and medial hypofrontality in first-episode schizophrenia: functional activity in a medication-naive state and effects of short-term atypical antipsychotic treatment. , 2005, The American journal of psychiatry.

[59]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[60]  M. Brammer,et al.  Effects on the brain of a psychological treatment: cognitive remediation therapy: functional magnetic resonance imaging in schizophrenia. , 2002, The British journal of psychiatry : the journal of mental science.

[61]  Stefan Knecht,et al.  How atypical is atypical language dominance? , 2003, NeuroImage.

[62]  J C Gore,et al.  Preliminary evidence of improved verbal working memory performance and normalization of task-related frontal lobe activation in schizophrenia following cognitive exercises. , 2000, The American journal of psychiatry.

[63]  F Barkhof,et al.  fMRI of visual encoding: Reproducibility of activation , 1999, Human brain mapping.

[64]  Irene Tracey,et al.  Quantitative assessment of the reproducibility of functional activation measured with BOLD and MR perfusion imaging: Implications for clinical trial design , 2005, NeuroImage.

[65]  Abraham Z Snyder,et al.  Reliability of functional localization using fMRI , 2003, NeuroImage.

[66]  Xingbao Li,et al.  Augmenting Atypical Antipsychotics with a Cognitive Enhancer (Donepezil) Improves Regional Brain Activity in Schizophrenia Patients: A Pilot Double-blind Placebo Controlled BOLD fMRI Study , 2003, Neurocase.

[67]  Richard S. J. Frackowiak,et al.  Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension , 1995, Cognition.

[68]  Scott T. Grafton,et al.  Extensive Individual Differences in Brain Activations Associated with Episodic Retrieval are Reliable Over Time , 2002, Journal of Cognitive Neuroscience.

[69]  U. Habel,et al.  Stability of emotional dysfunctions? A long-term fMRI study in first-episode schizophrenia. , 2007, Journal of psychiatric research.

[70]  H. Brückmann,et al.  Effects of treatment with the atypical neuroleptic quetiapine on working memory function: a functional MRI follow-up investigation , 2006, European Archives of Psychiatry and Clinical Neuroscience.