Within-subject variation in BOLD-fMRI signal changes across repeated measurements: Quantification and implications for sample size

Functional magnetic resonance imaging (fMRI) can be used to detect experimental effects on brain activity across measurements. The success of such studies depends on the size of the experimental effect, the reliability of the measurements, and the number of subjects. Here, we report on the stability of fMRI measurements and provide sample size estimations needed for repeated measurement studies. Stability was quantified in terms of the within-subject standard deviation (sigma(w)) of BOLD signal changes across measurements. In contrast to correlation measures of stability, this statistic does not depend on the between-subjects variance in the sampled group. Sample sizes required for repeated measurements of the same subjects were calculated using this sigma(w). Ten healthy subjects performed a motor task on three occasions, separated by one week, while being scanned. In order to exclude training effects on fMRI stability, all subjects were trained extensively on the task. Task performance, spatial activation pattern, and group-wise BOLD signal changes were highly stable over sessions. In contrast, we found substantial fluctuations (up to half the size of the group mean activation level) in individual activation levels, both in ROIs and in voxels. Given this large degree of instability over sessions, and the fact that the amount of within-subject variation plays a crucial role in determining the success of an fMRI study with repeated measurements, improving stability is essential. In order to guide future studies, sample sizes are provided for a range of experimental effects and levels of stability. Obtaining estimates of these latter two variables is essential for selecting an appropriate number of subjects.

[1]  Irene Tracey,et al.  Quantitative assessment of the reproducibility of functional activation measured with BOLD and MR perfusion imaging: Implications for clinical trial design , 2005, NeuroImage.

[2]  Paul J. Laurienti,et al.  Dietary Caffeine Consumption Modulates fMRI Measures , 2002, NeuroImage.

[3]  S. Petersen,et al.  The effects of practice on the functional anatomy of task performance. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Charles R. G. Guttmann,et al.  Functional MRI of auditory verbal working memory: long-term reproducibility analysis , 2004, NeuroImage.

[5]  J. Detre,et al.  Perfusion functional MRI reveals cerebral blood flow pattern under psychological stress. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Nick F. Ramsey,et al.  Test–retest reliability of fMRI activation during prosaccades and antisaccades , 2007, NeuroImage.

[7]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[8]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[9]  F. Hsu,et al.  Effects of a single dose of cortisol on the neural correlates of episodic memory and error processing in healthy volunteers , 2003, Psychopharmacology.

[10]  R. Kahn,et al.  Function of striatum beyond inhibition and execution of motor responses , 2005, Human brain mapping.

[11]  D. Weinberger,et al.  Three-dimensional functional magnetic resonance imaging of human brain on a clinical 1.5-T scanner. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[12]  S. Julious Sample sizes for clinical trials with Normal data , 2004, Statistics in medicine.

[13]  S. Rauch,et al.  Test-retest reliability of a functional MRI working memory paradigm in normal and schizophrenic subjects. , 2001, The American journal of psychiatry.

[14]  Amir Raz,et al.  Ecological nuances in functional magnetic resonance imaging (fMRI): psychological stressors, posture, and hydrostatics , 2005, NeuroImage.

[15]  K. Scheffler,et al.  Effect of ethanol on BOLD response to acoustic stimulation: implications for neuropharmacological fMRI , 2000, Psychiatry Research: Neuroimaging.

[16]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[17]  S. Strother,et al.  Reproducibility of BOLD‐based functional MRI obtained at 4 T , 1999, Human brain mapping.

[18]  D. Sheehan,et al.  The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. , 1998, The Journal of clinical psychiatry.

[19]  F. Chollet,et al.  Fluoxetine modulates motor performance and cerebral activation of patients recovering from stroke , 2001, Annals of neurology.

[20]  Karl J. Friston,et al.  Variability in fMRI: An Examination of Intersession Differences , 2000, NeuroImage.

[21]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[22]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[23]  Stephen M Smith,et al.  Variability in fMRI: A re‐examination of inter‐session differences , 2005, Human brain mapping.

[24]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[25]  Stephan Hamann,et al.  Cortisol responses of healthy volunteers undergoing magnetic resonance imaging , 2006, Human brain mapping.

[26]  A. Kelly,et al.  Human functional neuroimaging of brain changes associated with practice. , 2005, Cerebral cortex.

[27]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[28]  R. Poldrack Imaging Brain Plasticity: Conceptual and Methodological Issues— A Theoretical Review , 2000, NeuroImage.

[29]  C. Genovese,et al.  Estimating test‐retest reliability in functional MR imaging I: Statistical methodology , 1997, Magnetic resonance in medicine.

[30]  J. Fell,et al.  Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI , 2003, Neurology.

[31]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[32]  G. Glover,et al.  Physiological noise in oxygenation‐sensitive magnetic resonance imaging , 2001, Magnetic resonance in medicine.

[33]  J. Meléndez,et al.  Anxiety-related reactions associated with magnetic resonance imaging examinations. , 1993, JAMA.

[34]  Gary H Glover,et al.  Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses , 2002, Journal of Neuroscience Methods.

[35]  Irene Tracey,et al.  Resting fluctuations in arterial carbon dioxide induce significant low frequency variations in BOLD signal , 2004, NeuroImage.

[36]  Peter Kirsch,et al.  Oxytocin Modulates Neural Circuitry for Social Cognition and Fear in Humans , 2005, The Journal of Neuroscience.

[37]  R. Kahn,et al.  Striatal Dysfunction in Schizophrenia and Unaffected Relatives , 2006, Biological Psychiatry.

[38]  Michael F Egan,et al.  Tolcapone Improves Cognition and Cortical Information Processing in Normal Human Subjects , 2007, Neuropsychopharmacology.

[39]  Enrico Simonotto,et al.  Repeatability of motor and working-memory tasks in healthy older volunteers: assessment at functional MR imaging. , 2004, Radiology.

[40]  M S Cohen,et al.  Stability, repeatability, and the expression of signal magnitude in functional magnetic resonance imaging , 1999, Journal of magnetic resonance imaging : JMRI.

[41]  J. Haxby,et al.  Localization of Cardiac-Induced Signal Change in fMRI , 1999, NeuroImage.

[42]  Thomas T. Liu,et al.  A component based noise correction method (CompCor) for BOLD and perfusion based fMRI , 2007, NeuroImage.

[43]  N Jon Shah,et al.  Assessment of reliability in functional imaging studies , 2003, Journal of magnetic resonance imaging : JMRI.

[44]  C. Dickey,et al.  Long-Term Reproducibility Analysis of Fmri using Hand Motor Task , 2005, The International journal of neuroscience.

[45]  K. McGraw,et al.  "Forming inferences about some intraclass correlations coefficients": Correction. , 1996 .

[46]  D. Altman,et al.  A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. , 1990, Computers in biology and medicine.

[47]  T. Hergueta,et al.  The mini international neuropsychiatric interview , 1998, European Psychiatry.

[48]  Russell A. Poldrack,et al.  Long-term test–retest reliability of functional MRI in a classification learning task , 2006, NeuroImage.

[49]  Jeff H. Duyn,et al.  An adaptive filter for suppression of cardiac and respiratory noise in MRI time series data , 2006, NeuroImage.

[50]  G. Logan On the ability to inhibit thought and action , 1984 .

[51]  Alan C. Evans,et al.  A general statistical analysis for fMRI data , 2000, NeuroImage.