A study of long‐term fMRI reproducibility using data‐driven analysis methods

The reproducibility of functional magnetic resonance imaging (fMRI) is important for fMRI‐based neuroscience research and clinical applications. Previous studies show considerable variation in amplitude and spatial extent of fMRI activation across repeated sessions on individual subjects even using identical experimental paradigms and imaging conditions. Most existing fMRI reproducibility studies were typically limited by time duration and data analysis techniques. Particularly, the assessment of reproducibility is complicated by a fact that fMRI results may depend on data analysis techniques used in reproducibility studies. In this work, the long‐term fMRI reproducibility was investigated with a focus on the data analysis methods. Two spatial smoothing techniques, including a wavelet‐domain Bayesian method and the Gaussian smoothing, were evaluated in terms of their effects on the long‐term reproducibility. A multivariate support vector machine (SVM)‐based method was used to identify active voxels, and compared to a widely used general linear model (GLM)‐based method at the group level. The reproducibility study was performed using multisession fMRI data acquired from eight healthy adults over 1.5 years' period of time. Three regions‐of‐interest (ROI) related to a motor task were defined based upon which the long‐term reproducibility were examined. Experimental results indicate that different spatial smoothing techniques may lead to different reproducibility measures, and the wavelet‐based spatial smoothing and SVM‐based activation detection is a good combination for reproducibility studies. On the basis of the ROIs and multiple numerical criteria, we observed a moderate to substantial within‐subject long‐term reproducibility. A reasonable long‐term reproducibility was also observed from the inter‐subject study. It was found that the short‐term reproducibility is usually higher than the long‐term reproducibility. Furthermore, the results indicate that brain regions with high contrast‐to‐noise ratio do not necessarily exhibit high reproducibility. These findings may provide supportive information for optimal design/implementation of fMRI studies and data interpretation.

[1]  N Jon Shah,et al.  Assessment of reliability in functional imaging studies , 2003, Journal of magnetic resonance imaging : JMRI.

[2]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[3]  Gerard J. den Heeten,et al.  Functional magnetic resonance imaging for neurosurgical planning in neurooncology , 2004, European Radiology.

[4]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[5]  Karl J. Friston,et al.  Variability in fMRI: An Examination of Intersession Differences , 2000, NeuroImage.

[6]  Yingli Lu,et al.  Regional homogeneity approach to fMRI data analysis , 2004, NeuroImage.

[7]  John Suckling,et al.  Brain Imaging Correlates of Depressive Symptom Severity and Predictors of Symptom Improvement After Antidepressant Treatment , 2007, Biological Psychiatry.

[8]  Peter Kirsch,et al.  Test–retest reliability of evoked BOLD signals from a cognitive–emotive fMRI test battery , 2012, NeuroImage.

[9]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[10]  Jing Z. Liu,et al.  Reproducibility of fMRI at 1.5 T in a strictly controlled motor task , 2004, Magnetic resonance in medicine.

[11]  S. Rombouts,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[12]  Mathijs Raemaekers,et al.  Task and task‐free FMRI reproducibility comparison for motor network identification , 2014, Human brain mapping.

[13]  Xiaomu Song,et al.  Spatiotemporal Denoising and Clustering of fMRI Data , 2006, 2006 International Conference on Image Processing.

[14]  Tomaso A. Poggio,et al.  Image Representations and Feature Selection for Multimedia Database Search , 2003, IEEE Trans. Knowl. Data Eng..

[15]  Belur V. Dasarathy,et al.  Nearest Neighbour Editing and Condensing Tools–Synergy Exploitation , 2000, Pattern Analysis & Applications.

[16]  S. Rombouts,et al.  Test-retest analysis with functional MR of the activated area in the human visual cortex. , 1997, AJNR. American journal of neuroradiology.

[17]  Nick F. Ramsey,et al.  Test–retest reliability of fMRI activation during prosaccades and antisaccades , 2007, NeuroImage.

[18]  R S Menon,et al.  Investigation of BOLD contrast in fMRI using multi‐shot EPI , 1997, NMR in biomedicine.

[19]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[20]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[21]  C. Dickey,et al.  Long-Term Reproducibility Analysis of Fmri using Hand Motor Task , 2005, The International journal of neuroscience.

[22]  Godfried T. Toussaint,et al.  Relative neighborhood graphs and their relatives , 1992, Proc. IEEE.

[23]  Jos B. T. M. Roerdink,et al.  Denoising functional MR images: a comparison of wavelet denoising and Gaussian smoothing , 2004, IEEE Transactions on Medical Imaging.

[24]  Mark W. Woolrich,et al.  Bayesian analysis of neuroimaging data in FSL , 2009, NeuroImage.

[25]  Leslie G. Ungerleider,et al.  The acquisition of skilled motor performance: fast and slow experience-driven changes in primary motor cortex. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Xiaomu Song,et al.  Unsupervised spatiotemporal fMRI data analysis using support vector machines , 2009, NeuroImage.

[27]  Stephen M. Smith,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[28]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[29]  Keith R Thulborn,et al.  Reproducibility of activation maps for longitudinal studies of visual function by functional magnetic resonance imaging. , 2012, Investigative ophthalmology & visual science.

[30]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[31]  S. Strother,et al.  Reproducibility of BOLD‐based functional MRI obtained at 4 T , 1999, Human brain mapping.

[32]  James T Voyvodic,et al.  fMRI activation mapping as a percentage of local excitation: Consistent presurgical motor maps without threshold adjustment , 2009, Journal of magnetic resonance imaging : JMRI.

[33]  Russell A. Poldrack,et al.  Long-term test–retest reliability of functional MRI in a classification learning task , 2006, NeuroImage.

[34]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[35]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[36]  Charles R. G. Guttmann,et al.  Functional MRI of auditory verbal working memory: long-term reproducibility analysis , 2004, NeuroImage.

[37]  M. Fox,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .