Accurate autocorrelation modeling substantially improves fMRI reliability

Given the recent controversies in some neuroimaging statistical methods, we compare the most frequently used functional Magnetic Resonance Imaging (fMRI) analysis packages: AFNI, FSL and SPM, with regard to temporal autocorrelation modeling. This process, sometimes known as pre-whitening, is conducted in virtually all task fMRI studies. Here, we employ eleven datasets containing 980 scans corresponding to different fMRI protocols and subject populations. We found that autocorrelation modeling in AFNI, although imperfect, performed much better than the autocorrelation modeling of FSL and SPM. The presence of residual autocorrelated noise in FSL and SPM leads to heavily confounded first level results, particularly for low-frequency experimental designs. SPM’s alternative pre-whitening method, FAST, performed better than SPM’s default. The reliability of task fMRI studies could be improved with more accurate autocorrelation modeling. We recommend that fMRI analysis packages provide diagnostic plots to make users aware of any pre-whitening problems.There has been recent controversy over the validity of commonly-used software packages for functional MRI (fMRI) data analysis. Here, the authors compare the performance of three leading packages (AFNI, FSL, SPM) in terms of temporal autocorrelation modeling, a key statistical step in fMRI analysis.

[1]  Michael S. Beauchamp,et al.  FMRI group analysis combining effect estimates and their variances , 2012, NeuroImage.

[2]  Christian Windischberger,et al.  Toward discovery science of human brain function , 2010, Proceedings of the National Academy of Sciences.

[3]  R. Weisskoff,et al.  Effect of temporal autocorrelation due to physiological noise and stimulus paradigm on voxel‐level false‐positive rates in fMRI , 1998, Human brain mapping.

[4]  S Thesen,et al.  Prospective acquisition correction for head motion with image‐based tracking for real‐time fMRI , 2000, Magnetic resonance in medicine.

[5]  Karl J. Friston,et al.  Mixed-effects and fMRI studies , 2005, NeuroImage.

[6]  William D. Marslen-Wilson,et al.  The Cambridge Centre for Ageing and Neuroscience (Cam-CAN) study protocol: a cross-sectional, lifespan, multidisciplinary examination of healthy cognitive ageing , 2014, BMC Neurology.

[7]  Rupert Lanzenberger,et al.  Influence of fMRI smoothing procedures on replicability of fine scale motor localization , 2005, NeuroImage.

[8]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[9]  E. Bullmore,et al.  Statistical methods of estimation and inference for functional MR image analysis , 1996, Magnetic resonance in medicine.

[10]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[11]  Alan C. Evans,et al.  A General Statistical Analysis for fMRI Data , 2000, NeuroImage.

[12]  Jonas Svensson,et al.  Investigation of spatial resolution, partial volume effects and smoothing in functional MRI using artificial 3D time series , 2008, NeuroImage.

[13]  Hans Knutsson,et al.  Empirically investigating the statistical validity of SPM, FSL and AFNI for single subject fMRI analysis , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[14]  Stephen M. Smith,et al.  Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data , 2001, NeuroImage.

[15]  Craig E. L. Stark,et al.  When zero is not zero: The problem of ambiguous baseline conditions in fMRI , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Applications , 2002, NeuroImage.

[17]  Yves Rosseel,et al.  neuRosim: An R Package for Generating fMRI Data , 2011 .

[18]  Oliver Speck,et al.  High resolution fMRI of subcortical regions during visual erotic stimulation at 7 T , 2008, Magnetic Resonance Materials in Physics, Biology and Medicine.

[19]  Oliver Speck,et al.  Quantitative assessment of visual cortex function with fMRI at 7 Tesla—test–retest variability , 2015, Front. Hum. Neurosci..

[20]  Myung-Ho In,et al.  Highly accelerated PSF-mapping for EPI distortion correction with improved fidelity , 2012, Magnetic Resonance Materials in Physics, Biology and Medicine.

[21]  Lina J. Karam,et al.  On the Performance of Autocorrelation Estimation Algorithms for fMRI Analysis , 2008, IEEE Journal of Selected Topics in Signal Processing.

[22]  Krzysztof J. Gorgolewski,et al.  A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research , 2016, bioRxiv.

[23]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[24]  Geoffrey M. Boynton,et al.  Efficient Design of Event-Related fMRI Experiments Using M-Sequences , 2002, NeuroImage.

[25]  Jonathan R. Polimeni,et al.  Analysis strategies for high-resolution UHF-fMRI data , 2017, NeuroImage.

[26]  M. Bianciardi,et al.  Evaluation of mixed effects in event-related fMRI studies: impact of first-level design and filtering , 2004, NeuroImage.

[27]  Thomas E. Nichols,et al.  Non-white noise in fMRI: Does modelling have an impact? , 2006, NeuroImage.

[28]  Karl J. Friston,et al.  Slice-timing effects and their correction in functional MRI , 2011, NeuroImage.

[29]  Thomas E. Nichols,et al.  Simple group fMRI modeling and inference , 2009, NeuroImage.

[30]  Margaret D. King,et al.  The NKI-Rockland Sample: A Model for Accelerating the Pace of Discovery Science in Psychiatry , 2012, Front. Neurosci..

[31]  Hans Knutsson,et al.  Does Parametric Fmri Analysis with Spm Yield Valid Results? -an Empirical Study of 1484 Rest Datasets Does Parametric Fmri Analysis with Spm Yield Valid Results? - an Empirical Study of 1484 Rest Datasets , 2022 .

[32]  Karl J. Friston,et al.  Accurate modeling of temporal correlations in rapidly sampled fMRI time series , 2018, Human brain mapping.

[33]  D. Larkman,et al.  Use of multicoil arrays for separation of signal from multiple slices simultaneously excited , 2001, Journal of magnetic resonance imaging : JMRI.

[34]  Hans Knutsson,et al.  Cluster failure revisited: Impact of first level design and physiological noise on cluster false positive rates , 2018, Human brain mapping.

[35]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[36]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[37]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[38]  Hans Knutsson,et al.  Correction for Eklund et al., Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[39]  Karsten Mueller,et al.  Commentary: Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2017, Front. Hum. Neurosci..

[40]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Theory , 2002, NeuroImage.

[41]  Thomas E. Nichols,et al.  Best practices in data analysis and sharing in neuroimaging using MRI , 2017, Nature Neuroscience.

[42]  Martin M. Monti,et al.  Human Neuroscience , 2022 .

[43]  Thomas E. Nichols,et al.  Cluster failure revisited: Impact of first level design and physiological noise on cluster false positive rates , 2018, bioRxiv.

[44]  Yves Rosseel,et al.  A Review of fMRI Simulation Studies , 2014, PloS one.

[45]  Steen Moeller,et al.  Evaluation of 2D multiband EPI imaging for high-resolution, whole-brain, task-based fMRI studies at 3T: Sensitivity and slice leakage artifacts , 2016, NeuroImage.

[46]  Markus Barth,et al.  Serial correlations in single-subject fMRI with sub-second TR , 2017, NeuroImage.

[47]  Karl J. Friston,et al.  To Smooth or Not to Smooth? Bias and Efficiency in fMRI Time-Series Analysis , 2000, NeuroImage.

[48]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[49]  Thomas E. Nichols,et al.  Diagnosis and exploration of massively univariate neuroimaging models , 2003, NeuroImage.

[50]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[51]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .