Increasing the reliability of data analysis of functional magnetic resonance imaging by applying a new blockwise permutation method

A recent paper by Eklund et al. (2012) showed that up to 70% false positive results may occur when analyzing functional magnetic resonance imaging (fMRI) data using the statistical parametric mapping (SPM) software, which may mainly be caused by insufficient compensation for the temporal correlation between successive scans. Here, we show that a blockwise permutation method can be an effective alternative to the standard correction method for the correlated residuals in the general linear model, assuming an AR(1)-model as used in SPM for analyzing fMRI data. The blockwise permutation approach including a random shift developed by our group (Adolf et al., 2011) accounts for the temporal correlation structure of the data without having to provide a specific definition of the underlying autocorrelation model. 1465 publicly accessible resting-state data sets were re-analyzed, and the results were compared with those of Eklund et al. (2012). It was found that with the new permutation method the nominal familywise error rate for the detection of activated voxels could be maintained approximately under even the most critical conditions in which Eklund et al. found the largest deviations from the nominal error level. Thus, the method presented here can serve as a tool to ameliorate the quality and reliability of fMRI data analyses.

[1]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[2]  Andreas Kastrup,et al.  Effects of age on negative BOLD signal changes in the primary somatosensory cortex , 2013, NeuroImage.

[3]  Jonathan D. Power,et al.  Functional Brain Networks Develop from a “Local to Distributed” Organization , 2009, PLoS Comput. Biol..

[4]  T A Carpenter,et al.  Colored noise and computational inference in neurophysiological (fMRI) time series analysis: Resampling methods in time and wavelet domains , 2001, Human brain mapping.

[5]  C. Braak,et al.  Permutation Versus Bootstrap Significance Tests in Multiple Regression and Anova , 1992 .

[6]  Karl J. Friston,et al.  To Smooth or Not to Smooth? Bias and Efficiency in fMRI Time-Series Analysis , 2000, NeuroImage.

[7]  Godfrey D Pearlson,et al.  Alcohol dose effects on brain circuits during simulated driving: An fMRI study , 2009, Human brain mapping.

[8]  Hans Knutsson,et al.  Does Parametric Fmri Analysis with Spm Yield Valid Results? -an Empirical Study of 1484 Rest Datasets Does Parametric Fmri Analysis with Spm Yield Valid Results? - an Empirical Study of 1484 Rest Datasets , 2022 .

[9]  Waltraud Kahle,et al.  Applying multivariate techniques to high-dimensional temporally correlated fMRI data , 2011 .

[10]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[11]  Carl-Fredrik Westin,et al.  Resampling fMRI time series , 2005, NeuroImage.

[12]  Karl J. Friston,et al.  Decoding episodic memory in ageing: A Bayesian analysis of activity patterns predicting memory , 2012, NeuroImage.

[13]  Debashis Kushary,et al.  Bootstrap Methods and Their Application , 2000, Technometrics.

[14]  V. Calhoun,et al.  Selective changes of resting-state networks in individuals at risk for Alzheimer's disease , 2007, Proceedings of the National Academy of Sciences.

[15]  John S. Duncan,et al.  Voxel-based diffusion tensor imaging in patients with mesial temporal lobe epilepsy and hippocampal sclerosis , 2008, NeuroImage.

[16]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[17]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[18]  Thomas E. Nichols,et al.  False positives in neuroimaging genetics using voxel-based morphometry data , 2011, NeuroImage.

[19]  Giuseppe Sartori,et al.  When the single matters more than the group: Very high false positive rates in single case Voxel Based Morphometry , 2013, NeuroImage.

[20]  Bharat B. Biswal,et al.  The Influence of the Amplitude of Low-Frequency Fluctuations on Resting-State Functional Connectivity , 2013, Front. Hum. Neurosci..

[21]  Godfrey D Pearlson,et al.  Influence of Alcohol Use on Neural Response to Go/No-Go Task in College Drinkers , 2013, Neuropsychopharmacology.

[22]  Christian Windischberger,et al.  Toward discovery science of human brain function , 2010, Proceedings of the National Academy of Sciences.

[23]  P. Tobler,et al.  Salience Signals in the Right Temporoparietal Junction Facilitate Value-Based Decisions , 2013, The Journal of Neuroscience.

[24]  S. S. Young,et al.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[25]  Hans R. Künsch,et al.  Matched-block bootstrap for dependent data , 1995 .

[26]  Ulrich Mansmann,et al.  GlobalANCOVA: exploration and assessment of gene group effects , 2008, Bioinform..

[27]  J. Duyn,et al.  Investigation of Low Frequency Drift in fMRI Signal , 1999, NeuroImage.

[28]  Johannes Bernarding,et al.  Event-related functional magnetic resonance imaging (efMRI) of depth-by-disparity perception: additional evidence for right-hemispheric lateralization , 2009, Experimental Brain Research.

[29]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[30]  Mickaël Causse,et al.  Affective decision making under uncertainty during a plausible aviation task: An fMRI study , 2013, NeuroImage.