Faster family‐wise error control for neuroimaging with a parametric bootstrap

SUMMARY In neuroimaging, hundreds to hundreds of thousands of tests are performed across a set of brain regions or all locations in an image. Recent studies have shown that the most common family‐wise error (FWE) controlling procedures in imaging, which rely on classical mathematical inequalities or Gaussian random field theory, yield FWE rates (FWER) that are far from the nominal level. Depending on the approach used, the FWER can be exceedingly small or grossly inflated. Given the widespread use of neuroimaging as a tool for understanding neurological and psychiatric disorders, it is imperative that reliable multiple testing procedures are available. To our knowledge, only permutation joint testing procedures have been shown to reliably control the FWER at the nominal level. However, these procedures are computationally intensive due to the increasingly available large sample sizes and dimensionality of the images, and analyses can take days to complete. Here, we develop a parametric bootstrap joint testing procedure. The parametric bootstrap procedure works directly with the test statistics, which leads to much faster estimation of adjusted p‐values than resampling‐based procedures while reliably controlling the FWER in sample sizes available in many neuroimaging studies. We demonstrate that the procedure controls the FWER in finite samples using simulations, and present region‐ and voxel‐wise analyses to test for sex differences in developmental trajectories of cerebral blood flow.

[1]  E. B. Wilson Probable Inference, the Law of Succession, and Statistical Inference , 1927 .

[2]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[3]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[4]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[5]  A. Dawid Some matrix-variate distribution theory: Notational considerations and a Bayesian application , 1981 .

[6]  David A. Freedman,et al.  A Nonstochastic Interpretation of Reported Significance Levels , 1983 .

[7]  Y. Hochberg A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[8]  G. Hommel A stagewise rejective multiple test procedure based on a modified Bonferroni test , 1988 .

[9]  F. Götze On the Rate of Convergence in the Multivariate CLT , 1991 .

[10]  S. S. Young,et al.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[11]  Yogendra P. Chaubey Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[12]  Karl J. Friston,et al.  Assessing the significance of focal activations using their spatial extent , 1994, Human brain mapping.

[13]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[14]  S. Sarkar,et al.  The Simes Method for Multiple Hypothesis Testing with Positively Dependent Test Statistics , 1997 .

[15]  Richard A. Johnson,et al.  A new family of power transformations to improve normality or symmetry , 2000 .

[16]  L. Brown,et al.  Interval Estimation for a Binomial Proportion , 2001 .

[17]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[18]  Muni S. Srivastava,et al.  Singular Wishart and multivariate beta distributions , 2003 .

[19]  S. Dudoit,et al.  Multiple Hypothesis Testing in Microarray Experiments , 2003 .

[20]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[21]  S. Dudoit,et al.  Multiple Testing Procedures with Applications to Genomics , 2007 .

[22]  James F Troendle,et al.  Multiple Testing with Minimal Assumptions , 2008, Biometrical journal. Biometrische Zeitschrift.

[23]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[24]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[25]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[26]  S. Wood Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models , 2011 .

[27]  Kosha Ruparel,et al.  Resting quantitative cerebral blood flow in schizophrenia measured by pulsed arterial spin labeling perfusion MRI , 2011, Psychiatry Research: Neuroimaging.

[28]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[29]  Thomas E. Nichols,et al.  False positives in neuroimaging genetics using voxel-based morphometry data , 2011, NeuroImage.

[30]  Hans Knutsson,et al.  Does Parametric Fmri Analysis with Spm Yield Valid Results? -an Empirical Study of 1484 Rest Datasets Does Parametric Fmri Analysis with Spm Yield Valid Results? - an Empirical Study of 1484 Rest Datasets , 2022 .

[31]  Christos Davatzikos,et al.  Neuroimaging of the Philadelphia Neurodevelopmental Cohort , 2014, NeuroImage.

[32]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[33]  Efstathios D. Gennatas,et al.  Impact of puberty on the evolution of cerebral perfusion during adolescence , 2014, Proceedings of the National Academy of Sciences.

[34]  Stephen M. Smith,et al.  Permutation inference for the general linear model , 2014, NeuroImage.

[35]  Stephen M. Smith,et al.  Faster permutation inference in brain imaging , 2016, NeuroImage.

[36]  Russell T. Shinohara,et al.  Elevated Amygdala Perfusion Mediates Developmental Sex Differences in Trait Anxiety , 2016, Biological Psychiatry.

[37]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[38]  Mark A. Elliott,et al.  The Philadelphia Neurodevelopmental Cohort: A publicly available resource for the study of normal and abnormal brain development in youth , 2016, NeuroImage.