Robust spatial extent inference with a semiparametric bootstrap joint inference procedure

Spatial extent inference (SEI) is widely used across neuroimaging modalities to adjust for multiple comparisons when studying brain-phenotype associations that inform our understanding of disease. Recent studies have shown that Gaussian random field (GRF) based tools can have inflated family-wise error rates (FWERs). This has led to substantial controversy as to which processing choices are necessary to control the FWER using GRF-based SEI. The failure of GRF-based methods is due to unrealistic assumptions about the spatial covariance function of the imaging data. A permutation procedure is the most robust SEI tool because it estimates the spatial covariance function from the imaging data. However, the permutation procedure can fail because its assumption of exchangeability is violated in many imaging modalities. Here, we propose the (semi-) parametric bootstrap joint (PBJ; sPBJ) testing procedures that are designed for SEI of multilevel imaging data. The sPBJ procedure uses a robust estimate of the spatial covariance function, which yields consistent estimates of standard errors, even if the covariance model is misspecified. We use the methods to study the association between performance and executive functioning in a working memory fMRI study. The sPBJ has similar or greater power to the PBJ and permutation procedures while maintaining the nominal type 1 error rate in reasonable sample sizes. We provide an R package to perform inference using the PBJ and sPBJ procedures. This article is protected by copyright. All rights reserved.

[1]  Karl J. Friston,et al.  Assessing the significance of focal activations using their spatial extent , 1994, Human brain mapping.

[2]  Christos Davatzikos,et al.  Neuroimaging of the Philadelphia Neurodevelopmental Cohort , 2014, NeuroImage.

[3]  Simon N. Wood,et al.  Shape constrained additive models , 2015, Stat. Comput..

[4]  Hans Knutsson,et al.  Cluster failure revisited: Impact of first level design and physiological noise on cluster false positive rates , 2018, Human brain mapping.

[5]  Philip T. Reiss,et al.  The International Journal of Biostatistics Fast Function-on-Scalar Regression with Penalized Basis Expansions , 2011 .

[6]  John C. Hancock,et al.  Signal Detection Theory , 1966 .

[7]  Karsten Mueller,et al.  Commentary: Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2017, Front. Hum. Neurosci..

[8]  Robin M. Chan,et al.  Working memory for complex figures: an fMRI comparison of letter and fractal n-back tasks. , 2002, Neuropsychology.

[9]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[10]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[11]  Mark A. Elliott,et al.  The Philadelphia Neurodevelopmental Cohort: A publicly available resource for the study of normal and abnormal brain development in youth , 2016, NeuroImage.

[12]  Ryan C. N. D'Arcy,et al.  Confirming white matter fMRI activation in the corpus callosum: Co-localization with DTI tractography , 2010, NeuroImage.

[13]  Wenguang Sun,et al.  False discovery control in large‐scale spatial multiple testing , 2015, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[14]  Stephen M. Smith,et al.  Permutation inference for the general linear model , 2014, NeuroImage.

[15]  Y. Benjamini,et al.  False Discovery Rates for Spatial Signals , 2007 .

[16]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[17]  Stephan Heckers,et al.  Mapping Thalamocortical Functional Connectivity in Chronic and Early Stages of Psychotic Disorders , 2016, Biological Psychiatry.

[18]  Alan C. Evans,et al.  Detecting changes in nonisotropic images , 1999, Human brain mapping.

[19]  Jeffrey S. Morris Functional Regression , 2014, 1406.4068.

[20]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[21]  Dennis D. Boos,et al.  Essential Statistical Inference , 2013 .

[22]  Satrajit S. Ghosh,et al.  Sharing brain mapping statistical results with the neuroimaging data model , 2016, Scientific Data.

[23]  Mark A. Elliott,et al.  Impact of in-scanner head motion on multiple measures of functional connectivity: Relevance for studies of neurodevelopment in youth , 2012, NeuroImage.

[24]  I. Verdinelli,et al.  False Discovery Control for Random Fields , 2004 .

[25]  Dennis D. Boos,et al.  Essential Statistical Inference: Theory and Methods , 2013 .

[26]  S. Slotnick Cluster success: fMRI inferences for spatial extent have acceptable false-positive rates , 2017, Cognitive neuroscience.

[27]  Thomas E. Nichols,et al.  Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelation , 2008, NeuroImage.

[28]  Jonathan D. Power,et al.  The Development of Human Functional Brain Networks , 2010, Neuron.

[29]  W. Penny,et al.  Random-Effects Analysis , 2002 .

[30]  Guido Gerig,et al.  ITK-SNAP: An interactive tool for semi-automatic segmentation of multi-modality biomedical images , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[31]  Thomas E. Nichols,et al.  Post-hoc power estimation for topological inference in fMRI , 2014, NeuroImage.

[32]  Brian Avants,et al.  Neuroconductor: an R platform for medical imaging analysis , 2019, Biostatistics.

[33]  Daniel S. Margulies,et al.  NeuroVault.org: A web-based repository for collecting and sharing unthresholded statistical maps of the human brain , 2014, bioRxiv.

[34]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[35]  T. Braver,et al.  BOLD Correlates of Trial-by-Trial Reaction Time Variability in Gray and White Matter: A Multi-Study fMRI Analysis , 2009, PloS one.

[36]  Vyacheslav P. Tuzlukov,et al.  Signal detection theory , 2001 .

[37]  Christos Davatzikos,et al.  Functional Maturation of the Executive System during Adolescence , 2013, The Journal of Neuroscience.

[38]  Mark W. Woolrich,et al.  Bayesian analysis of neuroimaging data in FSL , 2009, NeuroImage.

[39]  Bilwaj Gaonkar,et al.  Analytic estimation of statistical significance maps for support vector machine based multi-variate image analysis and classification , 2013, NeuroImage.

[40]  H. White A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity , 1980 .

[41]  Bruce Fischl,et al.  False positive rates in surface-based anatomical analysis , 2018, NeuroImage.

[42]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[43]  M. Dylan Tisdall,et al.  Quantitative assessment of structural image quality , 2018, NeuroImage.

[44]  Mike Angstadt,et al.  Reevaluating “cluster failure” in fMRI using nonparametric control of the false discovery rate , 2017, Proceedings of the National Academy of Sciences.

[45]  Thomas E. Nichols,et al.  False positives in neuroimaging genetics using voxel-based morphometry data , 2011, NeuroImage.

[46]  J. S. Long,et al.  Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model , 2000 .

[47]  H. White,et al.  Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties☆ , 1985 .

[48]  Y. Benjamini,et al.  Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics , 1999 .

[49]  Utkarsh Ayachit,et al.  The ParaView Guide: A Parallel Visualization Application , 2015 .

[50]  Joseph P. Romano,et al.  Control of the false discovery rate under dependence using the bootstrap and subsampling , 2008 .

[51]  S. Wood,et al.  GAMs with integrated model selection using penalized regression splines and applications to environmental modelling , 2002 .

[52]  Baxter P. Rogers,et al.  Detection of synchronous brain activity in white matter tracts at rest and under functional loading , 2017, Proceedings of the National Academy of Sciences.

[53]  Christopher R. Madan,et al.  Creating 3D visualizations of MRI data: A brief guide , 2015, F1000Research.

[54]  Russell T. Shinohara,et al.  Faster family‐wise error control for neuroimaging with a parametric bootstrap , 2017, Biostatistics.

[55]  Daniel S. Margulies,et al.  NeuroVault.org: a web-based repository for collecting and sharing unthresholded statistical maps of the human brain , 2014, bioRxiv.

[56]  Karl J. Friston,et al.  Analysis of family‐wise error rates in statistical parametric mapping using random field theory , 2016, Human brain mapping.

[57]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .