An evaluation of thresholding techniques in fMRI analysis

This paper reviews and compares individual voxel-wise thresholding methods for identifying active voxels in single-subject fMRI datasets. Different error rates are described which may be used to calibrate activation thresholds. We discuss methods which control each of the error rates at a prespecified level alpha, including simple procedures which ignore spatial correlation among the test statistics as well as more elaborate ones which incorporate this correlation information. The operating characteristics of the methods are shown through a simulation study, indicating that the error rate used has an important impact on the sensitivity of the thresholding method, but that accounting for correlation has little impact. Therefore, the simple procedures described work well for thresholding most single-subject fMRI experiments and are recommended. The methods are illustrated with a real bilateral finger tapping experiment.

[1]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[2]  Karl J. Friston,et al.  Comparing Functional (PET) Images: The Assessment of Significant Change , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[3]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[4]  John D. Storey,et al.  Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach , 2004 .

[5]  M S Cohen,et al.  Real-time functional magnetic resonance imaging. , 2001, Methods.

[6]  J D Watson,et al.  Nonparametric Analysis of Statistic Images from Functional Mapping Experiments , 1996, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[7]  S. C. Strother,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: Mutual Information Learning Curves , 2002, NeuroImage.

[8]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[9]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[10]  P. J. Jennings,et al.  Time series analysis in the time domain and resampling methods for studies of functional magnetic resonance brain imaging , 1997, Human brain mapping.

[11]  Rupert G. Miller.  Simultaneous Statistical Inference , 1966 .

[12]  L. Wasserman,et al.  Operating characteristics and extensions of the false discovery rate procedure , 2002 .

[13]  S. Sarkar.  Some Results on False Discovery Rate in Stepwise multiple testing procedures , 2002 .

[14]  T A Carpenter,et al.  Colored noise and computational inference in neurophysiological (fMRI) time series analysis: Resampling methods in time and wavelet domains , 2001, Human brain mapping.

[15]  Larry Wasserman,et al.  False Discovery Rates for Random Fields , 2003 .

[16]  Y. Benjamini,et al.  Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics , 1999 .

[17]  Thomas E. Nichols,et al.  Statistical limitations in functional neuroimaging. II. Signal detection and statistical inference. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  H. Keselman,et al.  Multiple Comparison Procedures , 2005 .

[19]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[20]  Russell D. Wolfinger,et al.  Multiple Comparisons and Multiple Tests Using the SAS System , 1999 .

[21]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[22]  Yogendra P. Chaubey.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[23]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[24]  Karl J. Friston,et al.  Assessing the significance of focal activations using their spatial extent , 1994, Human brain mapping.

[25]  Siu Hung Cheung,et al.  Familywise robustness criteria for multiple‐comparison procedures , 2002 .

[26]  E. Bullmore,et al.  Statistical methods of estimation and inference for functional MR image analysis , 1996, Magnetic resonance in medicine.

[27]  E C Wong,et al.  Processing strategies for time‐course data sets in functional mri of the human brain , 1993, Magnetic resonance in medicine.

[28]  Daniel B. Rowe,et al.  Multivariate Bayesian Statistics: Models for Source Separation and Signal Unmixing , 2002 .

[29]  John D. Storey.  The positive false discovery rate: a Bayesian interpretation and the q-value , 2003 .

[30]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[31]  S C Williams,et al.  Generic brain activation mapping in functional magnetic resonance imaging: a nonparametric approach. , 1997, Magnetic resonance imaging.

[32]  Y. Benjamini,et al.  On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics , 2000 .

[33]  John D. Storey.  A direct approach to false discovery rates , 2002 .

[34]  G. E. Thomas.  Resampling‐Based Multiple Testing: Examples and Methods for p‐Value Adjustment , 1994 .

[35]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[36]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .