An evaluation of methods for detecting brain activations from functional neuroimages

Brain activation studies based on PET or fMRI seek to explore neuroscience questions by statistically analyzing the acquired images to produce statistical parametric images (SPIs). An increasingly wide range of univariate and multivariate analysis techniques are used to generate SPIs in order to detect mean-signal activations and/or long-range spatial interactions. However, little is known about the comparative detection performance of even simple techniques in finite data sets. Our aims are (1) to empirically compare the detection performance of a range of techniques using simulations of a simple image phantom and receiver operating characteristics (ROC) analysis, and (2) to construct two near-optimal detectors, both generalized likelihood ratio tests as upper performance bounds. We found that for finite samples of (10-100) images, even when the t-test with single-voxel variance estimates (single-voxel t-test) is the "correct" (i.e. unbiased) model for simple local additive signals, better detection performance is obtained using pooled variance estimates or adaptive, multivariate covariance-based detectors. Normalization by voxel-based variance estimates causes significantly decreased detection performance using either single-voxel t-tests or correlation-coefficient thresholding compared to pooled-variance t-tests or covariance thresholding, respectively. Moreover, we found that SVD by itself, or followed by an adaptive Fisher linear discriminant, provides a detector that is (1) more sensitive to mean differences than a single-voxel t-test, (2) insensitive to the large local signal variances detected by covariance thresholding, and (3) much more sensitive to signal correlations than correlation-coefficient thresholding. Adaptive, multivariate covariance-based approaches and pooled-variance t-tests represent promising directions for obtaining optimal signal detection in functional neuroimaging studies.

[1]  Lars Kai Hansen,et al.  Nonlinear versus Linear Models in Functional Neuroimaging: Learning Curves and Generalization Crossover , 1997, IPMI.

[2]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[3]  Iwao Kanno,et al.  On the Detection of Activation Patterns Using Principal Components Analysis , 1998 .

[4]  Alan C. Evans,et al.  Detecting changes in nonisotropic images , 1999, Human brain mapping.

[5]  Stephen C. Strother,et al.  Effects of Changes in Experimental Design on PET Studies of Isometric Force , 2001, NeuroImage.

[6]  Karl J. Friston,et al.  Functional Connectivity: The Principal-Component Analysis of Large (PET) Data Sets , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[7]  V. Dhawan,et al.  Reproducibility of regional metabolic covariance patterns: comparison of four populations. , 1999, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[8]  Ray Somorjai,et al.  A novel spatio-temporal approach for analyzing fMRI experiments , 2001, NeuroImage.

[9]  P. Mitra,et al.  The nature of spatiotemporal changes in cerebral hemodynamics as manifested in functional magnetic resonance imaging , 1997, Magnetic resonance in medicine.

[10]  F Makedon,et al.  Statistical Methods in Medical Research Data Mining in Brain Imaging , 2022 .

[11]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[12]  M. Andermann,et al.  Detecting Changes In Non-Isotropic Images , 1999 .

[13]  Lars Kai Hansen,et al.  Exploring fMRI data for periodic signal components , 2002, Artif. Intell. Medicine.

[14]  X Hu,et al.  Retrospective estimation and correction of physiological fluctuation in functional MRI , 1995, Magnetic resonance in medicine.

[15]  Ray L. Somorjai,et al.  Artificial , 2015, Definitions.

[16]  R. Woods,et al.  Principal Component Analysis and the Scaled Subprofile Model Compared to Intersubject Averaging and Statistical Parametric Mapping: I. “Functional Connectivity” of the Human Motor System Studied with [15O]Water PET , 1995, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[17]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[18]  Stephen M. Smith,et al.  Spatio-temporal accuracy of ICA for FMRI , 2001, NeuroImage.

[19]  B Horwitz,et al.  Intercorrelations of Glucose Metabolic Rates between Brain Regions: Application to Healthy Males in a State of Reduced Sensory Input , 1984, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[20]  Lars Kai Hansen,et al.  Consensus Inference in Neuroimaging , 2001, NeuroImage.

[21]  J D Watson,et al.  Nonparametric Analysis of Statistic Images from Functional Mapping Experiments , 1996, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[22]  Essa Yacoub,et al.  Node merging in Kohonen's self-organizing mapping of fMRI data , 2002, Artif. Intell. Medicine.

[23]  S. Strother,et al.  Reproducibility of BOLD‐based functional MRI obtained at 4 T , 1999, Human brain mapping.

[24]  Stephen C. Strother,et al.  Penalized Discriminant Analysis of [15O]-water PET Brain Images with Prediction Error Selection of Smoothness and Regularization , 2001, IEEE Trans. Medical Imaging.

[25]  Lars Kai Hansen,et al.  Measuring Activation Pattern Reproducibility Using Resampling Techniques , 1998 .

[26]  S C Strother,et al.  Comparison of matched BOLD and FAIR 4.0T-fMRI with [15O]water PET brain volumes. , 1999, Medical physics.

[27]  M. Lowe,et al.  Functional Connectivity in Single and Multislice Echoplanar Imaging Using Resting-State Fluctuations , 1998, NeuroImage.

[28]  A. Stoessl,et al.  Glucose Use Correlations: A Matter of Inference , 1986, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[29]  Karl J. Friston,et al.  Is Multivariate Analysis of PET Data More Revealing Than the Univariate Approach? Evidence from a Study of Episodic Memory Retrieval , 1996, NeuroImage.

[30]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[31]  Thomas E. Nichols,et al.  Statistical limitations in functional neuroimaging. II. Signal detection and statistical inference. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  L. K. Hansen,et al.  Plurality and Resemblance in fMRI Data Analysis , 1999, NeuroImage.

[33]  R Baumgartner,et al.  Comparison of two exploratory data analysis methods for fMRI: fuzzy clustering vs. principal component analysis. , 2000, Magnetic resonance imaging.

[34]  Thomas E. Nichols,et al.  Statistical limitations in functional neuroimaging. I. Non-inferential methods and statistical models. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[35]  Karl J. Friston,et al.  A multivariate analysis of PET activation studies , 1996, Human brain mapping.

[36]  E. Bullmore,et al.  How Good Is Good Enough in Path Analysis of fMRI Data? , 2000, NeuroImage.

[37]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[38]  A. McIntosh,et al.  Neural modeling, functional brain imaging, and cognition , 1999, Trends in Cognitive Sciences.

[39]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[40]  Julian Besag,et al.  Digital Image Processing: Towards Bayesian image analysis , 1989 .

[41]  S. Strother,et al.  Penalized discriminant analysis of [/sup 15/O]-water PET brain images with prediction error selection of smoothness and regularization hyperparameters , 2001, IEEE Transactions on Medical Imaging.

[42]  S C Strother,et al.  Commentary and Opinion: I. Principal Component Analysis, Variance Partitioning, and “Functional Connectivity” , 1995, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[43]  M. N. Rajah,et al.  Interactions of prefrontal cortex in relation to awareness in sensory learning. , 1999, Science.

[44]  J R Moeller,et al.  A Regional Covariance Approach to the Analysis of Functional Patterns in Positron Emission Tomographic Data , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[45]  Donald Geman,et al.  Bayesian Image Analysis , 1986 .

[46]  J. V. Haxby,et al.  Spatial Pattern Analysis of Functional Brain Images Using Partial Least Squares , 1996, NeuroImage.

[47]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[48]  Julian Besag,et al.  Towards Bayesian image analysis , 1993 .

[49]  Alan C. Evans,et al.  Applications of random field theory to functional connectivity , 1998, Human brain mapping.

[50]  S. Strother,et al.  Quantitative Comparisons of Image Registration Techniques Based on High‐Resolution MRI of the Brain , 1994, Journal of computer assisted tomography.

[51]  John C. Gore,et al.  ROC Analysis of Statistical Methods Used in Functional MRI: Individual Subjects , 1999, NeuroImage.

[52]  L. Parsons,et al.  Interregional connectivity to primary motor cortex revealed using MRI resting state images , 1999, Human brain mapping.

[53]  Gary F. Egan,et al.  Abnormal Functional Connectivity in Posttraumatic Stress Disorder , 2002, NeuroImage.

[54]  Ray L. Somorjai,et al.  Exploring regions of interest with cluster analysis (EROICA) using a spectral peak statistic for selecting and testing the significance of fMRI activation time-series , 2002, Artif. Intell. Medicine.

[55]  Lars Kai Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.

[56]  L. K. Hansen,et al.  Generalizable Patterns in Neuroimaging: How Many Principal Components? , 1999, NeuroImage.