Test‐retest reliability estimation of functional MRI data

Functional magnetic resonance imaging (fMRI) data are commonly used to construct activation maps for the human brain. It is important to quantify the reliability of such maps. We have developed statistical models to provide precise estimates for reliability from several runs of the same paradigm over time. Specifically, our method extends the premise of maximum likelihood (ML) developed by Genovese et al. (Magn Reson Med 1997;38:497–507) by incorporating spatial context into the estimation process. Experiments indicate that our methodology provides more conservative estimates of true positives compared to those obtained by Genovese et al. The reliability estimates can be used to obtain voxel‐specific reliability measures for activated as well as inactivated regions in future experiments. We derive statistical methodology to determine optimal thresholds for region‐ and context‐specific activations. Empirical guidelines are also provided on the number of repeat scans to acquire in order to arrive at accurate reliability estimates. We report the results from experiments involving a motor paradigm performed on a single subject several times over a period of 2 months. Magn Reson Med 48:62–70, 2002. © 2002 Wiley‐Liss, Inc.

[1]  S. Webb,et al.  A reproducible repositioning method for serial magnetic resonance imaging studies of the brain in treatment trials for multiple sclerosis , 1997, Journal of magnetic resonance imaging : JMRI.

[2]  Stuart Geman,et al.  Statistical methods for tomographic image reconstruction , 1987 .

[3]  E. DeYoe,et al.  Reduction of physiological fluctuations in fMRI using digital filters , 1996, Magnetic resonance in medicine.

[4]  Alan C. Evans,et al.  An MRI-Based Probabilistic Atlas of Neuroanatomy , 1994 .

[5]  J. Besag,et al.  Bayesian Computation and Stochastic Systems , 1995 .

[6]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[7]  A M Dale,et al.  Event-related functional MRI: past, present, and future. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Julian Besag,et al.  Digital Image Processing: Towards Bayesian image analysis , 1989 .

[9]  R W Cox,et al.  Software tools for analysis and visualization of fMRI data , 1997, NMR in biomedicine.

[10]  D C Noll,et al.  Estimating test‐retest reliability in functional MR imaging II: Application to motor and cognitive activation studies , 1997, Magnetic resonance in medicine.

[11]  J C Mazziotta,et al.  Automated image registration: II. Intersubject validation of linear and nonlinear models. , 1998, Journal of computer assisted tomography.

[12]  J. Hajnal,et al.  Artifacts due to stimulus correlated motion in functional imaging of the brain , 1994, Magnetic resonance in medicine.

[13]  John C. Gore,et al.  ROC Analysis of Statistical Methods Used in Functional MRI: Individual Subjects , 1999, NeuroImage.

[14]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[15]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[16]  E. DeYoe,et al.  Analysis and use of FMRI response delays , 2001, Human brain mapping.

[17]  J. Frahm,et al.  Dynamic MR imaging of human brain oxygenation during rest and photic stimulation , 1992, Journal of magnetic resonance imaging : JMRI.

[18]  C. Genovese,et al.  Estimating test‐retest reliability in functional MR imaging I: Statistical methodology , 1997, Magnetic resonance in medicine.

[19]  Julian Besag,et al.  Towards Bayesian image analysis , 1993 .

[20]  Zhaowei Jiang,et al.  Consistency analysis for digitized three-dimensional Talairach's Co-Planner Stereotactic Atlas of the human brain , 1997 .

[21]  R. Turner,et al.  Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. , 1992, Proceedings of the National Academy of Sciences of the United States of America.