Number of events and reliability in fMRI

Relatively early in the history of fMRI, research focused on issues of power and reliability, with an important line concerning the establishment of optimal procedures for experimental design in order to maximize the various statistical properties of such designs. However, in recent years, tasks wherein events are defined only a posteriori, on the basis of behavior, have become increasingly common. Although these designs enable a much wider array of questions to be answered, they are not amenable to the tight control afforded by designs with events defined entirely a priori, and little work has assessed issues of power and reliability in such designs. We demonstrate how differences in numbers of events—as can occur with a posteriori event definition—affect reliability, both through simulation and in real data.

[1]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[2]  T. Marill.  Detection theory and psychophysics , 1956 .

[3]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[4]  Mert R. Sabuncu,et al.  The influence of head motion on intrinsic functional connectivity MRI , 2012, NeuroImage.

[5]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[6]  P. Killeen,et al.  An Alternative to Null-Hypothesis Significance Tests , 2005, Psychological science.

[7]  J. Mattingley,et al.  Annual meeting of the Cognitive Neuroscience Society , 1997 .

[8]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[9]  R. Buxton,et al.  Detection Power, Estimation Efficiency, and Predictability in Event-Related fMRI , 2001, NeuroImage.

[10]  H. Pashler,et al.  Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition 1 , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.

[11]  John D. Van Horn,et al.  Unique and persistent individual patterns of brain activity across different memory retrieval tasks , 2009, NeuroImage.

[12]  David J. McGonigle,et al.  Test–retest reliability in fMRI: Or how I learned to stop worrying and love the variability , 2012, NeuroImage.

[13]  Gary H Glover,et al.  Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses , 2002, Journal of Neuroscience Methods.

[14]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[15]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[16]  Karl J. Friston,et al.  Variability in fMRI: An Examination of Intersession Differences , 2000, NeuroImage.

[17]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[18]  Scott T. Grafton,et al.  Extensive Individual Differences in Brain Activations Associated with Episodic Retrieval are Reliable Over Time , 2002, Journal of Cognitive Neuroscience.

[19]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[20]  Thomas E. Nichols,et al.  Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelation , 2008, NeuroImage.

[21]  Karl J. Friston,et al.  Stochastic Designs in Event-Related fMRI , 1999, NeuroImage.

[22]  P. Killeen.  Replicability, Confidence, and Priors , 2005, Psychological science.

[23]  Mark E. Bastin,et al.  Single subject fMRI test–retest reliability metrics and confounding factors , 2013, NeuroImage.

[24]  Joshua Carp,et al.  The secret lives of experiments: Methods reporting in the fMRI literature , 2012, NeuroImage.

[25]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[26]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[27]  Richard E. Mayer,et al.  Individual differences in cognitive style and strategy predict similarities in the patterns of brain activity between individuals , 2012, NeuroImage.

[28]  Thomas T. Liu,et al.  Efficiency, power, and entropy in event-related FMRI with multiple trial types Part I: theory , 2004, NeuroImage.

[29]  Hans Knutsson,et al.  Does Parametric Fmri Analysis with Spm Yield Valid Results? -an Empirical Study of 1484 Rest Datasets Does Parametric Fmri Analysis with Spm Yield Valid Results? - an Empirical Study of 1484 Rest Datasets , 2022 .

[30]  Thomas E. Nichols,et al.  Optimization of experimental design in fMRI: a general framework using a genetic algorithm , 2003, NeuroImage.