Addressing the "problem" of temporal correlations in MVPA analysis

The use of multivariate pattern analysis (MVPA) has grown substantially over the past few years. Many studies using MVPA estimate the response of individual trial activity and perform hypothesis testing using a non-parametric approach. Here we show that the default auto regression model of order 1 used for temporal whitening of BOLD data is problematic in that it leads to biased permutation tests. We show that the correlation of activity estimates across trials can cause extreme bias in non-parametric hypothesis testing so that the proportion of type I or type II errors are inflated. Crucially for MVPA, this inflation increases with sphere size. The error magnitude is such that in our data set, strong univariate effects are completely missed. By whitening the data with a more general auto regression (AR) model, one can correct the bias in permutation testing for better signal detection. Applying higher order AR models is already implemented in many neuroimaging software packages as a non-default option. The use of more aggressive temporal whitening may also prove crucial for valid MVPA inference in fast event related designs.

[1]  James V. Haxby,et al.  Multivariate pattern analysis of fMRI: The early beginnings , 2012, NeuroImage.

[2]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Theory , 2002, NeuroImage.

[3]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[4]  John-Dylan Haynes,et al.  Searchlight-based multi-voxel pattern analysis of fMRI by cross-validated MANOVA , 2014, NeuroImage.

[5]  Russell A. Poldrack,et al.  The impact of study design on pattern estimation for single-trial multivariate pattern analysis , 2014, NeuroImage.

[6]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[7]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[8]  Karl J. Friston,et al.  Bayesian fMRI time series analysis with spatial priors , 2005, NeuroImage.

[9]  Jonathan D. Rosenblatt,et al.  Quantifying spatial pattern similarity in multivariate analysis using functional anisotropy , 2016, 1605.03482.

[10]  Muni S. Srivastava,et al.  A two sample test in high dimensional data , 2013, Journal of Multivariate Analysis.

[11]  Larry A. Wasserman,et al.  Classification Accuracy as a Proxy for Two Sample Testing , 2016, The Annals of Statistics.

[12]  Josephson Camilla,et al.  Does Parametric fMRI Analysis with SPM Yield Valid Results? – An Empirical Study of 1484 Rest Datasets , 2012 .

[13]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[14]  Krzysztof J. Gorgolewski,et al.  The human voice areas: Spatial organization and inter-individual variability in temporal and extra-temporal cortices , 2015, NeuroImage.

[15]  Johannes Bernarding,et al.  Increasing the reliability of data analysis of functional magnetic resonance imaging by applying a new blockwise permutation method , 2014, Front. Neuroinform..