Challenges in the reproducibility of clinical studies with resting state fMRI: An example in early Parkinson's disease

Resting state fMRI (rfMRI) is gaining in popularity, being easy to acquire and with promising clinical applications. However, rfMRI studies, especially those involving clinical groups, still lack reproducibility, largely due to the different analysis settings. This is particularly important for the development of imaging biomarkers. The aim of this work was to evaluate the reproducibility of our recent study regarding the functional connectivity of the basal ganglia network in early Parkinson's disease (PD) (Szewczyk-Krolikowski et al., 2014). In particular, we systematically analysed the influence of two rfMRI analysis steps on the results: the individual cleaning (artefact removal) of fMRI data and the choice of the set of independent components (template) used for dual regression. Our experience suggests that the use of a cleaning approach based on single-subject independent component analysis, which removes non neural-related sources of inter-individual variability, can help to increase the reproducibility of clinical findings. A template generated using an independent set of healthy controls is recommended for studies where the aim is to detect differences from a “healthy” brain, rather than an “average” template, derived from an equal number of patients and controls. While, exploratory analyses (e.g. testing multiple resting state networks) should be used to formulate new hypotheses, careful validation is necessary before promising findings can be translated into useful biomarkers.

[1]  Stephen M Smith,et al.  Correspondence of the brain's functional architecture during activation and rest , 2009, Proceedings of the National Academy of Sciences.

[2]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[3]  Ludovica Griffanti,et al.  Automatic denoising of functional MRI data: Combining independent component analysis and hierarchical fusion of classifiers , 2014, NeuroImage.

[4]  X. Zuo,et al.  Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: A systems neuroscience perspective , 2014, Neuroscience & Biobehavioral Reviews.

[5]  Mark Jenkinson,et al.  Resting Functional Connectivity Reveals Residual Functional Activity in Alzheimer’s Disease , 2013, Biological Psychiatry.

[6]  Antonio P Strafella,et al.  Uncovering the role of the insula in non-motor symptoms of Parkinson's disease. , 2014, Brain : a journal of neurology.

[7]  Brian D. Ross,et al.  The Virtual Biopsy : Global versus Focal Spectroscopy , 2013 .

[8]  Steen Moeller,et al.  ICA-based artefact removal and accelerated fMRI acquisition for improved resting state network imaging , 2014, NeuroImage.

[9]  Paul M. Matthews,et al.  Age-related adaptations of brain function during a memory task are also present at rest , 2012, NeuroImage.

[10]  Jonathan F. Russell,et al.  If a job is worth doing, it is worth doing twice , 2013, Nature.

[11]  Nicola Filippini,et al.  Functional connectivity in the basal ganglia network differentiates PD patients from controls , 2014, Neurology.

[12]  N. Filippini,et al.  Distinct patterns of brain activity in young carriers of the APOE e4 allele , 2009, NeuroImage.

[13]  U. Sailer,et al.  A resting state network in the motor control circuit of the basal ganglia , 2009, BMC Neuroscience.

[14]  J. Molinuevo,et al.  Donepezil Treatment Stabilizes Functional Connectivity During Resting State and Brain Activity During Memory Encoding in Alzheimer’s Disease , 2013, Journal of clinical psychopharmacology.

[15]  Koene R. A. Van Dijk,et al.  Template based rotation: A method for functional connectivity analysis with a priori templates , 2014, NeuroImage.

[16]  Kevin Murphy,et al.  Resting-state fMRI confounds and cleanup , 2013, NeuroImage.

[17]  Nick C. Fox,et al.  Ten simple rules for reporting voxel-based morphometry studies , 2008, NeuroImage.

[18]  Yoav Ben-Shlomo,et al.  REM sleep behaviour disorder is associated with worse quality of life and other non-motor features in early Parkinson's disease , 2013, Journal of Neurology, Neurosurgery & Psychiatry.

[19]  Yong He,et al.  Test–retest reliability of diffusion measures in cerebral white matter: A multiband diffusion MRI study , 2015, Journal of magnetic resonance imaging : JMRI.

[20]  Jerry L. Prince,et al.  Effects of diffusion weighting schemes on the reproducibility of DTI-derived fractional anisotropy, mean diffusivity, and principal eigenvector measurements at 1.5T , 2007, NeuroImage.

[21]  Xi-Nian Zuo,et al.  Reliable intrinsic connectivity networks: Test–retest evaluation using ICA and dual regression approach , 2010, NeuroImage.

[22]  Jürgen Finsterbusch,et al.  Microscopic diffusion anisotropy in the human brain: Reproducibility, normal values, and comparison with the fractional anisotropy , 2015, NeuroImage.

[23]  H Matsuda,et al.  Influence of Parameter Settings in Voxel-based Morphometry 8 , 2014, Methods of Information in Medicine.

[24]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[25]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[26]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[27]  Paul M. Matthews,et al.  Differential effects of the APOE genotype on brain function across the lifespan , 2011, NeuroImage.

[28]  Vince D. Calhoun,et al.  Impact of Analysis Methods on the Reproducibility and Reliability of Resting-State Networks , 2013, Brain Connect..

[29]  S. Rombouts,et al.  Resting-state functional MR imaging: a new window to the brain. , 2014, Radiology.

[30]  Simon B. Eickhoff,et al.  An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data , 2013, NeuroImage.

[31]  J. Hughes,et al.  Accuracy of clinical diagnosis of idiopathic Parkinson's disease: a clinico-pathological study of 100 cases. , 1992, Journal of neurology, neurosurgery, and psychiatry.

[32]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[33]  G. Assmann,et al.  Apolipoprotein E Polymorphism and Coronary Artery Disease , 1983, Arteriosclerosis.

[34]  Raymond Salvador,et al.  Validity of modulation and optimal settings for advanced voxel-based morphometry , 2014, NeuroImage.