Quantitative and qualitative assessment of structural magnetic resonance imaging data in a two-center study

BackgroundMulti-center magnetic resonance imaging (MRI) studies present an opportunity to advance research by pooling data. However, brain measurements derived from MR-images are susceptible to differences in MR-sequence parameters. It is therefore necessary to determine whether there is an interaction between the sequence parameters and the effect of interest, and to minimise any such interaction by careful choice of acquisition parameters. As an exemplar of the issues involved in multi-center studies, we present data from a study in which we aimed to optimize a set of volumetric MRI-protocols to define a protocol giving data that are consistent and reproducible across two centers and over time.MethodsOptimization was achieved based on data quality and quantitative measures, in our case using FreeSurfer and Voxel Based Morphometry approaches. Our approach consisted of a series of five comparisons. Firstly, a single-center dataset was collected, using a range of candidate pulse-sequences and parameters chosen on the basis of previous literature. Based on initial results, a number of minor changes were implemented to optimize the pulse-sequences, and a second single-center dataset was collected. FreeSurfer data quality measures were compared between datasets in order to determine the best performing sequence(s), which were taken forward to the next stage of testing. We subsequently acquired short-term and long-term two-center reproducibility data, and quantitative measures were again assessed to determine the protocol with the highest reproducibility across centers. Effects of a scanner software and hardware upgrade on the reproducibility of the protocols at one of the centers were also evaluated.ResultsAssessing the quality measures from the first two datasets allowed us to define artefact-free protocols, all with high image quality as assessed by FreeSurfer. Comparing the quantitative test and retest measures, we found high within-center reproducibility for all protocols, but lower between-center reproducibility for some protocols than others. The upgrade showed no important effects.ConclusionsWe were able to determine (for the scanners used in this study) an optimised protocol, which gave the highest within- and between-center reproducibility of those assessed, and give details of this protocol here. More generally, we discuss some of the issues raised by multi-center studies and describe a methodical approach to take towards optimization and standardization, and recommend performing this kind of procedure to other investigators.

[1]  Clifford R. Jack,et al.  Interpreting scan data acquired from multiple scanners: A study with Alzheimer's disease , 2008, NeuroImage.

[2]  Hilleke E. Hulshoff Pol,et al.  Brain volumes as predictor of outcome in recent-onset schizophrenia: a multi-center MRI study , 2003, Schizophrenia Research.

[3]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[4]  N. Makris,et al.  Decreased volume of left and total anterior insular lobule in schizophrenia , 2006, Schizophrenia Research.

[5]  K. Ohtomo,et al.  Effect of scanner in longitudinal studies of brain volume changes , 2011, Journal of magnetic resonance imaging : JMRI.

[6]  C. Jack,et al.  Quantitative magnetic resonance techniques as surrogate markers of Alzheimer’s disease , 2004, NeuroRX.

[7]  D. Bertrand,et al.  Nicotinic acetylcholine receptors: from structure to brain function. , 2003, Reviews of physiology, biochemistry and pharmacology.

[8]  Anders M. Dale,et al.  CORTICAL THICKNESS AND SUBCORTICAL VOLUMES IN SCHIZOPHRENIA AND BIPOLAR DISORDER , 2010, Schizophrenia Research.

[9]  Alan C. Evans,et al.  Focal cortical atrophy in multiple sclerosis: Relation to lesion load and disability , 2007, NeuroImage.

[10]  F. Barkhof,et al.  Interscanner variation in brain MRI lesion load measurements in MS: Implications for clinical trials , 1997, Neurology.

[11]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[12]  Jessica A. Turner,et al.  Impact of scanner hardware and imaging protocol on image quality and compartment volume precision in the ADNI cohort , 2010, NeuroImage.

[13]  Anne-Catherine Bachoud-Lévi,et al.  Distribution of grey matter atrophy in Huntington’s disease patients: A combined ROI-based and voxel-based morphometric study , 2006, NeuroImage.

[14]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[15]  N. Schuff,et al.  Comparison of automated and manual MRI volumetry of hippocampus in normal aging and dementia , 2002, Journal of magnetic resonance imaging : JMRI.

[16]  F. Jessen,et al.  Multicenter assessment of reliability of cranial MRI , 2006, Neurobiology of Aging.

[17]  B. Hermann,et al.  The neurodevelopmental impact of childhood onset temporal lobe epilepsy on brain structure and function and the risk of progressive cognitive effects. , 2002, Progress in brain research.

[18]  Alan C. Evans,et al.  Focal decline of cortical thickness in Alzheimer's disease identified by computational neuroanatomy. , 2004, Cerebral cortex.

[19]  David F. Tate,et al.  Reliability and validity of MRI-based automated volumetry software relative to auto-assisted manual measurement of subcortical structures in HIV-infected patients from a multisite study , 2010, NeuroImage.

[20]  S. Southwick,et al.  MRI and PET study of deficits in hippocampal structure and function in women with childhood sexual abuse and posttraumatic stress disorder. , 2003, The American journal of psychiatry.

[21]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[22]  C. Jack,et al.  Brain atrophy rates predict subsequent clinical conversion in normal elderly and amnestic MCI , 2005, Neurology.

[23]  D. Louis Collins,et al.  Sensitivity of voxel-based morphometry analysis to choice of imaging protocol at 3 T , 2009, NeuroImage.

[24]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[25]  Claude Lepage,et al.  Mapping reliability in multicenter MRI: Voxel‐based morphometry and cortical thickness , 2010, Human brain mapping.

[26]  Anders M. Dale,et al.  Sequence-independent segmentation of magnetic resonance images , 2004, NeuroImage.

[27]  N. Schuff,et al.  Measurement of hippocampal subfields and age-related changes with high resolution MRI at 4T , 2007, Neurobiology of Aging.

[28]  Alan C. Evans,et al.  A novel quantitative cross-validation of different cortical surface reconstruction algorithms using MRI phantom , 2006, NeuroImage.

[29]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[30]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[31]  Tyrone D. Cannon,et al.  Reliability of brain volumes from multicenter MRI acquisition: A calibration study , 2004, Human brain mapping.

[32]  André J. W. van der Kouwe,et al.  Reliability of MRI-derived cortical and subcortical morphometric measures: Effects of pulse sequence, voxel geometry, and parallel imaging , 2009, NeuroImage.

[33]  John Suckling,et al.  Brain anatomy and its relationship to behavior in adults with autism spectrum disorder: a multicenter magnetic resonance imaging study. , 2012, Archives of general psychiatry.

[34]  F. Jessen,et al.  Multicentre variability of MRI-based medial temporal lobe volumetry in Alzheimer's disease , 2010, Psychiatry Research: Neuroimaging.

[35]  Anders M. Dale,et al.  MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths , 2009, NeuroImage.

[36]  A. Dale,et al.  Focal thinning of the cerebral cortex in multiple sclerosis. , 2003, Brain : a journal of neurology.

[37]  F. Duffy,et al.  Early experience alters brain function and structure. , 2004, Pediatrics.

[38]  R. Turner,et al.  Optimization of 3-D MP-RAGE Sequences for Structural Brain Imaging , 2000, NeuroImage.

[39]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[40]  Suzanne E. Welcome,et al.  Mapping cortical change across the human life span , 2003, Nature Neuroscience.

[41]  Steven C. R. Williams,et al.  A comprehensive testing protocol for MRI neuroanatomical segmentation techniques: Evaluation of a novel lateral ventricle segmentation method , 2011, NeuroImage.

[42]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[43]  Kiralee M. Hayashi,et al.  Dynamics of Gray Matter Loss in Alzheimer's Disease , 2003, The Journal of Neuroscience.

[44]  R. Woods,et al.  Mapping cortical thickness and gray matter concentration in first episode schizophrenia. , 2005, Cerebral cortex.

[45]  Jan Kassubek,et al.  Executive dysfunction in early stages of Huntington's disease is associated with striatal and insular atrophy: A neuropsychological and voxel-based morphometric study , 2005, Journal of the Neurological Sciences.

[46]  Gregory McCarthy,et al.  Scan–rescan reliability of subcortical brain volumes derived from automated segmentation , 2010, Human brain mapping.

[47]  Ting Song,et al.  Comparison study of clinical 3D MRI brain segmentation evaluation , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.