Intra- and interscanner variability of magnetic resonance imaging based volumetry in multiple sclerosis

Brain volumetric measurements in multiple sclerosis (MS) reflect not only disease-specific processes but also other sources of variability. The latter has to be considered especially in multicenter and longitudinal studies. Here, we compare data generated by three different 3-Tesla magnetic resonance scanners (Philips Achieva; Siemens Verio; GE Signa MR750). We scanned two patients diagnosed with relapsing remitting MS six times per scanner within three weeks (T1w and FLAIR, 3D). We assessed T2-hyperintense lesions by an automated lesion segmentation tool and determined volumes of grey matter (GM), white matter (WM) and whole brain (GM+WM) from the lesion-filled T1-weighted images using voxel-based morphometry (SPM8/VBM8) and SIENAX (FSL). We measured cortical thickness using FreeSurfer from both, lesion-filled and original T1-weighted images. We quantified brain volume changes with SIENA. In both patients, we found significant differences in total lesion volume, global brain tissue volumes and cortical thickness measures between the scanners. Morphometric measures varied remarkably between repeated scans at each scanner, independent of the brain imaging software tool used. We conclude that for cross-sectional multicenter studies, the effect of different scanners has to be taken into account. For longitudinal monocentric studies, the expected effect size should exceed the size of false positive findings observed in this study. Assuming a physiological loss of brain volume of about 0.3% per year in healthy adult subjects (Good et al., 2001), which may double in MS (De Stefano et al., 2010; De Stefano et al., 2015), with current tools reliable estimation of brain atrophy in individual patients is only possible over periods of several years.

[1]  M. Battaglini,et al.  Establishing pathological cut-offs of brain atrophy rates in multiple sclerosis , 2015, Journal of Neurology, Neurosurgery & Psychiatry.

[2]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[3]  M. Dylan Tisdall,et al.  Head motion during MRI acquisition reduces gray matter volume and thickness estimates , 2015, NeuroImage.

[4]  Bernhard Hemmer,et al.  An automated tool for detection of FLAIR-hyperintense white-matter lesions in Multiple Sclerosis , 2012, NeuroImage.

[5]  P. Matthews,et al.  Normalized Accurate Measurement of Longitudinal Brain Change , 2001, Journal of computer assisted tomography.

[6]  M. Sdika,et al.  Nonrigid registration of multiple sclerosis brain images using lesion inpainting for morphometry or lesion mapping , 2009, Human brain mapping.

[7]  David A. Rottenberg,et al.  Quantitative comparison of four brain extraction algorithms , 2004, NeuroImage.

[8]  Liliane Schoofs,et al.  Differential Proteomics in Dequeened Honeybee Colonies Reveals Lower Viral Load in Hemolymph of Fertile Worker Bees , 2011, PloS one.

[9]  John Suckling,et al.  Assessment of the impact of the scanner-related factors on brain morphometry analysis with Brainvisa , 2011, BMC Medical Imaging.

[10]  David H. Miller,et al.  Reducing the impact of white matter lesions on automated measures of brain gray and white matter volumes , 2010, Journal of magnetic resonance imaging : JMRI.

[11]  D. Louis Collins,et al.  Gradient distortions in MRI: Characterizing and correcting for their effects on SIENA-generated measures of brain volume change , 2010, NeuroImage.

[12]  Frederik Barkhof,et al.  Grey matter pathology in multiple sclerosis , 2008, The Lancet Neurology.

[13]  B. L. Welch ON THE COMPARISON OF SEVERAL MEAN VALUES: AN ALTERNATIVE APPROACH , 1951 .

[14]  Stefan Klöppel,et al.  Intra- and interscanner variability of automated voxel-based volumetry based on a 3D probabilistic atlas of human cerebral structures , 2010, NeuroImage.

[15]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[16]  M. Battaglini,et al.  Assessing brain atrophy rates in a large population of untreated multiple sclerosis subtypes , 2010, Neurology.

[17]  M. Filippi,et al.  Mechanisms of action of disease-modifying agents and brain volume changes in multiple sclerosis , 2008, Neurology.

[18]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[19]  Khader M Hasan,et al.  Effect of in‐painting on cortical thickness measurements in multiple sclerosis: A large cohort study , 2015, Human brain mapping.

[20]  Joanna M. Wardlaw,et al.  Prospective multi-centre Voxel Based Morphometry study employing scanner specific segmentations: Procedure development using CaliBrain structural MRI data , 2009, BMC Medical Imaging.

[21]  Otto W. Witte,et al.  Changes in Brain Size during the Menstrual Cycle , 2011, PloS one.

[22]  Daniel S. Reich,et al.  Direct MRI detection of impending plaque development in multiple sclerosis , 2015, Neurology: Neuroimmunology & Neuroinflammation.

[23]  C. Crainiceanu,et al.  Quantification of multiple-sclerosis-related brain atrophy in two heterogeneous MRI datasets using mixed-effects modeling☆ , 2013, NeuroImage: Clinical.

[24]  J. Tukey Comparing individual means in the analysis of variance. , 1949, Biometrics.

[25]  Stephen M. Smith,et al.  Accurate, Robust, and Automated Longitudinal and Cross-Sectional Brain Change Analysis , 2002, NeuroImage.

[26]  W. Heindel,et al.  Dehydration confounds the assessment of brain atrophy , 2005, Neurology.

[27]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[28]  C Confavreux,et al.  Reliability of Longitudinal Brain Volume Loss Measurements between 2 Sites in Patients with Multiple Sclerosis: Comparison of 7 Quantification Techniques , 2012, American Journal of Neuroradiology.

[29]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[30]  Sébastien Ourselin,et al.  Brain MAPS: An automated, accurate and robust brain extraction technique using a template library , 2011, NeuroImage.

[31]  G Tedeschi,et al.  Regional cortical thinning in multiple sclerosis and its relation with cognitive impairment: A multicenter study , 2016, Multiple sclerosis.

[32]  D. Louis Collins,et al.  Evaluation of automated techniques for the quantification of grey matter atrophy in patients with multiple sclerosis , 2010, NeuroImage.

[33]  Anders M. Dale,et al.  MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths , 2009, NeuroImage.

[34]  M. Battaglini,et al.  Evaluating and reducing the impact of white matter lesions on brain volume measurements , 2012, Human brain mapping.

[35]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[36]  Stephen M. Smith,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[37]  Jeffrey A. Cohen,et al.  Diagnostic criteria for multiple sclerosis: 2010 Revisions to the McDonald criteria , 2011, Annals of neurology.

[38]  D. Louis Collins,et al.  Diurnal fluctuations in brain volume: Statistical analyses of MRI from large populations , 2015, NeuroImage.

[39]  R Bakshi,et al.  The Impact of Lesion In-Painting and Registration Methods on Voxel-Based Morphometry in Detecting Regional Cerebral Gray Matter Atrophy in Multiple Sclerosis , 2012, American Journal of Neuroradiology.

[40]  Olivier Gout,et al.  Treatment effect on brain atrophy correlates with treatment effect on disability in multiple sclerosis , 2014, Annals of neurology.

[41]  Nick C Fox,et al.  Haemodialysis and Cerebral Oedema , 2001, Nephron.

[42]  Ludwig Kappos,et al.  White matter lesion filling improves the accuracy of cortical thickness measurements in multiple sclerosis patients: a longitudinal study , 2014, BMC Neuroscience.

[43]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[44]  J A Frank,et al.  MRI studies of multiple sclerosis: Implications for the natural history of the disease and for monitoring effectiveness of experimental therapies , 1996, Multiple sclerosis.

[45]  Lutz Jäncke,et al.  Training-Induced Neural Plasticity in Golf Novices , 2011, The Journal of Neuroscience.

[46]  M Filippi,et al.  Interscanner variation in brain MR lesion load measurements in multiple sclerosis using conventional spin-echo, rapid relaxation-enhanced, and fast-FLAIR sequences. , 1999, AJNR. American journal of neuroradiology.

[47]  F. Fazekas,et al.  Recommendations to improve imaging and analysis of brain lesion load and atrophy in longitudinal studies of multiple sclerosis , 2012, Journal of Neurology.

[48]  Ulrich Ettinger,et al.  Effects of acute dehydration on brain morphology in healthy humans , 2009, Human brain mapping.

[49]  C. Guttmann,et al.  Multiple sclerosis lesion formation and early evolution revisited: A weekly high-resolution magnetic resonance imaging study , 2016, Multiple sclerosis.

[50]  Claude Lepage,et al.  Mapping reliability in multicenter MRI: Voxel‐based morphometry and cortical thickness , 2010, Human brain mapping.

[51]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[52]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[53]  Mark Jenkinson,et al.  Optimizing parameter choice for FSL-Brain Extraction Tool (BET) on 3D T1 images in multiple sclerosis , 2012, NeuroImage.

[54]  Dominique Sappey-Marinier,et al.  Weekly multimodal MRI follow-up of two multiple sclerosis active lesions presenting a transient decrease in ADC , 2015, Brain and behavior.

[55]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[56]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[57]  Mehul P. Sampat,et al.  Disease modeling in multiple sclerosis: Assessment and quantification of sources of variability in brain parenchymal fraction measurements , 2010, NeuroImage.

[58]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[59]  Gregory G. Brown,et al.  Quantitative evaluation of automated skull‐stripping methods applied to contemporary and legacy images: Effects of diagnosis, bias correction, and slice location , 2006, Human brain mapping.

[60]  D. Arnold,et al.  Treatment effect on brain atrophy correlates with treatment effect on disability in multiple sclerosis , 2014, Annals of neurology.

[61]  P. S. Albert,et al.  Changes in the amount of diseased white matter over time in patients with relapsing-remitting multiple sclerosis , 1995, Neurology.

[62]  Till Acker,et al.  A human post-mortem brain model for the standardization of multi-centre MRI studies , 2015, NeuroImage.

[63]  Alan J Thompson,et al.  The reproducibility and sensitivity of brain tissue volume measurements derived from an SPM‐based segmentation methodology , 2002, Journal of magnetic resonance imaging : JMRI.

[64]  John Suckling,et al.  The neuro/PsyGRID calibration experiment , 2012, Human brain mapping.

[65]  Ulrich Ettinger,et al.  Dehydration affects brain structure and function in healthy adolescents , 2011, Human brain mapping.