Quantitative assessment of field strength, total intracranial volume, sex, and age effects on the goodness of harmonization for volumetric analysis on the ADNI database

When analyzing large multicenter databases, the effects of multiple confounding covariates increase the variability in the data and may reduce the ability to detect changes due to the actual effect of interest, for example, changes due to disease. Efficient ways to evaluate the effect of covariates toward the data harmonization are therefore important. In this article, we showcase techniques to assess the “goodness of harmonization” of covariates. We analyze 7,656 MR images in the multisite, multiscanner Alzheimer's Disease Neuroimaging Initiative (ADNI) database. We present a comparison of three methods for estimating total intracranial volume to assess their robustness and correct the brain structure volumes using the residual method and the proportional (normalization by division) method. We then evaluated the distribution of brain structure volumes over the entire ADNI database before and after accounting for multiple covariates such as total intracranial volume, scanner field strength, sex, and age using two techniques: (a) Zscapes, a panoramic visualization technique to analyze the entire database and (b) empirical cumulative distributions functions. The results from this study highlight the importance of assessing the goodness of data harmonization as a necessary preprocessing step when pooling large data set with multiple covariates, prior to further statistical data analysis.

[1]  G. Chételat,et al.  Region-Specific Hierarchy between Atrophy, Hypometabolism, and β-Amyloid (Aβ) Load in Alzheimer's Disease Dementia , 2012, The Journal of Neuroscience.

[2]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[3]  Peter Savadjiev,et al.  Inter-site and inter-scanner diffusion MRI data harmonization , 2016, NeuroImage.

[4]  C. Jack,et al.  Comparing 3T and 1.5T MRI for Mapping Hippocampal Atrophy in the Alzheimer's Disease Neuroimaging Initiative , 2015, American Journal of Neuroradiology.

[5]  C. Jack,et al.  Ways toward an early diagnosis in Alzheimer’s disease: The Alzheimer’s Disease Neuroimaging Initiative (ADNI) , 2005, Alzheimer's & Dementia.

[6]  T. Vangberg,et al.  How Does the Accuracy of Intracranial Volume Measurements Affect Normalized Brain Volumes? Sample Size Estimates Based on 966 Subjects from the HUNT MRI Cohort , 2015, American Journal of Neuroradiology.

[7]  Jozsef Janszky,et al.  Are there any gender differences in the hippocampus volume after head-size correction? A volumetric and voxel-based morphometric study , 2014, Neuroscience Letters.

[8]  Frithjof Kruggel,et al.  The relationship between head size and intracranial volume in elderly subjects , 2003, Brain Research.

[9]  P. Myles,et al.  Using the Bland-Altman method to measure agreement with repeated measures. , 2007, British journal of anaesthesia.

[10]  Benjamin Thyreau,et al.  A longitudinal study of age‐ and gender‐related annual rate of volume changes in regional gray matter in healthy adults , 2013, Human brain mapping.

[11]  John D. Storey,et al.  Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis , 2007, PLoS genetics.

[12]  P C O'Brien,et al.  Procedures for setting normal values , 1995, Neurology.

[13]  F. Massey.  The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[14]  E G Tangalos,et al.  Total intracranial volume: Normative values and lack of association with Alzheimer’s disease , 2002, Neurology.

[15]  Lars Johansson,et al.  Intracranial volume estimated with commonly used methods could introduce bias in studies including brain volume measurements , 2013, NeuroImage.

[16]  Anders M. Dale,et al.  Reliability in multi-site structural MRI studies: Effects of gradient non-linearity correction on phantom and human data , 2006, NeuroImage.

[17]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[18]  Bruce Fischl,et al.  Highly accurate inverse consistent registration: A robust approach , 2010, NeuroImage.

[19]  T. W. Anderson.  On the Distribution of the Two-Sample Cramer-von Mises Criterion , 1962 .

[20]  Sébastien Ourselin,et al.  Automated Template-Based Hippocampal Segmentations from MRI: The Effects of 1.5T or 3T Field Strength on Accuracy , 2014, Neuroinformatics.

[21]  Malek Adjouadi,et al.  Comparative reliability analysis of publicly available software packages for automatic intracranial volume estimation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Peter Savadjiev,et al.  Multi-site harmonization of diffusion MRI data in a registration framework , 2017, Brain Imaging and Behavior.

[23]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[24]  John G. Csernansky,et al.  Open Access Series of Imaging Studies: Longitudinal MRI Data in Nondemented and Demented Older Adults , 2010, Journal of Cognitive Neuroscience.

[25]  Thomas Lindqvist,et al.  Brain parenchymal fraction in an age-stratified healthy population - determined by MRI using manual segmentation and three automated segmentation methods. , 2016, Journal of neuroradiology. Journal de neuroradiologie.

[26]  Alex R. Smith,et al.  Sex differences in the structural connectome of the human brain , 2013, Proceedings of the National Academy of Sciences.

[27]  Mark E. Schmidt,et al.  The Alzheimer’s Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[28]  M. Stephens,et al.  K-Sample Anderson–Darling Tests , 1987 .

[29]  D. Giavarina.  Understanding Bland Altman analysis , 2015, Biochemia medica.

[30]  R. Gur,et al.  Gender differences in age effect on brain atrophy measured by magnetic resonance imaging. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Rohit Bakshi,et al.  Whole Brain Volume Measured from 1.5T versus 3T MRI in Healthy Subjects and Patients with Multiple Sclerosis , 2015, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[32]  Jennifer L. Whitwell,et al.  Accurate automatic estimation of total intracranial volume: A nuisance variable with less nuisance , 2015, NeuroImage.

[33]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[34]  Nick C Fox,et al.  Normalization of cerebral volumes by use of intracranial volume: implications for longitudinal quantitative MR imaging. , 2001, AJNR. American journal of neuroradiology.

[35]  Arman Sargolzaei,et al.  Estimating Intracranial Volume in Brain Research: An Evaluation of Methods , 2015, Neuroinformatics.

[36]  R. Gur,et al.  Multisite Machine Learning Analysis Provides a Robust Structural Imaging Signature of Schizophrenia Detectable Across Diverse Patient Populations and Within Individuals , 2018, Schizophrenia bulletin.

[37]  Sébastien Ourselin,et al.  Head size, age and gender adjustment in MRI studies: a necessary nuisance? , 2010, NeuroImage.

[38]  Anders M. Dale,et al.  MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths , 2009, NeuroImage.

[39]  Joël Schaerer,et al.  Accurate intracranial cavity volume estimation using multiatlas segmentation , 2012, Alzheimer's & Dementia.

[40]  K. Hansen,et al.  Functional normalization of 450k methylation array data improves replication in large cancer studies , 2014, Genome Biology.

[41]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[42]  Arno Klein,et al.  101 Labeled Brain Images and a Consistent Human Cortical Labeling Protocol , 2012, Front. Neurosci..

[43]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[44]  Frederik Barkhof,et al.  Application of Machine Learning to Arterial Spin Labeling in Mild Cognitive Impairment and Alzheimer Disease. , 2016, Radiology.

[45]  Lina J. Karam,et al.  On the Performance of Autocorrelation Estimation Algorithms for fMRI Analysis , 2008, IEEE Journal of Selected Topics in Signal Processing.

[46]  Joseph V. Hajnal,et al.  A robust method to estimate the intracranial volume across MRI field strengths (1.5T and 3T) , 2010, NeuroImage.

[47]  Michael I. Miller,et al.  Large Deformation Diffeomorphism and Momentum Based Hippocampal Shape Discrimination in Dementia of the Alzheimer type , 2007, IEEE Transactions on Medical Imaging.

[48]  A. Simmons,et al.  A VOXEL-WISE MORPHOMETRY COMPARISON OF THE ADNI 1.5T AND ADNI 3.0T VOLUMETRIC MRI PROTOCOLS , 2014, Alzheimer's & Dementia.

[49]  Shuyu Li,et al.  Age-related changes in brain structural covariance networks , 2013, Front. Hum. Neurosci..

[50]  Hyunwoo Lee,et al.  Estimating and accounting for the effect of MRI scanner changes on longitudinal whole-brain volume change measurements , 2019, NeuroImage.

[51]  Ragini Verma,et al.  Harmonization of multi-site diffusion tensor imaging data , 2017, NeuroImage.

[52]  Yuankai Huo,et al.  Simultaneous total intracranial volume and posterior fossa volume estimation using multi‐atlas label fusion , 2017, Human brain mapping.

[53]  Nikos Makris,et al.  Adjustment for whole brain and cranial size in volumetric brain studies: a review of common adjustment factors and statistical methods. , 2006, Harvard review of psychiatry.

[54]  Rohit Bakshi,et al.  Correction for intracranial volume in analysis of whole brain atrophy in multiple sclerosis: the proportion vs. residual method , 2004, NeuroImage.

[55]  M. Weissman,et al.  Statistical harmonization corrects site effects in functional connectivity measurements from multi‐site fMRI data , 2018, Human brain mapping.

[56]  Daniel Rueckert,et al.  Brain Extraction Using Label Propagation and Group Agreement: Pincram , 2015, PloS one.

[57]  Snehashis Roy,et al.  Robust skull stripping using multiple MR image contrasts insensitive to pathology , 2017, NeuroImage.

[58]  Daniel Rueckert,et al.  Automatic morphometry in Alzheimer's disease and mild cognitive impairment☆☆☆ , 2011, NeuroImage.

[59]  John W. Emerson,et al.  Nonparametric Goodness-of-Fit Tests for Discrete Null Distributions , 2011, R J..

[60]  Christos Davatzikos,et al.  A review on neuroimaging-based classification studies and associated feature extraction methods for Alzheimer's disease and its prodromal stages , 2017, NeuroImage.

[61]  Douglas G. Altman,et al.  Statistics Notes: Correlation, regression, and repeated data , 1994 .

[62]  K. Ohtomo,et al.  A longitudinal study of brain volume changes in normal aging. , 2012, European journal of radiology.

[63]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[64]  Paul M. Thompson,et al.  Multi-site genetic analysis of diffusion images and voxelwise heritability analysis: A pilot project of the ENIGMA–DTI working group , 2013, NeuroImage.

[65]  Russell T. Shinohara,et al.  Harmonization of cortical thickness measurements across scanners and sites , 2017, NeuroImage.

[66]  Nick C Fox,et al.  Interactive algorithms for the segmentation and quantitation of 3-D MRI brain scans. , 1997, Computer methods and programs in biomedicine.

[67]  Jean A. Frazier,et al.  Statistical adjustments for brain size in volumetric neuroimaging studies: Some practical implications in methods , 2011, Psychiatry Research: Neuroimaging.

[68]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[69]  Olivier Potvin,et al.  Freesurfer cortical normative data for adults using Desikan-Killiany-Tourville and ex vivo protocols , 2017, NeuroImage.

[70]  Johann A. Gagnon-Bartsch,et al.  Using control genes to correct for unwanted variation in microarray data. , 2012, Biostatistics.

[71]  Owen Carmichael,et al.  Standardization of analysis sets for reporting results from ADNI MRI data , 2013, Alzheimer's & Dementia.

[72]  Cheng Li,et al.  Adjusting batch effects in microarray expression data using empirical Bayes methods. , 2007, Biostatistics.

[73]  Simon Duchesne,et al.  Normative data for subcortical regional volumes over the lifetime of the adult human brain , 2016, NeuroImage.

[74]  Assawin Gongvatana,et al.  Brain ventricular volume and cerebrospinal fluid biomarkers of Alzheimer's disease. , 2010, Journal of Alzheimer's disease : JAD.

[75]  R. Bartha,et al.  Ventricular enlargement as a possible measure of Alzheimer's disease progression validated using the Alzheimer's disease neuroimaging initiative database. , 2008, Brain : a journal of neurology.

[76]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[77]  C. Jack,et al.  HARP: THE EADC-ADNI HARMONIZED PROTOCOL FOR MANUAL HIPPOCAMPAL SEGMENTATION: A STANDARD OF REFERENCE FROM A GLOBAL WORKING GROUP , 2014, Alzheimer's & Dementia.

[78]  Steen Moeller,et al.  Heritability of fractional anisotropy in human white matter: A comparison of Human Connectome Project and ENIGMA-DTI data , 2015, NeuroImage.

[79]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[80]  Wei Pan,et al.  Longitudinal Analysis Is More Powerful than Cross-Sectional Analysis in Detecting Genetic Association with Neuroimaging Phenotypes , 2014, PloS one.

[81]  D. Louis Collins,et al.  Nonlocal Intracranial Cavity Extraction , 2014, Int. J. Biomed. Imaging.

[82]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[83]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[84]  M. Weiner.  Expanding ventricles may detect preclinical Alzheimer disease , 2008, Neurology.

[85]  T. Jernigan,et al.  Computed tomography in schizophrenics and normal volunteers. I. Fluid volume. , 1982, Archives of general psychiatry.

[86]  Mert R. Sabuncu,et al.  Statistical analysis of longitudinal neuroimage data with Linear Mixed Effects models , 2013, NeuroImage.

[87]  Gang Chen,et al.  A practical guideline for intracranial volume estimation in patients with Alzheimer's disease , 2015, BMC Bioinformatics.

[88]  Guy B. Williams,et al.  Comparative Reliability of Total Intracranial Volume Estimation Methods and the Influence of Atrophy in a Longitudinal Semantic Dementia Cohort , 2009, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[89]  Anders M. Dale,et al.  ENIGMA and the individual: Predicting factors that affect the brain in 35 countries worldwide , 2017, NeuroImage.

[90]  D. Trune,et al.  The relative importance of head size, gender and age on the auditory brainstem response , 1988, Hearing Research.

[91]  Y. Koike,et al.  Head size as a basis of gender difference in the latency of the brainstem auditory-evoked response. , 1990, Audiology : official organ of the International Society of Audiology.

[92]  Nick C Fox,et al.  A longitudinal study of brain volume changes in normal aging using serial registered magnetic resonance imaging. , 2003, Archives of neurology.

[93]  Bruce Fischl,et al.  Avoiding asymmetry-induced bias in longitudinal image processing , 2011, NeuroImage.

[94]  Gautam Shroff,et al.  Approximate Incremental Big-Data Harmonization , 2013, 2013 IEEE International Congress on Big Data.

[95]  Andrew Simmons,et al.  The effects of intracranial volume adjustment approaches on multiple regional MRI volumes in healthy aging and Alzheimer's disease , 2014, Front. Aging Neurosci..

[96]  D. Reich,et al.  Volumetric Analysis from a Harmonized Multisite Brain MRI Study of a Single Subject with Multiple Sclerosis , 2017, American Journal of Neuroradiology.

[97]  M. Viergever,et al.  Robustness of Automated Methods for Brain Volume Measurements across Different MRI Field Strengths , 2016, PloS one.

[98]  Russell T. Shinohara,et al.  Removing inter-subject technical variability in magnetic resonance imaging studies , 2016, NeuroImage.

[99]  Mark E Bastin,et al.  Sex Differences in the Adult Human Brain: Evidence from 5216 UK Biobank Participants , 2017, bioRxiv.

[100]  M N Rossor,et al.  Intracranial volume and Alzheimer disease: evidence against the cerebral reserve hypothesis. , 2000, Archives of neurology.

[101]  Abraham Z. Snyder,et al.  A unified approach for morphometric and functional data analysis in young, old, and demented adults using automated atlas-based head size normalization: reliability and validation against manual measurement of total intracranial volume , 2004, NeuroImage.