Effects of change in FreeSurfer version on classification accuracy of patients with Alzheimer's disease and mild cognitive impairment

Studies have found non‐negligible differences in cortical thickness estimates across versions of software that are used for processing and quantifying MRI‐based cortical measurements, and issues have arisen regarding these differences, as obtained estimates could potentially affect the validity of the results. However, more critical for diagnostic classification than absolute thickness estimates across versions is the inter‐subject stability. We aimed to investigate the effect of change in software version on classification of older persons in groups of healthy, mild cognitive impairment and Alzheimer's Disease. Using MRI samples of 100 older normal controls, 100 with mild cognitive impairment and 100 Alzheimer's Disease patients obtained from the Alzheimer's Disease Neuroimaging Initiative database, we performed a standard reconstruction processing using the FreeSurfer image analysis suite versions 4.1.0, 4.5.0 and 5.1.0. Pair‐wise comparisons of cortical thickness between FreeSurfer versions revealed significant differences, ranging from 1.6% (4.1.0 vs. 4.5.0) to 5.8% (4.1.0 vs. 5.1.0) across the cortical mantle. However, change of version had very little effect on detectable differences in cortical thickness between diagnostic groups, and there were little differences in accuracy between versions when using entorhinal thickness for diagnostic classification. This lead us to conclude that differences in absolute thickness estimates across software versions in this case did not imply lacking validity, that classification results appeared reliable across software versions, and that classification results obtained in studies using different FreeSurfer versions can be reliably compared. Hum Brain Mapp 37:1831–1841, 2016. © 2016 Wiley Periodicals, Inc.

[1]  A. Dale,et al.  Thinning of the cerebral cortex in aging. , 2004, Cerebral cortex.

[2]  N. Schuff,et al.  Magnetic resonance imaging of the entorhinal cortex and hippocampus in mild cognitive impairment and Alzheimer's disease , 2001, Journal of neurology, neurosurgery, and psychiatry.

[3]  A. M. Dale,et al.  A hybrid approach to the skull stripping problem in MRI , 2004, NeuroImage.

[4]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[5]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[6]  Sébastien Ourselin,et al.  A comparison of voxel and surface based cortical thickness estimation methods , 2011, NeuroImage.

[7]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[9]  D. Selkoe.  Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[10]  A. Dale,et al.  Regional and progressive thinning of the cortical ribbon in Huntington’s disease , 2002, Neurology.

[11]  André J. W. van der Kouwe,et al.  Detection of cortical thickness correlates of cognitive performance: Reliability across MRI scan sessions, scanners, and field strengths , 2008, NeuroImage.

[12]  H. van Crevel.  [Diagnosis in dementia]. , 1987, Nederlandsch tijdschrift voor geneeskunde.

[13]  Denise C. Park,et al.  Toward defining the preclinical stages of Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[14]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[15]  Anders M. Dale,et al.  A hybrid approach to the Skull Stripping problem in MRI , 2001, NeuroImage.

[16]  Ron Mengelers,et al.  The Effects of FreeSurfer Version, Workstation Type, and Macintosh Operating System Version on Anatomical Volume and Cortical Thickness Measurements , 2012, PloS one.

[17]  A. Dale,et al.  CSF Biomarkers in Prediction of Cerebral and Clinical Change in Mild Cognitive Impairment and Alzheimer's Disease , 2010, The Journal of Neuroscience.

[18]  M. Albert,et al.  Introduction to the recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[19]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[20]  B T Hyman,et al.  Entorhinal cortex pathology in Alzheimer's disease , 1991, Hippocampus.

[21]  Anders M. Dale,et al.  MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths , 2009, NeuroImage.

[22]  Richard M. Leahy,et al.  Comparison of landmark-based and automatic methods for cortical surface registration , 2010, NeuroImage.

[23]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[24]  Nick C Fox,et al.  The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease , 2011 .