The Effects of FreeSurfer Version, Workstation Type, and Macintosh Operating System Version on Anatomical Volume and Cortical Thickness Measurements

FreeSurfer is a popular software package to measure cortical thickness and volume of neuroanatomical structures. However, little if any is known about measurement reliability across various data processing conditions. Using a set of 30 anatomical T1-weighted 3T MRI scans, we investigated the effects of data processing variables such as FreeSurfer version (v4.3.1, v4.5.0, and v5.0.0), workstation (Macintosh and Hewlett-Packard), and Macintosh operating system version (OSX 10.5 and OSX 10.6). Significant differences were revealed between FreeSurfer version v5.0.0 and the two earlier versions. These differences were on average 8.8±6.6% (range 1.3–64.0%) (volume) and 2.8±1.3% (1.1–7.7%) (cortical thickness). About a factor two smaller differences were detected between Macintosh and Hewlett-Packard workstations and between OSX 10.5 and OSX 10.6. The observed differences are similar in magnitude as effect sizes reported in accuracy evaluations and neurodegenerative studies. The main conclusion is that in the context of an ongoing study, users are discouraged to update to a new major release of either FreeSurfer or operating system or to switch to a different type of workstation without repeating the analysis; results thus give a quantitative support to successive recommendations stated by FreeSurfer developers over the years. Moreover, in view of the large and significant cross-version differences, it is concluded that formal assessment of the accuracy of FreeSurfer is desirable.

[1]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[2]  A. M. Dale,et al.  A hybrid approach to the skull stripping problem in MRI , 2004, NeuroImage.

[3]  M Nylenna,et al.  Identification of patients in medical publications: need for informed consent. , 1991, BMJ.

[4]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[5]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[6]  J. Morris,et al.  The Cortical Signature of Alzheimer's Disease: Regionally Specific Cortical Thinning Relates to Symptom Severity in Very Mild to Mild AD Dementia and is Detectable in Asymptomatic Amyloid-Positive Individuals , 2008, Cerebral cortex.

[7]  D. Ramasamy,et al.  Memory impairment in multiple sclerosis: correlation with deep grey matter and mesial temporal atrophy , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[8]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[9]  Marianna D. Eddy,et al.  Regionally localized thinning of the cerebral cortex in schizophrenia , 2003, Schizophrenia Research.

[10]  A. Dale,et al.  Thinning of the cerebral cortex in aging. , 2004, Cerebral cortex.

[11]  Gregory McCarthy,et al.  Scan–rescan reliability of subcortical brain volumes derived from automated segmentation , 2010, Human brain mapping.

[12]  Anders M. Dale,et al.  Sequence-independent segmentation of magnetic resonance images , 2004, NeuroImage.

[13]  Eui-Cheol Nam,et al.  Validation of hippocampal volumes measured using a manual method and two automated methods (FreeSurfer and IBASPM) in chronic major depressive disorder , 2008, Neuroradiology.

[14]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[15]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[17]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[18]  A. Dale,et al.  Regional and progressive thinning of the cortical ribbon in Huntington’s disease , 2002, Neurology.

[19]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[20]  H. Uylings,et al.  Atrophy in the parahippocampal gyrus as an early biomarker of Alzheimer’s disease , 2010, Brain Structure and Function.

[21]  Bruce Fischl,et al.  Regional white matter volume differences in nondemented aging and Alzheimer's disease , 2009, NeuroImage.

[22]  Martin Styner,et al.  A comparison of automated segmentation and manual tracing for quantifying hippocampal and amygdala volumes , 2009, NeuroImage.

[23]  Anders M. Dale,et al.  MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths , 2009, NeuroImage.

[24]  Bruce Fischl,et al.  Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops , 2007, IEEE Transactions on Medical Imaging.

[25]  Anders M. Dale,et al.  Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex , 2001, IEEE Transactions on Medical Imaging.

[26]  Jim van Os,et al.  Reduced Cortical Thickness as an Outcome of Differential Sensitivity to Environmental Risks in Schizophrenia , 2011, Biological Psychiatry.

[27]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[28]  Marc Modat,et al.  Atrophy patterns in Alzheimer's disease and semantic dementia: A comparison of FreeSurfer and manual volumetric measurements , 2010, NeuroImage.

[29]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[30]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[31]  André J. W. van der Kouwe,et al.  Detection of cortical thickness correlates of cognitive performance: Reliability across MRI scan sessions, scanners, and field strengths , 2008, NeuroImage.

[32]  Bruce Fischl,et al.  Cerebral cortex and the clinical expression of Huntington's disease: complexity and heterogeneity. , 2008, Brain : a journal of neurology.

[33]  Daniel Rueckert,et al.  Automatic detection and quantification of hippocampal atrophy on MRI in temporal lobe epilepsy: A proof-of-principle study , 2007, NeuroImage.