Investigating the Added Value of FreeSurfer’s Manual Editing Procedure for the Study of the Reading Network in a Pediatric Population

Insights into brain anatomy are important for the early detection of neurodevelopmental disorders, such as dyslexia. FreeSurfer is one of the most frequently applied automatized software tools to study brain morphology. However, quality control of the outcomes provided by FreeSurfer is often ignored and could lead to wrong statistical inferences. Additional manual editing of the data may be a solution, although not without a cost in time and resources. Past research in adults on comparing the automatized method of FreeSurfer with and without additional manual editing indicated that although editing may lead to significant differences in morphological measures between the methods in some regions, it does not substantially change the sensitivity to detect clinical differences. Given that automated approaches are more likely to fail in pediatric—and inherently more noisy—data, we investigated in the current study whether FreeSurfer can be applied fully automatically or additional manual edits of T1-images are needed in a pediatric sample. Specifically, cortical thickness and surface area measures with and without additional manual edits were compared in six regions of interest (ROIs) of the reading network in 5-to-6-year-old children with and without dyslexia. Results revealed that additional editing leads to statistical differences in the morphological measures, but that these differences are consistent across subjects and that the sensitivity to reveal statistical differences in the morphological measures between children with and without dyslexia is not affected, even though conclusions of marginally significant findings can differ depending on the method used. Thereby, our results indicate that additional manual editing of reading-related regions in FreeSurfer has limited gain for pediatric samples.

[1]  G. Varoquaux,et al.  Connectivity‐based parcellation: Critique and implications , 2015, Human brain mapping.

[2]  Jan Wouters,et al.  Hemispheric Asymmetry in Auditory Processing of Speech Envelope Modulations in Prereading Children , 2014, The Journal of Neuroscience.

[3]  D. Rosenberg,et al.  Distinguishing between major depressive disorder and obsessive-compulsive disorder in children by measuring regional cortical thickness. , 2011, Archives of general psychiatry.

[4]  N. Gaab,et al.  Tackling the 'dyslexia paradox': reading brain and behavior for early markers of developmental dyslexia. , 2016, Wiley interdisciplinary reviews. Cognitive science.

[5]  K. Pelphrey,et al.  Cortical morphological markers in children with autism: a structural magnetic resonance imaging study of thickness, area, volume, and gyrification , 2016, Molecular Autism.

[6]  Nikos Makris,et al.  Automated versus manual segmentation of brain region volumes in former football players , 2018, NeuroImage: Clinical.

[7]  Anders M. Dale,et al.  A hybrid approach to the Skull Stripping problem in MRI , 2001, NeuroImage.

[8]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[9]  Ioana L. Coman,et al.  A comparison of FreeSurfer-generated data with and without manual intervention , 2015, Front. Neurosci..

[10]  Bruce Fischl,et al.  A tale of two factors: What determines the rate of progression in Huntington's disease? A longitudinal MRI study , 2011, Movement disorders : official journal of the Movement Disorder Society.

[11]  Giancarlo Ferrigno,et al.  Validation of FreeSurfer-Estimated Brain Cortical Thickness: Comparison with Histologic Measurements , 2014, Neuroinformatics.

[12]  Anderson M. Winkler,et al.  Cortical thickness or grey matter volume? The importance of selecting the phenotype for imaging genetics studies , 2010, NeuroImage.

[13]  M. Mallar Chakravarty,et al.  Evaluating accuracy of striatal, pallidal, and thalamic segmentation methods: Comparing automated approaches to manual delineation , 2017, NeuroImage.

[14]  O. Muzik,et al.  Statistical Parametric Mapping: Assessment of Application in Children , 2000, NeuroImage.

[15]  E. Leibenluft,et al.  Cortical Thickness and Subcortical Gray Matter Volume in Pediatric Anxiety Disorders , 2017, Neuropsychopharmacology.

[16]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[17]  Abigail B. Waters,et al.  Identifying errors in Freesurfer automated skull stripping and the incremental utility of manual intervention , 2018, Brain Imaging and Behavior.

[18]  Bruce Fischl,et al.  Volumetric navigators for prospective motion correction and selective reacquisition in neuroanatomical MRI , 2012, Magnetic resonance in medicine.

[19]  et al.,et al.  The Effect of Template Choice on Morphometric Analysis of Pediatric Brain Data ☆ , 2022 .

[20]  J. Wouters,et al.  Diffusion Tensor Imaging and Resting-State Functional MRI-Scanning in 5- and 6-Year-Old Children: Training Protocol and Motion Assessment , 2014, PloS one.

[21]  Wendy Bogers,et al.  Automated subcortical segmentation using FIRST: Test–retest reliability, interscanner reliability, and comparison to manual segmentation , 2013, Human brain mapping.

[22]  Jay N. Giedd,et al.  Motion Artifact in Magnetic Resonance Imaging: Implications for Automated Analysis , 2002, NeuroImage.

[23]  Thanh Vân Phan,et al.  Processing of structural neuroimaging data in young children: Bridging the gap between current practice and state-of-the-art methods , 2017, Developmental Cognitive Neuroscience.

[24]  A. Dale,et al.  Distinct genetic influences on cortical surface area and cortical thickness. , 2009, Cerebral cortex.

[25]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[26]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Michael N. Smolka,et al.  Quality Control of Structural MRI Images Applied Using FreeSurfer—A Hands-On Workflow to Rate Motion Artifacts , 2016, Front. Neurosci..

[28]  Andrew R Mayer,et al.  Gray Matter Abnormalities in Pediatric Mild Traumatic Brain Injury , 2015 .

[29]  M. Mallar Chakravarty,et al.  Hippocampus and amygdala volumes from magnetic resonance images in children: Assessing accuracy of FreeSurfer and FSL against manual segmentation , 2016, NeuroImage.

[30]  A. Dale,et al.  Regional and progressive thinning of the cortical ribbon in Huntington’s disease , 2002, Neurology.

[31]  Anqi Qiu,et al.  Automated quality assessment of structural magnetic resonance images in children: Comparison with visual inspection and surface‐based reconstruction , 2018, Human brain mapping.

[32]  Robin G. Morris,et al.  Early Intervention for Children at Risk for Reading Disabilities: The Impact of Grade at Intervention and Individual Differences on Intervention Outcomes , 2017, Journal of Educational Psychology.

[33]  J. van der Steen,et al.  Early intervention for children at risk of visual processing dysfunctions from 1 year of age: a randomized controlled trial protocol , 2019, Trials.

[34]  J. Hajnal,et al.  Abnormal Cortical Development after Premature Birth Shown by Altered Allometric Scaling of Brain Growth , 2006, PLoS medicine.

[35]  Anders M. Dale,et al.  Prospective motion correction of high-resolution magnetic resonance imaging data in children , 2010, NeuroImage.

[36]  R. Kahn,et al.  Human brain changes across the life span: A review of 56 longitudinal magnetic resonance imaging studies , 2012, Human brain mapping.

[37]  Phil Reed,et al.  A Meta-Analytic Review of the Effectiveness of Behavioural Early Intervention Programs for Children with Autistic Spectrum Disorders. , 2010 .

[38]  Anders M. Dale,et al.  Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex , 2001, IEEE Transactions on Medical Imaging.

[39]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[40]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[41]  Eui-Cheol Nam,et al.  Validation of hippocampal volumes measured using a manual method and two automated methods (FreeSurfer and IBASPM) in chronic major depressive disorder , 2008, Neuroradiology.

[42]  M. Dylan Tisdall,et al.  Head motion during MRI acquisition reduces gray matter volume and thickness estimates , 2015, NeuroImage.

[43]  Douglas L Arnold,et al.  Automated quality control of brain MR images , 2008, Journal of magnetic resonance imaging : JMRI.

[44]  Anders M. Dale,et al.  Sequence-independent segmentation of magnetic resonance images , 2004, NeuroImage.

[45]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[46]  Bryon A Mueller,et al.  Global functional connectivity abnormalities in children with fetal alcohol spectrum disorders. , 2013, Alcoholism, clinical and experimental research.

[47]  Sina Zarei Mahmoodabadi,et al.  Widespread cortical thinning in children with frontal lobe epilepsy , 2011, Epilepsia.

[48]  Dan Rettmann,et al.  PROMO: Real‐time prospective motion correction in MRI using image‐based tracking , 2010, Magnetic resonance in medicine.

[49]  M. LingJosef,et al.  Gray matter abnormalities in pediatric mild traumatic brain injury. , 2015 .

[50]  A. Dale,et al.  Prospective motion correction improves diagnostic utility of pediatric MRI scans , 2011, Pediatric Radiology.

[51]  H. Wimmer,et al.  Functional abnormalities in the dyslexic brain: A quantitative meta‐analysis of neuroimaging studies , 2009, Human brain mapping.

[52]  Bruce Fischl,et al.  Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops , 2007, IEEE Transactions on Medical Imaging.

[53]  Chris Adamson,et al.  A new neonatal cortical and subcortical brain atlas: the Melbourne Children's Regional Infant Brain (M-CRIB) atlas , 2017, NeuroImage.

[54]  Paul M. Thompson,et al.  Dynamic mapping of hippocampal development in childhood onset schizophrenia , 2007, Schizophrenia Research.

[55]  Sharon Vaughn,et al.  Research-Based Implications From Extensive Early Reading Interventions , 2007 .

[56]  G. Dawson,et al.  Long-Term Outcomes of Early Intervention in 6-Year-Old Children With Autism Spectrum Disorder. , 2015, Journal of the American Academy of Child and Adolescent Psychiatry.

[57]  Ivo D Dinov,et al.  Imputation Strategy for Reliable Regional MRI Morphological Measurements , 2019, Neuroinformatics.

[58]  Hubert Korzilius,et al.  A meta-analytic study on the effectiveness of comprehensive ABA-based early intervention programs for children with Autism Spectrum Disorders , 2011 .

[59]  B. J. Casey,et al.  Anatomical MRI of the developing human brain: what have we learned? , 2001, Journal of the American Academy of Child and Adolescent Psychiatry.

[60]  Mario Sansone,et al.  Automated search of control points in surface-based morphometry , 2018, NeuroImage.

[61]  David H. Miller,et al.  Imaging outcomes for neuroprotection and repair in multiple sclerosis trials , 2009, Nature Reviews Neurology.

[62]  Clifford R Jack,et al.  A comparison of manual tracing and FreeSurfer for estimating hippocampal volume over the adult lifespan , 2018, Human brain mapping.

[63]  Nancy C. Andreasen,et al.  Manual and Automated Measurement of the Whole Thalamus and Mediodorsal Nucleus Using Magnetic Resonance Imaging , 2002, NeuroImage.

[64]  Dirk Smeets,et al.  Evaluation of methods for volumetric analysis of pediatric brain data: The childmetrix pipeline versus adult-based approaches , 2018, NeuroImage: Clinical.

[65]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[66]  D. Daley,et al.  Efficacy of the Incredible Years Basic parent training programme as an early intervention for children with conduct problems and ADHD. , 2007, Child: care, health and development.

[67]  J. Wouters,et al.  Atypical gray matter in children with dyslexia before the onset of reading instruction , 2019, Cortex.

[68]  S. Mostofsky,et al.  Motor Circuit Anatomy in Children with Autism Spectrum Disorder With or Without Attention Deficit Hyperactivity Disorder , 2016, Autism research : official journal of the International Society for Autism Research.

[69]  S. Mostofsky,et al.  Abnormal cerebral cortex structure in children with ADHD , 2009, Human brain mapping.

[70]  J. Giedd,et al.  Subtle in‐scanner motion biases automated measurement of brain anatomy from in vivo MRI , 2016, Human brain mapping.

[71]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[72]  Mert R. Sabuncu,et al.  The influence of head motion on intrinsic functional connectivity MRI , 2012, NeuroImage.

[73]  Walter H. Backes,et al.  Early onset of cortical thinning in children with rolandic epilepsy☆ , 2013, NeuroImage: Clinical.