Anatomy‐guided joint tissue segmentation and topological correction for 6‐month infant brain MRI with risk of autism

Tissue segmentation of infant brain MRIs with risk of autism is critically important for characterizing early brain development and identifying biomarkers. However, it is challenging due to low tissue contrast caused by inherent ongoing myelination and maturation. In particular, at around 6 months of age, the voxel intensities in both gray matter and white matter are within similar ranges, thus leading to the lowest image contrast in the first postnatal year. Previous studies typically employed intensity images and tentatively estimated tissue probabilities to train a sequence of classifiers for tissue segmentation. However, the important prior knowledge of brain anatomy is largely ignored during the segmentation. Consequently, the segmentation accuracy is still limited and topological errors frequently exist, which will significantly degrade the performance of subsequent analyses. Although topological errors could be partially handled by retrospective topological correction methods, their results may still be anatomically incorrect. To address these challenges, in this article, we propose an anatomy‐guided joint tissue segmentation and topological correction framework for isointense infant MRI. Particularly, we adopt a signed distance map with respect to the outer cortical surface as anatomical prior knowledge, and incorporate such prior information into the proposed framework to guide segmentation in ambiguous regions. Experimental results on the subjects acquired from National Database for Autism Research demonstrate the effectiveness to topological errors and also some levels of robustness to motion. Comparisons with the state‐of‐the‐art methods further demonstrate the advantages of the proposed method in terms of both segmentation accuracy and topological correctness.

[1]  Daniel Rueckert,et al.  The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction , 2017, NeuroImage.

[2]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[3]  Dinggang Shen,et al.  Cerebral Cortex doi:10.1093/cercor/bhs043 Cerebral Cortex Advance Access published February 24, 2012 The Synchronization within and Interaction between the Default and Dorsal Attention Networks in Early Infancy , 2022 .

[4]  John H. Gilmore,et al.  Automatic segmentation of MR images of the developing newborn brain , 2005, Medical Image Anal..

[5]  G. Dichter,et al.  Future Directions for Research in Autism Spectrum Disorders , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[6]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Xiao Han,et al.  CRUISE: Cortical reconstruction using implicit surface evolution , 2004, NeuroImage.

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  D. Amaral,et al.  Early brain enlargement and elevated extra-axial fluid in infants who develop autism spectrum disorder. , 2013, Brain : a journal of neurology.

[10]  Guido Gerig,et al.  Increased Extra-axial Cerebrospinal Fluid in High-Risk Infants Who Later Develop Autism , 2017, Biological Psychiatry.

[11]  Dinggang Shen,et al.  4D Multi-Modality Tissue Segmentation of Serial Infant Images , 2012, PloS one.

[12]  Laura Gui,et al.  Morphology-driven automatic segmentation of MR images of the neonatal brain , 2012, Medical Image Anal..

[13]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[14]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[15]  Dinggang Shen,et al.  CLASSIC: Consistent Longitudinal Alignment and Segmentation for Serial Image Computing , 2006, NeuroImage.

[16]  Anders M. Dale,et al.  Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex , 2001, IEEE Transactions on Medical Imaging.

[17]  F. Gilles,et al.  Gyral development of the human brain , 1977, Transactions of the American Neurological Association.

[18]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[19]  Mayhew Tm,et al.  The cerebrum and cerebellum of the fixed human brain: efficient and unbiased estimates of volumes and cortical surface areas. , 1989 .

[20]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[21]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Ron Kikinis,et al.  Adaptive Template Moderated Spatially Varying Statistical Classification , 1998, MICCAI.

[23]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[24]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[25]  Eric Courchesne,et al.  Patches of disorganization in the neocortex of children with autism. , 2014, The New England journal of medicine.

[26]  Robert T. Schultz,et al.  Segmentation and Measurement of the Cortex from 3D MR Images , 1998, MICCAI.

[27]  Elizabeth R Sowell,et al.  Promise for finding brain biomarkers among infants at high familial risk for developing autism spectrum disorders. , 2012, The American journal of psychiatry.

[28]  Yaozong Gao,et al.  Segmentation of neonatal brain MR images using patch-driven level sets , 2014, NeuroImage.

[29]  Thomas B. Moeslund,et al.  Long-Term Occupancy Analysis Using Graph-Based Optimisation in Thermal Imagery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Dinggang Shen,et al.  Automatic segmentation of neonatal images using convex optimization and coupled level sets , 2011, NeuroImage.

[31]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2014, NeuroImage.

[32]  Samuel B. Guze,et al.  Diagnostic and Statistical Manual of Mental Disorders, 4th ed. (DSM-IV) , 1995 .

[33]  Bram van Ginneken,et al.  Segmentation of the posterior ribs in chest radiographs using iterated contextual pixel classification , 2006, IEEE Transactions on Medical Imaging.

[34]  J. Mangin,et al.  Atlas-Free Surface Reconstruction of the Cortical Grey-White Interface in Infants , 2011, PloS one.

[35]  Dinggang Shen,et al.  Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces , 2014, NeuroImage.

[36]  Alan C. Evans,et al.  Brain volume findings in 6-month-old infants at high familial risk for autism. , 2012, The American journal of psychiatry.

[37]  Dinggang Shen,et al.  Learning-Based Topological Correction for Infant Cortical Surfaces , 2016, MICCAI.

[38]  Dinggang Shen,et al.  CLASSIC: Consistent Longitudinal Alignment and Segmentation for Serial Image Computing , 2005, IPMI.

[39]  Bruce Fischl,et al.  Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops , 2007, IEEE Transactions on Medical Imaging.

[40]  J. Gilmore,et al.  Spatial Patterns, Longitudinal Development, and Hemispheric Asymmetries of Cortical Thickness in Infants from Birth to 2 Years of Age , 2015, The Journal of Neuroscience.

[41]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[43]  Ben Glocker,et al.  Encoding atlases by randomized classification forests for efficient multi-atlas label propagation , 2014, Medical Image Anal..

[44]  Dinggang Shen,et al.  Altered Structural Connectivity in Neonates at Genetic Risk for Schizophrenia: a Combined Study Using Morphological and White Matter Networks , 2022 .

[45]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  Guido Gerig,et al.  Differences in white matter fiber tract development present from 6 to 24 months in infants with autism. , 2012, The American journal of psychiatry.

[47]  Suyash P. Awate,et al.  Clinical Neonatal Brain MRI Segmentation Using Adaptive Nonparametric Data Models and Intensity-Based Markov Priors , 2007, MICCAI.

[48]  Esa Alhoniemi,et al.  Gaussian mixture model-based segmentation of MR images taken from premature infant brains , 2009, Journal of Neuroscience Methods.

[49]  Yaozong Gao,et al.  Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation , 2014, NeuroImage.

[50]  Dinggang Shen,et al.  Neonatal brain image segmentation in longitudinal MRI studies , 2010, NeuroImage.

[51]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[52]  Daniel Rueckert,et al.  Automatic segmentation and reconstruction of the cortex from neonatal MRI , 2007, NeuroImage.

[53]  Daniel Rueckert,et al.  Regional growth and atlasing of the developing human brain , 2016, NeuroImage.

[54]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[55]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[56]  T M Mayhew,et al.  The cerebrum and cerebellum of the fixed human brain: efficient and unbiased estimates of volumes and cortical surface areas. , 1989, Journal of anatomy.

[57]  Guido Gerig,et al.  Longitudinal Modeling of Multi-modal Image Contrast Reveals Patterns of Early Brain Growth , 2017, MICCAI.

[58]  Brian B. Avants,et al.  Evaluation of automatic neonatal brain segmentation algorithms: The NeoBrainS12 challenge , 2015, Medical Image Anal..

[59]  Daniel Rueckert,et al.  Automatic Whole Brain MRI Segmentation of the Developing Neonatal Brain , 2014, IEEE Transactions on Medical Imaging.

[60]  Alan C. Evans,et al.  Maturation of white matter in the human brain: a review of magnetic resonance studies , 2001, Brain Research Bulletin.

[61]  Alan C. Evans,et al.  Early brain development in infants at high risk for autism spectrum disorder , 2017, Nature.

[62]  Dinggang Shen,et al.  Construction of multi-region-multi-reference atlases for neonatal brain MRI segmentation , 2010, NeuroImage.

[63]  Xiao Han Learning-Boosted Label Fusion for Multi-atlas Auto-Segmentation , 2013, MLMI.

[64]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[65]  Pierre-Louis Bazin,et al.  Topology Preserving Tissue Classification with Fast Marching and Topology Templates , 2005, IPMI.

[66]  Ayman El-Baz,et al.  Towards Non-invasive Image-Based Early Diagnosis of Autism , 2015, MICCAI.

[67]  Dinggang Shen,et al.  CENTS: Cortical enhanced neonatal tissue segmentation , 2011, Human brain mapping.

[68]  Dinggang Shen,et al.  Cortical thickness and surface area in neonates at high risk for schizophrenia , 2014, Brain Structure and Function.

[69]  Arthur W. Toga,et al.  Cortical Surface Reconstruction via Unified Reeb Analysis of Geometric and Topological Outliers in Magnetic Resonance Images , 2013, IEEE Transactions on Medical Imaging.

[70]  N DeviChelli,et al.  Neonatal brain MRI segmentation , 2015 .

[71]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[72]  Christian Gaser,et al.  Topological correction of brain surface meshes using spherical harmonics , 2010, MICCAI.

[73]  Simon K. Warfield,et al.  Automatic segmentation of newborn brain MRI , 2009, NeuroImage.

[74]  Chelli N. Devi,et al.  Neonatal brain MRI segmentation: A review , 2015, Comput. Biol. Medicine.

[75]  J. Gilmore,et al.  Dynamic Development of Regional Cortical Thickness and Surface Area in Early Childhood. , 2015, Cerebral cortex.

[76]  Irfan A. Essa,et al.  Tree-based Classifiers for Bilayer Video Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[77]  J. Gilmore,et al.  Structural and Maturational Covariance in Early Childhood Brain Development , 2016, Cerebral cortex.

[78]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[79]  Richard M. Leahy,et al.  Automated graph-based analysis and correction of cortical volume topology , 2001, IEEE Transactions on Medical Imaging.

[80]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[81]  Alan C. Evans,et al.  A fully automatic and robust brain MRI tissue classification method , 2003, Medical Image Anal..

[82]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[83]  J. Gilmore,et al.  Mapping Longitudinal Development of Local Cortical Gyrification in Infants from Birth to 2 Years of Age , 2014, The Journal of Neuroscience.

[84]  Bruce Fischl,et al.  A FreeSurfer-compliant consistent manual segmentation of infant brains spanning the 0–2 year age range , 2015, Front. Hum. Neurosci..

[85]  Daniel Rueckert,et al.  A review on automatic fetal and neonatal brain MRI segmentation , 2017, NeuroImage.

[86]  Petronella Anbeek,et al.  Probabilistic Brain Tissue Segmentation in Neonatal Magnetic Resonance Imaging , 2008, Pediatric Research.

[87]  Anqi Qiu,et al.  COMT haplotypes modulate associations of antenatal maternal anxiety and neonatal cortical morphology. , 2015, The American journal of psychiatry.