Complex Grey Matter Structure Segmentation in Brains via Deep Learning: Example of the Claustrum

Segmentationand parcellation of the brain has been widely performed on brain MRI using atlas-based methods. However, segmentation of the claustrum, a thin and sheet-like structure between insular cortex and putamen has not been amenable to automatized segmentation, thus limiting its investigation in larger imaging cohorts. Recently, deep-learning based approaches have been introduced for automated segmentation of brain structures, yielding great potential to overcome preexisting limitations. In the following, we present a multi-view deep-learning based approach to segment the claustrum in T1-weighted MRI scans. We trained and evaluated the proposed method on 181 manual bilateral claustrum annotations by an expert neuroradiologist serving as reference standard. Cross-validation experiments yielded median volumetric similarity, robust Hausdor? distance and Dice score of 93.3%, 1.41mm and 71.8% respectively which represents equal or superior segmentation performance compared to human intra-rater reliability. Leave-one-scanner-out evaluation showed good transfer-ability of the algorithm to images from unseen scanners, however at slightly inferior performance. Furthermore, we found that AI-based claustrum segmentation benefits from multi-view information and requires sample sizes of around 75 MRI scans in the training set. In conclusion, the developed algorithm has large potential in independent study cohorts and to facilitate MRI-based research of the human claustrum through automated segmentation. The software and models of our method are made publicly available.

[1]  N. Makris,et al.  Decreased volume of left and total anterior insular lobule in schizophrenia , 2006, Schizophrenia Research.

[2]  Jie Wei,et al.  M3Net: A multi-model, multi-size, and multi-view deep neural network for brain magnetic resonance image segmentation , 2019, Pattern Recognit..

[3]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[4]  Konstantinos Kamnitsas,et al.  Unsupervised domain adaptation in brain lesion segmentation with adversarial networks , 2016, IPMI.

[5]  S. Marino,et al.  Inter-hemispheric Claustral Connections in Human Brain: A Constrained Spherical Deconvolution-Based Study , 2017, Clinical Neuroradiology.

[6]  Cheng-Lin Liu,et al.  Multi-view Semi-supervised 3D Whole Brain Segmentation with a Self-ensemble Network , 2019, MICCAI.

[7]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[8]  Julien Cohen-Adad,et al.  Spinal cord grey matter segmentation challenge , 2017, NeuroImage.

[9]  Bjoern H. Menze,et al.  Automated analysis of whole brain vasculature using machine learning , 2019, bioRxiv.

[10]  Daniel C. Castro,et al.  Domain Generalization via Model-Agnostic Learning of Semantic Features , 2019, NeurIPS.

[11]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[12]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[13]  A. Horn,et al.  Optimization and comparative evaluation of nonlinear deformation algorithms for atlas-based segmentation of DBS target nuclei , 2019, NeuroImage.

[14]  W. Davis,et al.  The Claustrum in Autism and Typically Developing Male Children: A Quantitative MRI Study , 2008 .

[15]  Refaat E Gabr,et al.  Brain and lesion segmentation in multiple sclerosis using fully convolutional neural networks: A large-scale study , 2020, Multiple sclerosis.

[16]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  S. Rauch,et al.  Structural brain magnetic resonance imaging of limbic and thalamic volumes in pediatric bipolar disorder. , 2005, The American journal of psychiatry.

[19]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[20]  Daniel Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2020, Frontiers in Cardiovascular Medicine.

[21]  Kawal S. Rhode,et al.  CardiacNET: Segmentation of Left Atrium and Proximal Pulmonary Veins from MRI Using Multi-view CNN , 2017, MICCAI.

[22]  Simon Andermatt,et al.  Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challenge , 2019, IEEE Transactions on Medical Imaging.

[23]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[24]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[25]  Simon B Eickhoff,et al.  Imaging-based parcellations of the human brain , 2018, Nature Reviews Neuroscience.

[26]  Wei-Shi Zheng,et al.  Fully convolutional network ensembles for white matter hyperintensities segmentation in MR images , 2018, NeuroImage.

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  Renate Meyer,et al.  Cognitive status, language attainment, and prereading skills of 6‐year‐old very preterm children and their peers: the Bavarian Longitudinal Study , 1999, Developmental medicine and child neurology.

[29]  P. Fox,et al.  Identification of a common neurobiological substrate for mental illness. , 2015, JAMA psychiatry.

[30]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[31]  Pierrick Coupé,et al.  Author manuscript, published in "Journal of Magnetic Resonance Imaging 2010;31(1):192-203" DOI: 10.1002/jmri.22003 Adaptive Non-Local Means Denoising of MR Images with Spatially Varying Noise Levels , 2010 .

[32]  Daniel C. Castro,et al.  Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effects , 2019, ArXiv.