Deep learning from MRI-derived labels enables automatic brain tissue classification on human brain CT

Automatic methods for feature extraction, volumetry, and morphometric analysis in clinical neuroscience typically operate on images obtained with magnetic resonance (MR) imaging equipment. Although CT scans are less expensive to acquire and more widely available than MR scans, their application is currently limited to the visual assessment of brain integrity and the exclusion of co-pathologies. CT has rarely been used for tissue classification because the contrast between grey matter and white matter was considered insufficient. In this study, we propose an automatic method for segmenting grey matter (GM), white matter (WM), cerebrospinal fluid (CSF), and intracranial volume (ICV) from head CT images. A U-Net deep learning model was trained and validated on CT images with MRI-derived segmentation labels. We used data from 744 participants of the Gothenburg H70 Birth Cohort Studies for whom CT and T1-weighted MR images had been acquired on the same day. Our proposed model predicted brain tissue classes accurately from unseen CT images (Dice coefficients of 0.79, 0.82, 0.75, 0.93 and 0.98 for GM, WM, CSF, brain volume and ICV, respectively). To contextualize these results, we generated benchmarks based on established MR-based methods and intentional image degradation. Our findings demonstrate that CT-derived segmentations can be used to delineate and quantify brain tissues, opening new possibilities for the use of CT in clinical practice and research.

[1]  Guoyu Qian,et al.  Automatic segmentation of cerebrospinal fluid, white and gray matter in unenhanced computed tomography images. , 2010, Academic radiology.

[2]  Kirk I. Erickson,et al.  Physical activity, fitness, and gray matter volume , 2014, Neurobiology of Aging.

[3]  Wilfried Philips,et al.  MRI Segmentation of the Human Brain: Challenges, Methods, and Applications , 2015, Comput. Math. Methods Medicine.

[4]  Karl J. Friston,et al.  CHAPTER 4 – Rigid Body Registration , 2007 .

[5]  R. Stewart Neuroimaging in dementia and depression , 2001 .

[6]  Ronald Ouwerkerk,et al.  AAPM/RSNA physics tutorials for residents: MR imaging: brief overview and emerging applications. , 2007, Radiographics : a review publication of the Radiological Society of North America, Inc.

[7]  N. Venketasubramanian,et al.  Coronal CT is Comparable to MR Imaging in Aiding Diagnosis of Dementia in a Memory Clinic in Singapore , 2017, Alzheimer disease and associated disorders.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[10]  M. Eckerström,et al.  Increased Risk of Dementia in Subjective Cognitive Decline if CT Brain Changes are Present , 2018, Journal of Alzheimer's disease : JAD.

[11]  Lena Cavallin,et al.  Automated CT-based segmentation and quantification of total intracranial volume , 2015, European Radiology.

[12]  Yingyao Chen,et al.  Equity assessment of the distribution of CT and MRI scanners in China: a panel data analysis , 2018, International Journal for Equity in Health.

[13]  L. Pantoni,et al.  The use of CT in dementia , 2011, International Psychogeriatrics.

[14]  Carl-Fredrik Westin,et al.  Deep learning based segmentation of brain tissue from diffusion MRI , 2021, NeuroImage.

[15]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[16]  Bram Platel,et al.  White Matter and Gray Matter Segmentation in 4D Computed Tomography , 2017, Scientific Reports.

[17]  J T O'Brien,et al.  EFNS guidelines for the diagnosis and management of Alzheimer’s disease , 2010, European journal of neurology.

[18]  M. Lungren,et al.  Preparing Medical Imaging Data for Machine Learning. , 2020, Radiology.

[19]  T Sandor,et al.  Segmentation of brain CT images using the concept of region growing. , 1991, International journal of bio-medical computing.

[20]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[21]  Torsten Rohlfing,et al.  Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains , 2004, NeuroImage.

[22]  Daniel Rueckert,et al.  Magnetic Resonance Imaging of the Newborn Brain: Automatic Segmentation of Brain Images into 50 Anatomical Regions , 2013, PloS one.

[23]  Sotirios A. Tsaftaris,et al.  Medical Image Computing and Computer Assisted Intervention , 2017 .

[24]  S. Knecht,et al.  Decomposing the Hounsfield Unit , 2012, Clinical Neuroradiology.

[25]  Richard Kijowski,et al.  A deep learning approach for 18F-FDG PET attenuation correction , 2018, EJNMMI Physics.

[26]  K. Narr,et al.  Neuroimage: Clinical Effects of Prenatal Alcohol Exposure on the Development of White Matter Volume and Change in Executive Function , 2022 .

[27]  J. O'Brien,et al.  Neuroimaging in dementia and depression , 2000 .

[28]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[29]  Guillermo Sapiro,et al.  Continuous Dice Coefficient: a Method for Evaluating Probabilistic Segmentations , 2018, bioRxiv.

[30]  Amir Alansary,et al.  MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans , 2015, Comput. Intell. Neurosci..

[31]  Sterling C. Johnson,et al.  Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images , 2017, ArXiv.

[32]  M. Hayt MRI in practice , 1999 .

[33]  Daniel Rueckert,et al.  Brain Extraction Using Label Propagation and Group Agreement: Pincram , 2015, PloS one.

[34]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[35]  Y. Hu,et al.  Aging and the Brain: A Quantitative Study of Clinical CT Images , 2020, American Journal of Neuroradiology.

[36]  W. M. van der Flier,et al.  Diagnostic imaging of patients in a memory clinic: comparison of MR imaging and 64-detector row CT. , 2009, Radiology.

[37]  Xiaoying Tang,et al.  Skip Connection U-Net for White Matter Hyperintensities Segmentation From MRI , 2019, IEEE Access.

[38]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[39]  S. Resnick,et al.  Longitudinal pattern of regional brain volume change differentiates normal aging from MCI , 2009, Neurology.

[40]  Karl J. Friston,et al.  Incorporating Prior Knowledge into Image Registration , 1997, NeuroImage.

[41]  Dane Rayment,et al.  Neuroimaging in dementia: an update for the general clinician , 2016 .

[42]  B. Fischl,et al.  FastSurfer - A fast and accurate deep learning based neuroimaging pipeline , 2019, NeuroImage.

[43]  Guoyan Zheng,et al.  Multi-stream 3D FCN with multi-scale deep supervision for multi-modality isointense infant brain MR image segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[44]  Carl-Fredrik Westin,et al.  Deep learning based segmentation of brain tissue from diffusion MRI , 2020, NeuroImage.

[45]  Simon K. Warfield,et al.  Highly Accurate Segmentation of Brain Tissue and Subcortical Gray Matter from Newborn MRI , 2006, MICCAI.

[46]  E. Gordon,et al.  Widespread reductions in gray matter volume in depression☆ , 2013, NeuroImage: Clinical.

[47]  Xiaohong W. Gao,et al.  Classification of CT brain images based on deep learning networks , 2017, Comput. Methods Programs Biomed..

[48]  Rashindra Manniesing,et al.  Multiclass Brain Tissue Segmentation in 4D CT Using Convolutional Neural Networks , 2019, IEEE Access.

[49]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[50]  Bradley J. Erickson,et al.  Robust brain extraction tool for CT head images , 2020, Neurocomputing.

[51]  P. Bosco,et al.  Brain atrophy in Alzheimer’s Disease and aging , 2016, Ageing Research Reviews.

[52]  Parashkev Nachev,et al.  Computer Methods and Programs in Biomedicine NiftyNet: a deep-learning platform for medical imaging , 2022 .

[53]  J. Rapoport,et al.  Child Psychiatry Branch of the National Institute of Mental Health Longitudinal Structural Magnetic Resonance Imaging Study of Human Brain Development , 2015, Neuropsychopharmacology.

[54]  Arnau Oliver,et al.  Acute ischemic stroke lesion core segmentation in CT perfusion images using fully convolutional neural networks , 2019, Comput. Biol. Medicine.

[55]  K. Blennow,et al.  The Gothenburg H70 Birth cohort study 2014–16: design, methods and study population , 2018, European Journal of Epidemiology.

[56]  Nassir Navab,et al.  QuickNAT: A fully convolutional network for quick and accurate segmentation of neuroanatomy , 2018, NeuroImage.

[57]  Hervé Delingette,et al.  Deep learning with mixed supervision for brain tumor segmentation , 2018, Journal of medical imaging.

[58]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[59]  S. Fielden,et al.  Automated Segmentation of Head Computed Tomography Images Using FSL , 2017, Journal of computer assisted tomography.

[60]  Mohammad Mansouri,et al.  An explainable deep-learning algorithm for the detection of acute intracranial haemorrhage from small datasets , 2018, Nature Biomedical Engineering.

[61]  C. Caltagirone,et al.  Validation of the Guidelines for the Diagnosis of Dementia and Alzheimer’s Disease of the Italian Neurological Society. Study in 72 Italian neurological centres and 1549 patients , 2004, Neurological Sciences.

[62]  Marc Modat,et al.  Adaptive Neonate Brain Segmentation , 2011, MICCAI.

[63]  M. Mintun,et al.  Brain volume decline in aging: evidence for a relation between socioeconomic status, preclinical Alzheimer disease, and reserve. , 2008, Archives of neurology.

[64]  Guoyan Zheng,et al.  Multi-stream 3D FCN with multi-scale deep supervision for multi-modality isointense infant brain MR image segmentation , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[65]  Tamer S. Ibrahim,et al.  MR Imaging: Brief Overview and Emerging Applications1 , 2008 .