Automated joint skull-stripping and segmentation with Multi-Task U-Net in large mouse brain MRI databases

Skull-stripping and region segmentation are fundamental steps in preclinical magnetic resonance imaging (MRI) studies, and these common procedures are usually performed manually. We present Multi-task U-Net (MU-Net), a convolutional neural network designed to accomplish both tasks simultaneously. MU-Net achieved higher segmentation accuracy than state-of-the-art multi-atlas segmentation methods with an inference time of 0.35 seconds and no pre-processing requirements. We evaluated the performance of our network in the presence of skip connections and recently proposed framing connections, finding the simplest network to be the most effective. We tested MU-Net with an unusually large dataset combining several independent studies consisting of 1,782 mouse brain MRI volumes of both healthy and Huntington animals, and measured average Dice scores of 0.906 (striati), 0.937 (cortex), and 0.978 (brain mask). These high evaluation scores demonstrate that MU-Net is a powerful tool for segmentation and skull-stripping, decreasing inter and intra-rater variability of manual segmentation. The MU-Net code and the trained model are publicly available at https://github.com/Hierakonpolis/MU-Net.

[1]  Anders M. Dale,et al.  Automated segmentation of neuroanatomical structures in multispectral MR microscopy of the mouse brain , 2005, NeuroImage.

[2]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[3]  G. Johnson,et al.  A Diffusion MRI Tractography Connectome of the Mouse Brain and Comparison with Neuronal Tracer Data , 2015, Cerebral cortex.

[4]  Snehashis Roy,et al.  A deep learning framework for brain extraction in humans and animals with traumatic brain injury , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[5]  Federico Giove,et al.  Towards an efficient segmentation of small rodents brain: a short critical review , 2019, Journal of Neuroscience Methods.

[6]  Paul M Matthews,et al.  Technologies: preclinical imaging for drug development. , 2013, Drug discovery today. Technologies.

[7]  Sébastien Ourselin,et al.  Automatic Structural Parcellation of Mouse Brain MRI Using Multi-Atlas Label Fusion , 2014, PloS one.

[8]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Anqi Qiu,et al.  Atlas-based automatic mouse brain image segmentation revisited: model complexity vs. image registration. , 2012, Magnetic resonance imaging.

[10]  G Allan Johnson,et al.  Small Animal Multivariate Brain Analysis (SAMBA) – a High Throughput Pipeline with a Validation Framework , 2018, Neuroinformatics.

[11]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Sébastien Ourselin,et al.  STEPS: Similarity and Truth Estimation for Propagated Segmentations and its application to hippocampal segmentation and brain parcelation , 2013, Medical Image Anal..

[13]  Alan C. Evans,et al.  A three-dimensional MRI atlas of the mouse brain with estimates of the average and variability. , 2005, Cerebral cortex.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[16]  R Mark Henkelman,et al.  MRI phenotyping of genetically altered mice. , 2011, Methods in molecular biology.

[17]  Binbin Nie,et al.  A stereotaxic MRI template set of mouse brain with fine sub-anatomical delineations: Application to MEMRI studies of 5XFAD mice. , 2019, Magnetic resonance imaging.

[18]  M. Jenkinson Non-linear registration aka Spatial normalisation , 2007 .

[19]  Brian B. Avants,et al.  The optimal template effect in hippocampus studies of diseased populations , 2010, NeuroImage.

[20]  Anqi Qiu,et al.  Robust Automatic Rodent Brain Extraction Using 3-D Pulse-Coupled Neural Networks (PCNN) , 2011, IEEE Transactions on Image Processing.

[21]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[24]  Bin Yang,et al.  MedGAN: Medical Image Translation using GANs , 2018, Comput. Medical Imaging Graph..

[25]  Marc Modat,et al.  Multi Atlas Segmentation applied to in vivo mouse brain MRI , 2012 .

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Domingos Vieira,et al.  Preclinical Imaging: an Essential Ally in Modern Biosciences , 2013, Molecular Diagnosis & Therapy.

[29]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[30]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Anders M. Dale,et al.  Automated segmentation of the actively stained mouse brain using multi-spectral MR microscopy , 2008, NeuroImage.

[32]  Scott Hamilton,et al.  In Vivo 3D Digital Atlas Database of the Adult C57BL/6J Mouse Brain by Magnetic Resonance Microscopy , 2008, Frontiers in neuroanatomy.

[33]  Sébastien Ourselin,et al.  Multi-STEPS: Multi-label similarity and truth estimation for propagated segmentations , 2012, 2012 IEEE Workshop on Mathematical Methods in Biomedical Image Analysis.

[34]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[35]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[36]  Pallav Sengupta,et al.  Men and mice: Relating their ages. , 2016, Life sciences.

[37]  Rong Pan,et al.  Automated segmentation of mouse brain images using extended MRF , 2009, NeuroImage.

[38]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[39]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[40]  Nassir Navab,et al.  QuickNAT: Segmenting MRI Neuroanatomy in 20 seconds , 2018, ArXiv.

[41]  Jussi Tohka,et al.  Automatic Rodent Brain MRI Lesion Segmentation with Fully Convolutional Networks , 2019, MLMI@MICCAI.

[42]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[43]  Angelo Bifone,et al.  A stereotaxic MRI template set for the rat brain with tissue class distribution maps and co-registered anatomical atlas: Application to pharmacological MRI , 2006, NeuroImage.

[44]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[45]  G Allan Johnson,et al.  4D MRI of polycystic kidneys from rapamycin‐treated Glis3‐deficient mice , 2015, NMR in biomedicine.

[46]  Milan Sonka,et al.  RATS: Rapid Automatic Tissue Segmentation in rodent brain MRI , 2014, Journal of Neuroscience Methods.

[47]  Septimiu E. Salcudean,et al.  Reducing the Hausdorff Distance in Medical Image Segmentation With Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[48]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[49]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[50]  Marcelo Febo,et al.  Preclinical Magnetic Resonance Imaging and Spectroscopy Studies of Memory, Aging, and Cognitive Decline , 2016, Front. Aging Neurosci..

[51]  Hui Xiong,et al.  A Comprehensive Survey on Transfer Learning , 2021, Proceedings of the IEEE.

[52]  Mario Damiano,et al.  Semi-automated registration-based anatomical labelling, voxel based morphometry and cortical thickness mapping of the mouse brain , 2016, Journal of Neuroscience Methods.

[53]  Bradford C. Dickerson,et al.  A reliable protocol for the manual segmentation of the human amygdala and its subregions using ultra-high resolution MRI , 2012, NeuroImage.

[54]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.