Automatic bone segmentation in whole-body CT images

PurposeMany diagnostic or treatment planning applications critically depend on the successful localization of bony structures in CT images. Manual or semiautomatic bone segmentation is tedious, however, and often not practical in clinical routine. In this paper, we present a reliable and fully automatic bone segmentation in whole-body CT scans of patients suffering from multiple myeloma.MethodsWe address this problem by using convolutional neural networks with an architecture inspired by the U-Net [17]. In this publication, we compared three training procedures: (1) training from 2D axial slices, (2) a pseudo-3D approach including axial, sagittal and coronal slices and (3) an approach where the network is pre-trained in an unsupervised manner.ResultsWe evaluated the method on an in-house dataset of 18 whole-body CT scans consisting of 6800 axial slices, achieving a dice score of 0.95 and an intersection over union (IOU) of 0.91. Furthermore, we evaluated our method on the dataset used by Peréz-Carrasco et al. (Comput Methods Progr Biomed 156:85–95, 2018). The data and the ground truth have been made publicly available. The proposed method outperformed the other methods, obtaining a dice score of 0.92 and an IOU of 0.85.ConclusionThese promising results could facilitate the evaluation of bone density and the localization of focal lesions in the future, with a potential impact on both disease staging and treatment planning.

[1]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[2]  Manuel Pinheiro,et al.  A New Level-Set-Based Protocol for Accurate Bone Segmentation From CT Imaging , 2015, IEEE Access.

[3]  L.-K. Shark,et al.  Medical Image Segmentation Using New Hybrid Level-Set Method , 2008, 2008 Fifth International Conference BioMedical Visualization: Information Visualization in Medical and Biomedical Informatics.

[4]  B. Clarke,et al.  Normal bone anatomy and physiology. , 2008, Clinical journal of the American Society of Nephrology : CJASN.

[5]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[6]  José Antonio Pérez-Carrasco,et al.  Joint segmentation of bones and muscles using an intensity and histogram-based energy minimization approach , 2018, Comput. Methods Programs Biomed..

[7]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[8]  Woei-Chyn Chu,et al.  Performance measure characterization for evaluating neuroimage segmentation algorithms , 2009, NeuroImage.

[9]  Klaus H. Maier-Hein,et al.  The Medical Imaging Interaction Toolkit: challenges and advances , 2013, International Journal of Computer Assisted Radiology and Surgery.

[10]  Gábor Székely,et al.  Fully automatic and fast segmentation of the femur bone from 3D-CT images with no shape prior , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[11]  Steven K Boyd,et al.  Automatic segmentation of cortical and trabecular compartments based on a dual threshold technique for in vivo micro-CT bone analysis. , 2007, Bone.

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  Peter Glöckner,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2013 .

[14]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[15]  José Antonio Pérez-Carrasco,et al.  Segmentation of bone structures in 3D CT images based on continuous max-flow optimization , 2015, Medical Imaging.

[16]  Klaus H. Maier-Hein,et al.  Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges , 2017, Lecture Notes in Computer Science.

[17]  Steve Kroon,et al.  Unsupervised pre-training for fully convolutional neural networks , 2016, 2016 Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech).

[18]  J. Hillengass,et al.  Multiples Myelom: Aktuelle Empfehlungen für die Bildgebung , 2012, Der Radiologe.

[19]  Xue-Cheng Tai,et al.  Global Minimization for Continuous Multiphase Partitioning Problems Using a Dual Approach , 2011, International Journal of Computer Vision.

[20]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..