CT image segmentation of bone for medical additive manufacturing using a convolutional neural network

BACKGROUND The most tedious and time-consuming task in medical additive manufacturing (AM) is image segmentation. The aim of the present study was to develop and train a convolutional neural network (CNN) for bone segmentation in computed tomography (CT) scans. METHOD The CNN was trained with CT scans acquired using six different scanners. Standard tessellation language (STL) models of 20 patients who had previously undergone craniotomy and cranioplasty using additively manufactured skull implants served as "gold standard" models during CNN training. The CNN segmented all patient CT scans using a leave-2-out scheme. All segmented CT scans were converted into STL models and geometrically compared with the gold standard STL models. RESULTS The CT scans segmented using the CNN demonstrated a large overlap with the gold standard segmentation and resulted in a mean Dice similarity coefficient of 0.92 ± 0.04. The CNN-based STL models demonstrated mean surface deviations ranging between -0.19 mm ± 0.86 mm and 1.22 mm ± 1.75 mm, when compared to the gold standard STL models. No major differences were observed between the mean deviations of the CNN-based STL models acquired using six different CT scanners. CONCLUSIONS The fully-automated CNN was able to accurately segment the skull. CNNs thus offer the opportunity of removing the current prohibitive barriers of time and effort during CT image segmentation, making patient-specific AM constructs more accesible.

[1]  A. Mäkitie,et al.  Inaccuracies in additive manufactured medical skull models caused by the DICOM to STL conversion process. , 2014, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[2]  Richard Kijowski,et al.  Deep convolutional neural network and 3D deformable approach for tissue segmentation in musculoskeletal magnetic resonance imaging , 2018, Magnetic resonance in medicine.

[3]  Mariano Alcañiz Raya,et al.  Automatic Segmentation of Jaw Tissues in CT Using Active Appearance Models and Semi-automatic Landmarking , 2006, MICCAI.

[4]  Stefan Wesarg,et al.  Articulated atlas for segmentation of the skeleton from head & neck CT datasets , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[5]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[6]  Foster J. Provost,et al.  Learning When Training Data are Costly: The Effect of Class Distribution on Tree Induction , 2003, J. Artif. Intell. Res..

[7]  Bethany C Gross,et al.  Evaluation of 3D printing and its potential impact on biotechnology and the chemical sciences. , 2014, Analytical chemistry.

[8]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[9]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[10]  Gustavo E. A. P. A. Batista,et al.  A study of the behavior of several methods for balancing machine learning training data , 2004, SKDD.

[11]  Hans-Christian Hege,et al.  A 3D statistical shape model of the pelvic bone for segmentation , 2004, SPIE Medical Imaging.

[12]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[13]  Mika Salmi,et al.  Accuracy of medical models made by additive manufacturing (rapid manufacturing). , 2013, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[14]  Leo Joskowicz,et al.  Automatic Liver Tumor Segmentation in Follow-Up CT Scans: Preliminary Method and Results , 2015, Patch-MI@MICCAI.

[15]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[16]  Hamid Abrishami Moghaddam,et al.  Skull Segmentation and Reconstruction From Newborn CT Images Using Coupled Level Sets , 2016, IEEE Journal of Biomedical and Health Informatics.

[17]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Theo van Walsum,et al.  Random Forest-Based Bone Segmentation in Ultrasound. , 2017, Ultrasound in medicine & biology.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  C. L. Ventola Medical Applications for 3D Printing: Current and Projected Uses. , 2014, P & T : a peer-reviewed journal for formulary management.

[21]  Xavier Lladó,et al.  Quantitative Analysis of Patch-Based Fully Convolutional Neural Networks for Tissue Segmentation on Brain Magnetic Resonance Imaging , 2018, IEEE Access.

[22]  Stuart Crozier,et al.  Automatic Segmentation of Articular Cartilage in Magnetic Resonance Images of the Knee , 2007, MICCAI.

[23]  Neeraj Sharma,et al.  Automated medical image segmentation techniques , 2010, Journal of medical physics.

[24]  Daniël M Pelt,et al.  A mixed-scale dense convolutional neural network for image analysis , 2017, Proceedings of the National Academy of Sciences.

[25]  Paul J. Rullkoetter,et al.  Development of subject-specific and statistical shape models of the knee using an efficient segmentation and mesh-morphing approach , 2010, Comput. Methods Programs Biomed..

[26]  Jan Wolff,et al.  CT image segmentation methods for bone used in medical additive manufacturing. , 2018, Medical engineering & physics.

[27]  Le Lu,et al.  Pancreas Segmentation in MRI Using Graph-Based Decision Fusion on Convolutional Neural Networks , 2016, MICCAI.

[28]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[29]  Deshan Yang,et al.  Automatic and hierarchical segmentation of the human skeleton in CT images , 2017, Physics in medicine and biology.

[30]  Jiapan Guo,et al.  3D segmentation of mandible from multisectional CT scans by convolutional neural networks , 2018, ArXiv.

[31]  Nadia Magnenat-Thalmann,et al.  Robust statistical shape models for MRI bone segmentation in presence of small field of view , 2011, Medical Image Anal..

[32]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[33]  Bram van Ginneken,et al.  Iterative convolutional neural networks for automatic vertebra identification and segmentation in CT images , 2018, Medical Imaging.

[34]  Christopher Joseph Pal,et al.  Convolutional networks for kidney segmentation in contrast-enhanced CT scans , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[35]  Odelin Charron,et al.  Automatic detection and segmentation of brain metastases on multimodal MR images with a deep convolutional neural network , 2018, Comput. Biol. Medicine.

[36]  Gregory J. Wiet,et al.  Atlas-Based Segmentation of Temporal Bone Anatomy , 2017, International Journal of Computer Assisted Radiology and Surgery.

[37]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Marc Fournier,et al.  Automatic segmentation of newborns’ skull and fontanel from CT data using model-based variational level set , 2014, Signal Image Video Process..

[39]  Ulas Bagci,et al.  Robust and fully automated segmentation of mandible from CT scans , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[40]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[41]  Juan de Lara,et al.  Supporting user-oriented analysis for multi-view domain-specific visual languages , 2009, Inf. Softw. Technol..

[42]  Christopher Elamri A New Algorithm for Fully Automatic Brain Tumor Segmentation with 3-D Convolutional Neural Networks , 2016 .

[43]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[44]  H. Aerts,et al.  Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric MR , 2017, Scientific Reports.

[45]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[46]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[47]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[48]  Martin J. Wainwright,et al.  Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions , 2011, ICML.

[49]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[50]  Ronald M. Summers,et al.  A Bottom-Up Approach for Pancreas Segmentation Using Cascaded Superpixels and (Deep) Image Patch Labeling , 2015, IEEE Transactions on Image Processing.

[51]  Timothy F. Cootes,et al.  Fully Automatic Segmentation of the Proximal Femur Using Random Forest Regression Voting , 2013, IEEE Transactions on Medical Imaging.

[52]  G. Tapia,et al.  A Review on Process Monitoring and Control in Metal-Based Additive Manufacturing , 2014 .

[53]  Deukhee Lee,et al.  Automatic Spine Segmentation using Convolutional Neural Network via Redundant Generation of Class Labels for 3D Spine Modeling , 2017, ArXiv.

[54]  Ron Kikinis,et al.  Improved watershed transform for medical image segmentation using prior information , 2004, IEEE Transactions on Medical Imaging.

[55]  Sunil Agrawal,et al.  A Comparative Analysis of Thresholding and Edge Detection Segmentation Techniques , 2012 .

[56]  Maureen van Eijnatten,et al.  The impact of manual threshold selection in medical additive manufacturing , 2016, International Journal of Computer Assisted Radiology and Surgery.

[57]  Arakua Welbeck,et al.  Segmentation of the Proximal Femur from MR Images using Deep Convolutional Neural Networks , 2018, Scientific Reports.

[58]  M. Mohammed Thaha,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2019, Journal of Medical Systems.

[59]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[60]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[61]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[62]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.