3D Pulmonary Artery Segmentation from CTA Scans Using Deep Learning with Realistic Data Augmentation

The characterization of the vasculature in the mediastinum, more specifically the pulmonary artery, is of vital importance for the evaluation of several pulmonary vascular diseases. Thus, the goal of this study is to automatically segment the pulmonary artery (PA) from computed tomography angiography images, which opens up the opportunity for more complex analysis of the evolution of the PA geometry in health and disease and can be used in complex fluid mechanics models or individualized medicine. For that purpose, a new 3D convolutional neural network architecture is proposed, which is trained on images coming from different patient cohorts. The network makes use a strong data augmentation paradigm based on realistic deformations generated by applying principal component analysis to the deformation fields obtained from the affine registration of several datasets. The network is validated on 91 datasets by comparing the automatic segmentations with semi-automatically delineated ground truths in terms of mean Dice and Jaccard coefficients and mean distance between surfaces, which yields values of 0.89, 0.80 and 1.25 mm, respectively. Finally, a comparison against a Unet architecture is also included.

[1]  B. Gosselin,et al.  Segmentation of Opacified Thorax Vessels using Model-driven Active Contour , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[2]  Raúl San José Estépar,et al.  Deep-learning strategy for pulmonary artery-vein classification of non-contrast CT images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[3]  Udo Hoffmann,et al.  Reference Values for Normal Pulmonary Artery Dimensions by Noncontrast Cardiac Computed Tomography: The Framingham Heart Study , 2012, Circulation. Cardiovascular imaging.

[4]  Tatjana Zrimec,et al.  Automatic segmentation and analysis of the main pulmonary artery on standard post-contrast CT studies using iterative erosion and dilation , 2016, International Journal of Computer Assisted Radiology and Surgery.

[5]  Eugenio Culurciello,et al.  ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation , 2016, ArXiv.

[6]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[7]  Yousef Ebrahimdoost,et al.  Automatic segmentation of Pulmonary Artery (PA) in 3D pulmonary CTA images , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[8]  Benoit M. Macq,et al.  Model-guided segmentation of opacified thorax vessels , 2005, IEEE International Conference on Image Processing 2005.

[9]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[10]  Rashindra Manniesing,et al.  Artery and vein segmentation of the cerebral vasculature in 4D CT using a 3D fully convolutional neural network , 2018, Medical Imaging.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  M. Gladwin,et al.  Segmentation and quantification of pulmonary artery for noninvasive CT assessment of sickle cell secondary pulmonary hypertension. , 2010, Medical physics.

[14]  Bulat Ibragimov,et al.  Combining deep learning with anatomical analysis for segmentation of the portal vein for liver SBRT planning , 2017, Physics in medicine and biology.