A Two-Stage Convolutional Neural Network for Pulmonary Embolism Detection From CTPA Images

This paper presents a two-stage convolutional neural network (CNN) for automated detection of pulmonary embolisms (PEs) on CT pulmonary angiography (CTPA) images. The first stage utilizes a novel 3D candidate proposal network that detects a set of cubes containing suspected PEs from the entire 3D CTPA volume. In the second stage, each candidate cube is transformed to be aligned to the direction of the affected vessel and the cross-sections of the vessel-aligned cubes are input to a 2D classification network for false positive elimination. We have evaluated our approach using both the test dataset from the PE challenge and our own dataset consisting of 129 CTPA data with a total of 269 embolisms. The experimental results demonstrate that our method achieves a sensitivity of 75.4% at two false positives per scan at 0 mm localization error, which is superior to the winning system in the literature (i.e., sensitivity of 60.8% at the same level of false positives and localization error). On our own dataset, our method achieves sensitivities of 76.3%, 78.9%, and 84.2% at two false positives per scan at 0, 2, and 5 mm localization error, respectively.

[1]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[2]  Guy Meyer,et al.  Management of Pulmonary Embolism: An Update. , 2016, Journal of the American College of Cardiology.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Kenji Suzuki,et al.  Linear-time connected-component labeling based on sequential local operations , 2003, Comput. Vis. Image Underst..

[5]  Brian E. Chapman,et al.  A Multistage Approach to Improve Performance of Computer-Aided Detection of Pulmonary Embolisms Depicted on CT Images: Preliminary Investigation , 2011, IEEE Transactions on Biomedical Engineering.

[6]  Piotr Pruszczyk,et al.  Guidelines on the Diagnosis and Management of Acute Pulmonary Embolism , 2008 .

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Leonidas J. Guibas,et al.  Volumetric and Multi-view CNNs for Object Classification on 3D Data , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Kunio Doi,et al.  Computerized detection of pulmonary embolism in spiral CT angiography based on volumetric image analysis , 2002, IEEE Transactions on Medical Imaging.

[10]  Jinbo Bi,et al.  Computer Aided Detection of Pulmonary Embolism with Tobogganing and Mutiple Instance Classification in CT Pulmonary Angiography , 2007, IPMI.

[11]  Anna Vilanova,et al.  Automatic Detection of Pulmonary Embolism in CTA Images , 2009, IEEE Transactions on Medical Imaging.

[12]  Zhe Li,et al.  Evaluate the Malignancy of Pulmonary Nodules Using the 3-D Deep Leaky Noisy-OR Network , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Onur Osman,et al.  A novel method for pulmonary embolism detection in CTA images , 2014, Comput. Methods Programs Biomed..

[15]  Nima Tajbakhsh,et al.  Computer-Aided Pulmonary Embolism Detection Using a Novel Vessel-Aligned Multi-planar Image Representation and Convolutional Neural Networks , 2015, MICCAI.

[16]  Mahdi Saadatmand-Tarzjan,et al.  A new dataset of computed-tomography angiography images for computer-aided detection of pulmonary embolism , 2018, Scientific Data.

[17]  Rickey E Carter,et al.  Early anticoagulation is associated with reduced mortality for acute pulmonary embolism. , 2010, Chest.