Probability-based Mask R-CNN for pulmonary embolism detection

Abstract Pulmonary embolism (PE), a blockage of the lung artery, is common and sometimes fatal. Early diagnosis and treatment of PE can reduce the risk of associated morbidity and mortality. However, it is a huge challenge to accurately detect PE, particularly for the case of small segmental and subsegmental emboli. In this paper, a flexible probability-based Mask R-CNN model, namely P-Mask RCNN, is proposed for PE detection. Specifically, the feature map is firstly upsampled to enrich the local details of the small objects and to extract anchors at a higher density. Then, a candidate area is constructed based on the probability of the appearance of PE. Finally, we extract the anchors in the candidate area of the enlarged feature map for subsequent detection. Extracting anchors in the candidate area instead of the entire image can not only reduce both time and space consumption caused by the enlarging feature maps but also improve the detection performance by eliminating most invalid anchors. Compared with Mask R-CNN, the anchors extracted by the proposed P-Mask RCNN is closer to the ground truth. Extensive experimental results demonstrate the effectiveness and efficiency of the proposed approach. The source code of our method is available at https://github.com/longkun-uestc/P_Mask_RCNN .

[1]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Yongchao Gong,et al.  Mask Scoring R-CNN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Axel Wismüller,et al.  Classification of small lesions in dynamic breast MRI: eliminating the need for precise lesion segmentation through spatio-temporal analysis of contrast enhancement , 2012, Machine Vision and Applications.

[4]  Marcos Salganicoff,et al.  Computer-aided detection of pulmonary embolism: Influence on radiologists’ detection performance with respect to vessel segments , 2008, European Radiology.

[5]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[6]  Kunio Doi,et al.  Computerized detection of pulmonary embolism in spiral CT angiography based on volumetric image analysis , 2002, IEEE Transactions on Medical Imaging.

[7]  Huimin Ma,et al.  3D Object Proposals for Accurate Object Class Detection , 2015, NIPS.

[8]  Mahdi Saadatmand-Tarzjan,et al.  A new dataset of computed-tomography angiography images for computer-aided detection of pulmonary embolism , 2018, Scientific Data.

[9]  Ran Tao,et al.  Seeing Small Faces from Robust Anchor's Perspective , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Nima Tajbakhsh,et al.  Computer-aided detection and visualization of pulmonary embolism using a novel, compact, and discriminative image representation , 2019, Medical Image Anal..

[11]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[12]  Jue Wang,et al.  Detection of Multiclass Objects in Optical Remote Sensing Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[13]  Yi Li,et al.  Fully Convolutional Instance-Aware Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Chi Zhang,et al.  Automatic segmentation of arterial tree from 3D computed tomographic pulmonary angiography (CTPA) scans , 2019, Computer assisted surgery.

[15]  Mathias Prokop,et al.  Acute pulmonary embolism: effect of a computer-assisted detection prototype on diagnosis--an observer study. , 2012, Radiology.

[16]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[17]  Larry S. Davis,et al.  An Analysis of Scale Invariance in Object Detection - SNIP , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Anna Vilanova,et al.  Automatic Detection of Pulmonary Embolism in CTA Images , 2009, IEEE Transactions on Medical Imaging.

[19]  Xin Yang,et al.  A Two-Stage Convolutional Neural Network for Pulmonary Embolism Detection From CTPA Images , 2019, IEEE Access.

[20]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[21]  Abhinav Gupta,et al.  Training Region-Based Object Detectors with Online Hard Example Mining , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).