Faster R-CNN, fourth-order partial differential equation and global-local active contour model (FPDE-GLACM) for plaque segmentation in IV-OCT image

The accurate segmentation of plaque in intravascular optical coherence tomography (IV-OCT) image plays an important role in coronary atherosclerotic heart disease (CAD) diagnosis. To effectively provide information of coronary artery stenosis, we propose a novel hybrid framework which includes the faster R-CNN, fourth-order partial differential equation and global-local active contour model (FPDE-GLACM). This framework can efficiently detect and segment the plaque area in Speckle noise-contaminated IV-OCT images. We first detect plaque area by faster R-CNN and set bounding-box as the initial contour for active contour model. And then we minimize the joint energy functional of PDE-GLACM part to achieve the segmentation and denoising of IV-OCT images by gradient descent and finite difference scheme. Specifically, by using the Gaussian image minus original image to get the edge guide image, GLACM part obtains accurate plaque segmentation results. We perform experiments on 5000 IV-OCT images and set clinical manual segmentation results as ground truth. As expected, the results illustrate that the proposed FPDE-GLACM can provide better performance on plaque detection and segmentation. And these results may assist doctor in CAD diagnosis and treatment.

[1]  Marly Guimarães Fernandes Costa,et al.  Lumen Segmentation in Optical Coherence Tomography Images using Convolutional Neural Network , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2018 Update: A Report From the American Heart Association , 2018, Circulation.

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Amar Mitiche,et al.  Multiregion Image Segmentation by Parametric Kernel Graph Cuts , 2011, IEEE Transactions on Image Processing.

[5]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Nils Gessert,et al.  Automatic Plaque Detection in IVOCT Pullbacks Using Convolutional Neural Networks , 2018, IEEE Transactions on Medical Imaging.

[8]  Qinye Yin,et al.  Automatic identification of side branch and main vascular measurements in intravascular optical coherence tomography images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[9]  Yiannis Kompatsiaris,et al.  ARC-OCT: Automatic detection of lumen border in intravascular OCT images , 2017, Comput. Methods Programs Biomed..

[10]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[12]  Rajesh Kumar,et al.  A fourth order PDE based fuzzy c- means approach for segmentation of microscopic biopsy images in presence of Poisson noise for cancer detection , 2017, Comput. Methods Programs Biomed..

[13]  Theo van Walsum,et al.  Contour segmentation of the intima, media, and adventitia layers in intracoronary OCT images: application to fully automatic detection of healthy wall regions , 2017, International Journal of Computer Assisted Radiology and Surgery.

[14]  Shang Gao,et al.  Deep Learning: Individual Maize Segmentation From Terrestrial Lidar Data Using Faster R-CNN and Regional Growth Algorithms , 2018, Front. Plant Sci..

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yanyan Zhu,et al.  Active contour model based on local and global Gaussian fitting energy for medical image segmentation , 2018 .

[17]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[18]  Dimitrios I. Fotiadis,et al.  A Novel Semiautomated Atherosclerotic Plaque Characterization Method Using Grayscale Intravascular Ultrasound Images: Comparison With Virtual Histology , 2012, IEEE Transactions on Information Technology in Biomedicine.

[19]  Jiang Liu,et al.  Automatic image classification in intravascular optical coherence tomography images , 2016, 2016 IEEE Region 10 Conference (TENCON).

[20]  Sanjay Kumar Singh,et al.  A fourth-order PDE-based non-linear filter for speckle reduction from Optical Coherence Tomography images , 2012 .

[21]  Asad Munir,et al.  Adaptive active contours based on variable kernel with constant initialisation , 2018, IET Image Process..

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Dimitrios I Fotiadis,et al.  Methodology for fully automated segmentation and plaque characterization in intracoronary optical coherence tomography images , 2014, Journal of biomedical optics.

[24]  T. Kume,et al.  Current clinical applications of coronary optical coherence tomography , 2017, Cardiovascular Intervention and Therapeutics.

[25]  Jiang Liu,et al.  Graph based lumen segmentation in optical coherence tomography images , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[26]  Dimos Baltas,et al.  Esophagus segmentation in CT via 3D fully convolutional neural network and random walk , 2017, Medical physics.

[27]  Nasir M. Rajpoot,et al.  Dual-Channel Active Contour Model for Megakaryocytic Cell Segmentation in Bone Marrow Trephine Histology Images , 2017, IEEE Transactions on Biomedical Engineering.

[28]  Atsushi Tanaka,et al.  Fibroatheroma identification in Intravascular Optical Coherence Tomography images using deep features , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).