IA-net: informative attention convolutional neural network for choroidal neovascularization segmentation in OCT images.

Choroidal neovascularization (CNV) is a characteristic feature of wet age-related macular degeneration (AMD). Quantification of CNV is useful to clinicians in the diagnosis and treatment of CNV disease. Before quantification, CNV lesion should be delineated by automatic CNV segmentation technology. Recently, deep learning methods have achieved significant success for medical image segmentation. However, some CNVs are small objects which are hard to discriminate, resulting in performance degradation. In addition, it's difficult to train an effective network for accurate segmentation due to the complicated characteristics of CNV in OCT images. In order to tackle these two challenges, this paper proposed a novel Informative Attention Convolutional Neural Network (IA-net) for automatic CNV segmentation in OCT images. Considering that the attention mechanism has the ability to enhance the discriminative power of the interesting regions in the feature maps, the attention enhancement block is developed by introducing the additional attention constraint. It has the ability to force the model to pay high attention on CNV in the learned feature maps, improving the discriminative ability of the learned CNV features, which is useful to improve the segmentation performance on small CNV. For accurate pixel classification, the novel informative loss is proposed with the incorporation of an informative attention map. It can focus training on a set of informative samples that are difficult to be predicted. Therefore, the trained model has the ability to learn enough information to classify these informative samples, further improving the performance. The experimental results on our database demonstrate that the proposed method outperforms traditional CNV segmentation methods.

[1]  Xinjian Chen,et al.  Deriving external forces via convolutional neural networks for biomedical image segmentation. , 2019, Biomedical optics express.

[2]  Youngbae Hwang,et al.  Efficient deep learning of image denoising using patch complexity local divide and deep conquer , 2019, Pattern Recognit..

[3]  Horst Bischof,et al.  Mahalanobis Distance Learning for Person Re-identification , 2014, Person Re-Identification.

[4]  Wen Gao,et al.  Attention Driven Person Re-identification , 2018, Pattern Recognit..

[5]  Meng Gan,et al.  Adversarial convolutional network for esophageal tissue segmentation on OCT images. , 2020, Biomedical optics express.

[6]  Changxing Ding,et al.  Dual-force convolutional neural networks for accurate brain tumor segmentation , 2019, Pattern Recognit..

[7]  Xinjian Chen,et al.  Automated 3-D Retinal Layer Segmentation of Macular Optical Coherence Tomography Images With Serous Pigment Epithelial Detachments , 2015, IEEE Transactions on Medical Imaging.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Xiaoming Xi,et al.  Learned local similarity prior embedding active contour model for choroidal neovascularization segmentation in optical coherence tomography images , 2017, Science China Information Sciences.

[10]  Tao Mei,et al.  Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Milan Sonka,et al.  Quantification of external limiting membrane disruption caused by diabetic macular edema from SD-OCT. , 2012, Investigative ophthalmology & visual science.

[12]  Wei Liu,et al.  Exploring Representativeness and Informativeness for Active Learning , 2019, IEEE Transactions on Cybernetics.

[13]  Xinjian Chen,et al.  Automatic Segmentation of Retinal Layer in OCT Images With Choroidal Neovascularization , 2018, IEEE Transactions on Image Processing.

[14]  Michael J. Allingham,et al.  Deep learning-based single-shot prediction of differential effects of anti-VEGF treatment in patients with diabetic macular edema. , 2020, Biomedical optics express.

[15]  Xiangyu Zhang,et al.  DetNet: Design Backbone for Object Detection , 2018, ECCV.

[16]  Chia-Ling Tsai,et al.  Automatic characterization of classic choroidal neovascularization by using AdaBoost for supervised learning. , 2011, Investigative ophthalmology & visual science.

[17]  Rong Jin,et al.  Active Learning by Querying Informative and Representative Examples , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[19]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[20]  Gongping Yang,et al.  Automated segmentation of choroidal neovascularization in optical coherence tomography images using multi-scale convolutional neural networks with structure prior , 2017, Multimedia Systems.

[21]  Angshul Majumdar,et al.  RODEO: Robust DE-aliasing autoencOder for real-time medical image reconstruction , 2017, Pattern Recognit..

[22]  Xinjian Chen,et al.  Choroid Neovascularization Growth Prediction With Treatment Based on Reaction-Diffusion Model in 3-D OCT Images , 2017, IEEE Journal of Biomedical and Health Informatics.

[23]  Feng Li,et al.  Detail-preserving image super-resolution via recursively dilated residual network , 2019, Neurocomputing.

[24]  Marleen de Bruijne,et al.  Combining Generative and Discriminative Representation Learning for Lung CT Analysis With Convolutional Restricted Boltzmann Machines , 2016, IEEE Transactions on Medical Imaging.

[25]  Qiang Chen,et al.  Automated Choroidal Neovascularization Detection for Time Series SD-OCT Images , 2018, MICCAI.

[26]  Martin F. Kraus,et al.  Quantitative optical coherence tomography angiography of choroidal neovascularization in age-related macular degeneration. , 2014, Ophthalmology.

[27]  Ahmed K. Elmagarmid,et al.  Active Learning With Optimal Instance Subset Selection , 2013, IEEE Transactions on Cybernetics.

[28]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[29]  Martin Pfister,et al.  Deep learning segmentation for optical coherence tomography measurements of the lower tear meniscus. , 2020, Biomedical optics express.

[30]  Nanning Zheng,et al.  Discriminative Feature Learning With Foreground Attention for Person Re-Identification , 2018, IEEE Transactions on Image Processing.

[31]  Jie Wei,et al.  M3Net: A multi-model, multi-size, and multi-view deep neural network for brain magnetic resonance image segmentation , 2019, Pattern Recognit..

[32]  M. Sonka,et al.  Retinal Imaging and Image Analysis. , 2010, IEEE transactions on medical imaging.

[33]  Joel H. Saltz,et al.  Sparse Autoencoder for Unsupervised Nucleus Detection and Representation in Histopathology Images , 2017, Pattern Recognit..

[34]  Shuguang Cui,et al.  Progressive Abdominal Segmentation with Adaptively Hard Region Prediction and Feature Enhancement , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[35]  C. Barnstable,et al.  HTRA1 Promoter Polymorphism in Wet Age-Related Macular Degeneration , 2006, Science.

[36]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[37]  Ahmed S. Fahmy,et al.  Segmentation of Choroidal Neovascularization in Fundus Fluorescein Angiograms , 2013, IEEE Transactions on Biomedical Engineering.

[38]  Jingsong He,et al.  Online Hard Region Mining for Semantic Segmentation , 2019, Neural Processing Letters.

[39]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  J. Duker,et al.  Imaging of macular diseases with optical coherence tomography. , 1995, Ophthalmology.

[41]  Yu Zhou,et al.  No-Reference Quality Assessment for View Synthesis Using DoG-Based Edge Statistics and Texture Naturalness , 2019, IEEE Transactions on Image Processing.

[42]  Moongu Jeon,et al.  Terms-based discriminative information space for robust text classification , 2016, Inf. Sci..

[43]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  J. Duker,et al.  Optical coherence tomography of age-related macular degeneration and choroidal neovascularization. , 1996, Ophthalmology.

[45]  Tristan T. Hormel,et al.  Automated diagnosis and segmentation of choroidal neovascularization in OCT angiography using deep learning. , 2020, Biomedical optics express.