Detection of Microaneurysms in Fundus Images Based on an Attention Mechanism

Microaneurysms (MAs) are the earliest detectable diabetic retinopathy (DR) lesions. Thus, the ability to automatically detect MAs is critical for the early diagnosis of DR. However, achieving the accurate and reliable detection of MAs remains a significant challenge due to the size and complexity of retinal fundus images. Therefore, this paper presents a novel MA detection method based on a deep neural network with a multilayer attention mechanism for retinal fundus images. First, a series of equalization operations are performed to improve the quality of the fundus images. Then, based on the attention mechanism, multiple feature layers with obvious target features are fused to achieve preliminary MA detection. Finally, the spatial relationships between MAs and blood vessels are utilized to perform a secondary screening of the preliminary test results to obtain the final MA detection results. We evaluated the method on the IDRiD_VOC dataset, which was collected from the open IDRiD dataset. The results show that our method effectively improves the average accuracy and sensitivity of MA detection.

[1]  Qin Li,et al.  Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs , 2010, IEEE Transactions on Medical Imaging.

[2]  Yue Wu,et al.  Remote sensing image registration based on local structural information and global constraint , 2019, Journal of Applied Remote Sensing.

[3]  Liu Zhoufeng,et al.  AdaBoost learning for fabric defect detection based on HOG and SVM , 2011, 2011 International Conference on Multimedia Technology.

[4]  Tien Yin Wong,et al.  Red lesion detection in retinal fundus images using Frangi-based filters , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  U. Rajendra Acharya,et al.  Automated segmentation of exudates, haemorrhages, microaneurysms using single convolutional neural network , 2017, Inf. Sci..

[6]  Keshab K. Parhi,et al.  Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Subimage Classification , 2015, IEEE Journal of Biomedical and Health Informatics.

[7]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[8]  Deyu Meng,et al.  DecideNet: Counting Varying Density Crowds Through Attention Guided Detection and Density Estimation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Fan Xi,et al.  Detection crack in image using Otsu method and multiple filtering in image processing techniques , 2016 .

[10]  Xuan Guo,et al.  Bayesian analysis of complex mutations in HBV, HCV, and HIV studies , 2019, Big Data Min. Anal..

[11]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[12]  Xuelong Li,et al.  Efficient HOG human detection , 2011, Signal Process..

[13]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[14]  Dan Wang,et al.  Dynamic Aircraft Carrier Flight Deck Task Planning based on HTN , 2016 .

[15]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[16]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Yong Zhou,et al.  Relation classification via recurrent neural network with attention and tensor layers , 2018, Big Data Min. Anal..

[18]  Joni-Kristian Kämäräinen,et al.  Constructing Benchmark Databases and Protocols for Medical Image Analysis: Diabetic Retinopathy , 2013, Comput. Math. Methods Medicine.

[19]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[20]  Ryan Kastner,et al.  Fpga-based face detection system using Haar classifiers , 2009, FPGA '09.

[21]  Xiangqian Wu,et al.  Retinal Microaneurysms Detection Using Gradient Vector Analysis and Class Imbalance Classification , 2016, PloS one.

[22]  Linmi Tao,et al.  Multiple deep-belief-network-based spectral-spatial classification of hyperspectral images , 2019, Tsinghua Science and Technology.

[23]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Xiaokui Xiao,et al.  Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms , 2017, AAAI.

[25]  Tong Zhang,et al.  Identifying antigenicity-associated sites in highly pathogenic H5N1 influenza virus hemagglutinin by using sparse learning. , 2012, Journal of molecular biology.

[26]  Wei Liu,et al.  DSSD : Deconvolutional Single Shot Detector , 2017, ArXiv.

[27]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[28]  Fabrice Mériaudeau,et al.  Indian Diabetic Retinopathy Image Dataset (IDRiD): A Database for Diabetic Retinopathy Screening Research , 2018, Data.

[29]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Xin Ye,et al.  Body Part-Based Person Re-identification Integrating Semantic Attributes , 2018, Neural Processing Letters.

[31]  Wei Li,et al.  Privacy-Preserving Auto-Driving: A GAN-Based Approach to Protect Vehicular Camera Data , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[32]  Peiyun Hu,et al.  Finding Tiny Faces , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[35]  Zhipeng Cai,et al.  A Computational Framework for Influenza Antigenic Cartography , 2010, PLoS Comput. Biol..

[36]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[37]  Dichao Hu,et al.  An Introductory Survey on Attention Mechanisms in NLP Problems , 2018, IntelliSys.

[38]  Xiaofei Wang,et al.  Attention Based Glaucoma Detection: A Large-Scale Database and CNN Model , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Lin Yang,et al.  MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Behzad Aliahmad,et al.  Fundus images analysis using deep features for detection of exudates, hemorrhages and microaneurysms , 2018, BMC Ophthalmology.

[42]  Georgios Leontidis,et al.  A new unified framework for the early detection of the progression to diabetic retinopathy from fundus images , 2017, Comput. Biol. Medicine.

[43]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[45]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Randy Goebel,et al.  Nucleotide composition string selection in HIV-1 subtyping using whole genomes , 2007, Bioinform..

[47]  Rama Chellappa,et al.  A deep pyramid Deformable Part Model for face detection , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[48]  Min Tang,et al.  Segmentation-by-detection: A cascade network for volumetric medical image segmentation , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[49]  A. Broggi,et al.  Pedestrian Detection using Infrared images and Histograms of Oriented Gradients , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[50]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[51]  In-So Kweon,et al.  AttentionNet: Aggregating Weak Directions for Accurate Object Detection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[52]  Luning Liu,et al.  An information fusion model of innovation alliances based on the bayesian network , 2018, Tsinghua Science and Technology.

[53]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[54]  L. Tian,et al.  A method of Two-Dimensional Otsu image threshold segmentation based on improved Firefly Algorithm , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[55]  Pengfei Xiong,et al.  Pyramid Attention Network for Semantic Segmentation , 2018, BMVC.

[56]  Hector Muñoz-Avila,et al.  Hierarchical task network planning with resources and temporal constraints , 2017, Knowl. Based Syst..

[57]  Guangming Shi,et al.  Feature-fused SSD: fast detection for small objects , 2017, International Conference on Graphic and Image Processing.

[58]  John D. Fernandez,et al.  Facial feature detection using Haar classifiers , 2006 .

[59]  M. Abràmoff,et al.  Results of Automated Retinal Image Analysis for Detection of Diabetic Retinopathy from the Nakuru Study, Kenya , 2015, PloS one.

[60]  Sharib Ali,et al.  Automated detection of microaneurysms using scale-adapted blob analysis and semi-supervised learning , 2014, Comput. Methods Programs Biomed..

[61]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[62]  Randy Goebel,et al.  Selecting dissimilar genes for multi-class classification, an application in cancer subtyping , 2007, BMC Bioinformatics.

[63]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[64]  V. Rajinikanth,et al.  Otsu based optimal multilevel image thresholding using firefly algorithm , 2014 .

[65]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  U. Rajendra Acharya,et al.  Computer-aided diagnosis of diabetic retinopathy: A review , 2013, Comput. Biol. Medicine.