Ensemble based adaptive over-sampling method for imbalanced data learning in computer aided detection of microaneurysm

Diabetic retinopathy (DR) is a progressive disease, and its detection at an early stage is crucial for saving a patient's vision. An automated screening system for DR can help in reduce the chances of complete blindness due to DR along with lowering the work load on ophthalmologists. Among the earliest signs of DR are microaneurysms (MAs). However, current schemes for MA detection appear to report many false positives because detection algorithms have high sensitivity. Inevitably some non-MAs structures are labeled as MAs in the initial MAs identification step. This is a typical "class imbalance problem". Class imbalanced data has detrimental effects on the performance of conventional classifiers. In this work, we propose an ensemble based adaptive over-sampling algorithm for overcoming the class imbalance problem in the false positive reduction, and we use Boosting, Bagging, Random subspace as the ensemble framework to improve microaneurysm detection. The ensemble based over-sampling methods we proposed combine the strength of adaptive over-sampling and ensemble. The objective of the amalgamation of ensemble and adaptive over-sampling is to reduce the induction biases introduced from imbalanced data and to enhance the generalization classification performance of extreme learning machines (ELM). Experimental results show that our ASOBoost method has higher area under the ROC curve (AUC) and G-mean values than many existing class imbalance learning methods.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Haibo He,et al.  ADASYN: Adaptive synthetic sampling approach for imbalanced learning , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[3]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Kenneth W. Tobin,et al.  Validation of microaneurysm-based diabetic retinopathy screening across retina fundus datasets , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[5]  Hiroshi Fujita,et al.  Automated microaneurysm detection method based on eigenvalue analysis using hessian matrix in retinal fundus images , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[7]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[8]  Qin Li,et al.  Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs , 2010, IEEE Transactions on Medical Imaging.

[9]  Francisco Herrera,et al.  A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Lars Schmidt-Thieme,et al.  Cost-sensitive learning methods for imbalanced data , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[11]  P Gain,et al.  Evaluation of automated fundus photograph analysis algorithms for detecting microaneurysms, haemorrhages and exudates, and of a computer-assisted diagnostic system for grading diabetic retinopathy. , 2010, Diabetes & metabolism.

[12]  Bram van Ginneken,et al.  Automatic detection of red lesions in digital color fundus photographs , 2005, IEEE Transactions on Medical Imaging.

[13]  Haibo He,et al.  RAMOBoost: Ranked Minority Oversampling in Boosting , 2010, IEEE Transactions on Neural Networks.

[14]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[15]  Nitesh V. Chawla,et al.  Editorial: special issue on learning from imbalanced data sets , 2004, SKDD.

[16]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[17]  Sharib Ali,et al.  Automated detection of microaneurysms using robust blob descriptors , 2013, Medical Imaging.

[18]  T. Williamson,et al.  Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool. , 1996, The British journal of ophthalmology.

[19]  Qin Li,et al.  Detection of microaneurysms using multi-scale correlation coefficients , 2010, Pattern Recognit..

[20]  Bálint Antal,et al.  Improving microaneurysm detection in color fundus images by using context-aware approaches , 2013, Comput. Medical Imaging Graph..

[21]  Pascale Massin,et al.  Automatic detection of microaneurysms in color fundus images , 2007, Medical Image Anal..

[22]  Mustafa Ertas,et al.  Prevalence of Peripheral Neuropathy and Painful Peripheral Neuropathy in Turkish Diabetic Patients , 2011, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[23]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[24]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[25]  Sharib Ali,et al.  Automated detection of microaneurysms using scale-adapted blob analysis and semi-supervised learning , 2014, Comput. Methods Programs Biomed..

[26]  Dazhe Zhao,et al.  An Optimized Cost-Sensitive SVM for Imbalanced Data Learning , 2013, PAKDD.

[27]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[28]  Atsushi Mizutani,et al.  Automated microaneurysm detection method based on double ring filter in retinal fundus images , 2009, Medical Imaging.

[29]  Lei Zhang,et al.  Sparse Representation Classifier for microaneurysm detection and retinal blood vessel extraction , 2012, Inf. Sci..

[30]  Graça Maria Henriques Minas,et al.  Automatic detection of microaneurysm based on the slant stacking , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[31]  Roberto Rosas-Romero,et al.  A method to assist in the diagnosis of early diabetic retinopathy: Image processing applied to detection of microaneurysms in fundus images , 2015, Comput. Medical Imaging Graph..

[32]  Mrinal Haloi,et al.  Improved Microaneurysm Detection using Deep Neural Networks , 2015, ArXiv.

[33]  Shehzad Khalid,et al.  Identification and classification of microaneurysms for early detection of diabetic retinopathy , 2013, Pattern Recognit..

[34]  Vasile Palade,et al.  Automatic detection of microaneurysms in colour fundus images for diabetic retinopathy screening , 2015, Neural Computing and Applications.

[35]  Joni-Kristian Kämäräinen,et al.  The DIARETDB1 Diabetic Retinopathy Database and Evaluation Protocol , 2007, BMVC.

[36]  Wei Li,et al.  nsemble-based hybrid probabilistic sampling for imbalanced data earning in lung nodule CAD , 2014 .

[37]  I. Tomek,et al.  Two Modifications of CNN , 1976 .