A multi-context CNN ensemble for small lesion detection

In this paper, we propose a novel method for the detection of small lesions in digital medical images. Our approach is based on a multi-context ensemble of convolutional neural networks (CNNs), aiming at learning different levels of image spatial context and improving detection performance. The main innovation behind the proposed method is the use of multiple-depth CNNs, individually trained on image patches of different dimensions and then combined together. In this way, the final ensemble is able to find and locate abnormalities on the images by exploiting both the local features and the surrounding context of a lesion. Experiments were focused on two well-known medical detection problems that have been recently faced with CNNs: microcalcification detection on full-field digital mammograms and microaneurysm detection on ocular fundus images. To this end, we used two publicly available datasets, INbreast and E-ophtha. Statistically significantly better detection performance were obtained by the proposed ensemble with respect to other approaches in the literature, demonstrating its effectiveness in the detection of small abnormalities.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[3]  Claudio Marrocco,et al.  Detection of Clusters of Microcalcifications in Mammograms: A Multi Classifier Approach , 2008, 2008 21st IEEE International Symposium on Computer-Based Medical Systems.

[4]  Robert M. Nishikawa,et al.  Reduction of false positive detection in clustered microcalcifications , 2013, 2013 IEEE International Conference on Image Processing.

[5]  Alessandro Bria,et al.  An effective learning strategy for cascaded object detection , 2016, Inf. Sci..

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[8]  Qin Li,et al.  Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs , 2010, IEEE Transactions on Medical Imaging.

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[11]  Wei-Shi Zheng,et al.  Fully convolutional network ensembles for white matter hyperintensities segmentation in MR images , 2018, NeuroImage.

[12]  Dimitrios I. Fotiadis,et al.  An automatic microcalcification detection system based on a hybrid neural network classifier , 2002, Artif. Intell. Medicine.

[13]  Cecilia Di Ruberto,et al.  Leucocyte classification for leukaemia detection using image processing techniques , 2014, Artif. Intell. Medicine.

[14]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[15]  Chandan Chakraborty,et al.  Efficient deep learning model for mitosis detection using breast histopathology images , 2017, Comput. Medical Imaging Graph..

[16]  Somshubra Majumdar,et al.  Microaneurysm detection using fully convolutional neural networks , 2018, Comput. Methods Programs Biomed..

[17]  Nico Karssemeijer,et al.  Automatic Microcalcification Detection in Multi-vendor Mammography Using Convolutional Neural Networks , 2016, Digital Mammography / IWDM.

[18]  Xavier Lladó,et al.  Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review , 2017, Artif. Intell. Medicine.

[19]  Joachim M. Buhmann,et al.  Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation , 2017, Comput. Medical Imaging Graph..

[20]  Jun Dong,et al.  Premature ventricular contraction detection combining deep neural networks and rules inference , 2017, Artif. Intell. Medicine.

[21]  Claudio Marrocco,et al.  MCS-based balancing techniques for skewed classes: An empirical comparison , 2008, 2008 19th International Conference on Pattern Recognition.

[22]  Claudio De Stefano,et al.  Using Bayesian networks for selecting classifiers in GP ensembles , 2014, Inf. Sci..

[23]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[24]  João L. Monteiro,et al.  Using a multi-agent system approach for microaneurysm detection in fundus images , 2014, Artif. Intell. Medicine.

[25]  Frank W. Samuelson,et al.  Comparing image detection algorithms using resampling , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[26]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[27]  K. Doi,et al.  Computer-aided diagnosis and artificial intelligence in clinical imaging. , 2011, Seminars in nuclear medicine.

[28]  Joseph Geradts,et al.  Mammographic predictors of the presence and size of invasive carcinomas associated with malignant microcalcification lesions without a mass. , 2003, AJR. American journal of roentgenology.

[29]  Damla Arifoglu,et al.  Detection of abnormal behaviour for dementia sufferers using Convolutional Neural Networks , 2019, Artif. Intell. Medicine.

[30]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[31]  Kenji Suzuki,et al.  A deep CNN based transfer learning method for false positive reduction , 2018, Multimedia Tools and Applications.

[32]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[33]  Tammy Riklin-Raviv,et al.  Ensemble of expert deep neural networks for spatio‐temporal denoising of contrast‐enhanced MRI sequences , 2017, Medical Image Anal..

[34]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[35]  P. Taylor,et al.  A systematic review of computer-assisted diagnosis in diagnostic cancer imaging. , 2012, European journal of radiology.

[36]  Chaofeng Li,et al.  False-Positive Reduction on Lung Nodules Detection in Chest Radiographs by Ensemble of Convolutional Neural Networks , 2018, IEEE Access.

[37]  Yongyi Yang,et al.  A context-sensitive deep learning approach for microcalcification detection in mammograms , 2018, Pattern Recognit..

[38]  Horst K. Hahn,et al.  Deep learning nuclei detection: A simple approach can deliver state-of-the-art results , 2018, Comput. Medical Imaging Graph..

[39]  Kenji Suzuki,et al.  Machine Learning in Medical Imaging , 2017, Lecture Notes in Computer Science.

[40]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[41]  Nico Karssemeijer,et al.  Improving the automated detection of calcifications by combining deep cascades and deep convolutional nets , 2018, Other Conferences.

[42]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[43]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[44]  Guy Cazuguel,et al.  TeleOphta: Machine learning and image processing methods for teleophthalmology , 2013 .

[45]  Claudio De Stefano,et al.  A Hybrid Evolutionary Algorithm for Bayesian Networks Learning: An Application to Classifier Combination , 2010, EvoApplications.

[46]  Claudio Marrocco,et al.  A computer-aided detection system for clustered microcalcifications , 2010, Artif. Intell. Medicine.

[47]  Claudio Marrocco,et al.  Exploiting AUC for optimal linear combinations of dichotomizers , 2006, Pattern Recognit. Lett..

[48]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.