Weighted Ensemble of Deep Learning Models based on Comprehensive Learning Particle Swarm Optimization for Medical Image Segmentation

In recent years, deep learning has rapidly become a method of choice for segmentation of medical images. Deep neural architectures such as UNet and FPN have achieved high performances on many medical datasets. However, medical image analysis algorithms are required to be reliable, robust, and accurate for clinical applications which can be difficult to achieve for some single deep learning methods. In this study, we introduce an ensemble of classifiers for semantic segmentation of medical images. The ensemble of classifiers here is a set of various deep learning-based classifiers, aiming to achieve better performance than using a single classifier. We propose a weighted ensemble method in which the weighted sum of segmentation outputs by classifiers is used to choose the final segmentation decision. We use a swarm intelligence algorithm namely Comprehensive Learning Particle Swarm Optimization to optimize the combining weights. Dice coefficient, a popular performance metric for image segmentation, is used as the fitness criteria. Experiments conducted on some medical datasets of the CAMUS competition on cardiographic image segmentation show that our method achieves better results than both the constituent segmentation models and the reported model of the CAMUS competition.

[1]  Alan Wee-Chung Liew,et al.  A weighted multiple classifier framework based on random projection , 2019, Inf. Sci..

[2]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[4]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[5]  Nathan Srebro,et al.  The Marginal Value of Adaptive Gradient Methods in Machine Learning , 2017, NIPS.

[6]  Alan Wee-Chung Liew,et al.  Evolving an Optimal Decision Template for Combining Classifiers , 2019, ICONIP.

[7]  Iasonas Kokkinos,et al.  Sub-cortical brain structure segmentation using F-CNN'S , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[8]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[9]  Ponnuthurai N. Suganthan,et al.  Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation , 2015, Swarm Evol. Comput..

[10]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[11]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Frederic Cervenansky,et al.  Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography , 2019, IEEE Transactions on Medical Imaging.

[13]  Alan Wee-Chung Liew,et al.  A novel combining classifier method based on Variational Inference , 2016, Pattern Recognit..

[14]  Andre G. C. Pacheco,et al.  Learning dynamic weights for an ensemble of deep models applied to medical imaging classification , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[15]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[17]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[18]  Yudong Zhang,et al.  A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications , 2015 .

[19]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[20]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[21]  Weihong Deng,et al.  Very deep convolutional neural network based image classification using small training sample size , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[22]  Hakan Erdogan,et al.  Linear classifier combination and selection using group sparse regularization and hinge loss , 2013, Pattern Recognit. Lett..

[23]  Farrukh Aslam Khan,et al.  Attributed multi-objective comprehensive learning particle swarm optimization for optimal security of networks , 2013, Appl. Soft Comput..

[24]  Xiang Yu,et al.  Enhanced comprehensive learning particle swarm optimization , 2014, Appl. Math. Comput..

[25]  Qin Liu,et al.  Multi-class Gradient Harmonized Dice Loss with Application to Knee MR Image Segmentation , 2019, MICCAI.

[26]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[27]  P. Cattin,et al.  Multi-dimensional Gated Recurrent Units for the Segmentation of Biomedical 3D-Data , 2016, LABELS/DLMIA@MICCAI.

[28]  Dimitris N. Metaxas,et al.  Attentive neural cell instance segmentation , 2019, Medical Image Anal..

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Quoc V. Le,et al.  On optimization methods for deep learning , 2011, ICML.

[31]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[32]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  S. Lo,et al.  Bidirectional local distance measure for comparing segmentations. , 2012, Medical physics.

[34]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[35]  Susana K. Lai-Yuen,et al.  AdaResU-Net: Multiobjective adaptive convolutional neural network for medical image segmentation , 2020, Neurocomputing.

[36]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[37]  Bostjan Likar,et al.  Model-Based Segmentation of Vertebral Bodies from MR Images with 3D CNNs , 2016, MICCAI.

[38]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[39]  Song Wang,et al.  Degraded Image Semantic Segmentation With Dense-Gram Networks , 2020, IEEE Transactions on Image Processing.

[40]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[41]  Yaozong Gao,et al.  Deformable MR Prostate Segmentation via Deep Feature Learning and Sparse Patch Matching , 2016, IEEE Transactions on Medical Imaging.

[42]  Zhongyi Hu,et al.  Comprehensive learning particle swarm optimization based memetic algorithm for model selection in short-term load forecasting using support vector regression , 2014, Appl. Soft Comput..

[43]  K. Mahadevan,et al.  Comprehensive learning particle swarm optimization for reactive power dispatch , 2010, Appl. Soft Comput..

[44]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[45]  Syed Muhammad Anwar,et al.  Deep Learning in Medical Image Analysis , 2017 .

[46]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[47]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[48]  Mengjie Zhang,et al.  Variable-Length Particle Swarm Optimization for Feature Selection on High-Dimensional Classification , 2019, IEEE Transactions on Evolutionary Computation.

[49]  Theodosios Pavlidis Advanced Segmentation Techniques , 1977 .

[50]  William Nick Street,et al.  Ensemble Pruning Via Semi-definite Programming , 2006, J. Mach. Learn. Res..

[51]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.