Malaria detection through digital microscopic imaging using Deep Greedy Network with transfer learning

Abstract. Purpose: In conventional diagnosis, the visual inspection of the malaria parasite Plasmodium falciparum in infected red blood cells under a microscope, is done manually by pathologists, which is both laborious and error-prone. Recent studies on automating this process have been conducted using artificial intelligence and feature selection of positional and morphological features from blood smear cell images using convolutional neural network (CNN). However, most deep CNN models do not perform well as per the expectation on small datasets. Approach: In this context, we propose a comprehensive computer-aided diagnosis scheme for automating the detection of malaria parasites in thin blood smear images using deep CNN, where transfer learning is used for optimizing the feature selection process. As an extra layer of security, layer embeddings are extracted from the intermediate convolutional layers using the feature matrix to cross-check the selection of features in the intermediate layers. The proposal includes the utilization of the ResNet 152 model integrated with the Deep Greedy Network for training, which produces an enhanced quality of prediction. Results: The performance of the proposed hybrid model has been evaluated concerning the evaluation metrics such as accuracy, precision, recall, specificity, and F1-score, which has been further compared with the pre-existing deep learning algorithms. Conclusions: The comparative analysis of the results reported based on the accuracy metrics demonstrates promising outcomes concerning the other models. Lastly, the embedding extraction from the intermediate hidden layers and their visual analysis also provides an opportunity for manual verification of the performance of the trained model.

[1]  Amita Dessai,et al.  Lung cancer detection system using lung CT image processing , 2017, 2017 International Conference on Computing, Communication, Control and Automation (ICCUBEA).

[2]  Zhiping Lin,et al.  Deep CNNs for microscopic image classification by exploiting transfer learning and feature concatenation , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[3]  Indrajit Das,et al.  Deep Greedy Network: A Tool for Medical Diagnosis on Exiguous Dataset of COVID-19 , 2020, 2020 IEEE 1st International Conference for Convergence in Engineering (ICCE).

[4]  Bin Qin,et al.  Malaria Cell Detection Using Evolutionary Convolutional Deep Networks , 2019, 2019 Computing, Communications and IoT Applications (ComComAp).

[5]  Tareq Abed Mohammed,et al.  Understanding of a convolutional neural network , 2017, 2017 International Conference on Engineering and Technology (ICET).

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  D. Juliet,et al.  Transfer Learning with ResNet-50 for Malaria Cell-Image Classification , 2019, 2019 International Conference on Communication and Signal Processing (ICCSP).

[8]  Akansha Singh,et al.  Era of deep neural networks: A review , 2017, 2017 8th International Conference on Computing, Communication and Networking Technologies (ICCCNT).

[9]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[10]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[11]  E. Ashley,et al.  Malaria , 2018, The Lancet.

[12]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[13]  Chih-Hung Chang,et al.  Deep and Shallow Architecture of Multilayer Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Lars J. Grimm,et al.  Computational approach to radiogenomics of breast cancer: Luminal A and luminal B molecular subtypes are associated with imaging features on routine breast MRI extracted using computer vision algorithms , 2015, Journal of magnetic resonance imaging : JMRI.

[15]  Mahesh Jangid,et al.  Malaria Detection Using Multiple Deep Learning Approaches , 2019, 2019 2nd International Conference on Intelligent Communication and Computational Techniques (ICCT).

[16]  Yutaka Satoh,et al.  Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet? , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  V. Prendki,et al.  The pathogenesis of Plasmodium falciparum malaria in humans: insights from splenic physiology. , 2011, Blood.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Tania S. Douglas,et al.  Automated detection of malaria in Giemsa-stained thin blood smears , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  N. Khanjani,et al.  The relation between climatic factors and malaria incidence in Kerman, South East of Iran , 2016, Parasite epidemiology and control.

[21]  Yousif A. Hamad,et al.  Brain's Tumor Edge Detection on Low Contrast Medical Images , 2018, 2018 1st Annual International Conference on Information and Sciences (AiCIS).

[22]  Sameer K. Antani,et al.  Performance evaluation of deep neural ensembles toward malaria parasite detection in thin-blood smear images , 2019, PeerJ.

[23]  A. Vijayalakshmi,et al.  Deep learning approach to detect malaria from microscopic images , 2019, Multimedia Tools and Applications.

[24]  Manish Mishra,et al.  A view of Artificial Neural Network , 2014, 2014 International Conference on Advances in Engineering & Technology Research (ICAETR - 2014).

[25]  Yonghong Xie,et al.  Bi-Modal Learning With Channel-Wise Attention for Multi-Label Image Classification , 2020, IEEE Access.

[26]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  M. Todd,et al.  The past, present and future of anti-malarial medicines , 2019, Malaria Journal.

[28]  Hermann Ney,et al.  Feature Extraction with Convolutional Neural Networks for Handwritten Word Recognition , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[29]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[30]  Ömer Deperlıoğlu,et al.  Diagnosis of Diabetic Retinopathy by Using Image Processing and Convolutional Neural Network , 2018, 2018 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT).

[31]  Hanung Adi Nugroho,et al.  Feature extraction and classification for detection malaria parasites in thin blood smear , 2015, 2015 2nd International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE).

[32]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Fabio A. González,et al.  A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images , 2009, J. Biomed. Informatics.

[34]  Yu Liu,et al.  Image classification based on convolutional neural networks with cross-level strategy , 2016, Multimedia Tools and Applications.

[35]  Michał Grochowski,et al.  Data augmentation for improving deep learning in image classification problem , 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW).

[36]  T. Jung,et al.  Improving EEG-Based Emotion Classification Using Conditional Transfer Learning , 2017, Front. Hum. Neurosci..