Deep Learning Based Automatic Malaria Parasite Detection from Blood Smear and Its Smartphone Based Application

Malaria is a life-threatening disease that is spread by the Plasmodium parasites. It is detected by trained microscopists who analyze microscopic blood smear images. Modern deep learning techniques may be used to do this analysis automatically. The need for the trained personnel can be greatly reduced with the development of an automatic accurate and efficient model. In this article, we propose an entirely automated Convolutional Neural Network (CNN) based model for the diagnosis of malaria from the microscopic blood smear images. A variety of techniques including knowledge distillation, data augmentation, Autoencoder, feature extraction by a CNN model and classified by Support Vector Machine (SVM) or K-Nearest Neighbors (KNN) are performed under three training procedures named general training, distillation training and autoencoder training to optimize and improve the model accuracy and inference performance. Our deep learning-based model can detect malarial parasites from microscopic images with an accuracy of 99.23% while requiring just over 4600 floating point operations. For practical validation of model efficiency, we have deployed the miniaturized model in different mobile phones and a server-backed web application. Data gathered from these environments show that the model can be used to perform inference under 1 s per sample in both offline (mobile only) and online (web application) mode, thus engendering confidence that such models may be deployed for efficient practical inferential systems.

[1]  Andrew G. Dempster,et al.  Segmentation of blood images using morphological operators , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ching Y. Suen,et al.  A novel hybrid CNN-SVM classifier for recognizing handwritten digits , 2012, Pattern Recognit..

[4]  W. Jarra,et al.  High sensitivity of detection of human malaria parasites by the use of nested polymerase chain reaction. , 1993, Molecular and biochemical parasitology.

[5]  I. Bygbjerg,et al.  Malaria - Diagnostik , 2003 .

[6]  Rabul Hussain Laskar,et al.  Malaria infected erythrocyte classification based on a hybrid classifier using microscopic images of thin blood smear , 2016, Multimedia Tools and Applications.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[9]  Madhu S. Nair,et al.  Malaria Parasite Detection From Peripheral Blood Smear Images Using Deep Belief Networks , 2017, IEEE Access.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Xiangji Huang,et al.  CNN-based image analysis for malaria diagnosis , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[12]  B. Pritt,et al.  Update on Malaria Diagnostics and Test Utilization , 2017, Journal of Clinical Microbiology.

[13]  Juan Manuel Górriz,et al.  Digital image analysis for automatic enumeration of malaria parasites using morphological operations , 2015, Expert Syst. Appl..

[14]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[15]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[16]  Andrew G. Dempster,et al.  Morphological Image Processing for Evaluating Malaria Disease , 2001, IWVF.

[17]  K. Parvati,et al.  Image Segmentation Using Gray-Scale Morphology and Marker-Controlled Watershed Transformation , 2008 .

[18]  Harm de Vries,et al.  RMSProp and equilibrated adaptive learning rates for non-convex optimization. , 2015 .

[19]  A. Moorman,et al.  Assumption-free analysis of quantitative real-time polymerase chain reaction (PCR) data , 2003, Neuroscience Letters.

[20]  I. Bygbjerg,et al.  Malaria diagnosis and treatment under the strategy of the integrated management of childhood illness (IMCI): relevance of laboratory support from the rapid immunochromatographic tests of ICT Malaria P.f/P.v and OptiMal. , 2001, Annals of tropical medicine and parasitology.

[21]  C. Wongsrichanalai,et al.  A review of malaria diagnostic tools: microscopy and rapid diagnostic test (RDT). , 2007, The American journal of tropical medicine and hygiene.

[22]  Dian Anggraini,et al.  Automated status identification of microscopic images obtained from malaria thin blood smears using bayes decision: A study case in plasmodium falciparum , 2011, 2011 International Conference on Advanced Computer Science and Information Systems.

[23]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[24]  A. Dempster,et al.  Computer vision for microscopy diagnosis of malaria , 2009, Malaria Journal.

[25]  George R. Thoma,et al.  Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images , 2018, PeerJ.

[26]  R. Haque,et al.  Real-time PCR assay and rapid diagnostic tests for the diagnosis of clinically suspected malaria patients in Bangladesh , 2011, Malaria Journal.

[27]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  L. Bai,et al.  A portable image-based cytometer for rapid malaria detection and quantification , 2017, PloS one.

[29]  Anne E Carpenter,et al.  Applying Faster R-CNN for Object Detection on Malaria Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  C. Chakraborty,et al.  Automated system for characterization and classification of malaria‐infected stages using light microscopic images of thin blood smears , 2015, Journal of microscopy.

[31]  Leonardo Yunda,et al.  Automated image analysis method for p-vivax malaria parasite detection in thick film blood images , 2012 .

[32]  K. Kain,et al.  Impact of microscopy error on estimates of protective efficacy in malaria-prevention trials. , 2002, The Journal of infectious diseases.

[33]  David M. Rubin,et al.  Automated image processing method for the diagnosis and classification of malaria on thin blood smears , 2006, Medical and Biological Engineering and Computing.

[34]  Jaime S. Cardoso,et al.  International Conference On Medical Imaging Understanding and Analysis 2016 , MIUA 2016 , 6-8 July 2016 , Loughborough , UK Automated detection of malaria parasites on thick blood smears via mobile devices , 2016 .

[35]  Takehisa Yairi,et al.  Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction , 2014, MLSDA'14.

[36]  T. Abbasian,et al.  Automatic Malaria Diagnosis system , 2013, 2013 First RSI/ISM International Conference on Robotics and Mechatronics (ICRoM).

[37]  Moses J. Eghan,et al.  Wavelength Markers for Malaria (Plasmodium Falciparum) Infected and Uninfected Red Blood Cells for Ring and Trophozoite Stages , 2014 .

[38]  Andrew G. Dempster,et al.  Parasite detection and identification for automated thin blood film malaria diagnosis , 2010, Comput. Vis. Image Underst..

[39]  S. P. Kachur,et al.  Quality assurance of malaria rapid diagnostic tests used for routine patient care in rural Tanzania: microscopy versus real-time polymerase chain reaction , 2015, Malaria Journal.

[40]  Yuhang Dong,et al.  Evaluations of deep convolutional neural networks for automatic identification of malaria infected cells , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[41]  Peter J. Haas,et al.  Large-scale matrix factorization with distributed stochastic gradient descent , 2011, KDD.

[42]  Sameer K. Antani,et al.  Performance evaluation of deep neural ensembles toward malaria parasite detection in thin-blood smear images , 2019, PeerJ.

[43]  Zhiguo Jiang,et al.  Feature extraction from histopathological images based on nucleus-guided convolutional neural network for breast lesion classification , 2017, Pattern Recognit..

[44]  W. Jarra,et al.  Identification of the four human malaria parasite species in field samples by the polymerase chain reaction and detection of a high prevalence of mixed infections. , 1993, Molecular and biochemical parasitology.

[45]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[46]  Chandan Chakraborty,et al.  Machine learning approach for automated screening of malaria parasite using light microscopic images. , 2013, Micron.

[47]  John A. Quinn,et al.  Deep Convolutional Neural Networks for Microscopy-Based Point of Care Diagnostics , 2016, MLHC.

[48]  Thomas J. Smith,et al.  What is clinical malaria? Finding case definitions for field research in highly endemic areas. , 1994, Parasitology today.

[49]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[50]  Mahdieh Poostchi,et al.  Image analysis and machine learning for detecting malaria , 2018, Translational research : the journal of laboratory and clinical medicine.

[51]  M. Pietikäinen,et al.  A Malaria Diagnostic Tool Based on Computer Vision Screening and Visualization of Plasmodium falciparum Candidate Areas in Digitized Blood Smears , 2014, PloS one.

[52]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Rabul Hussain Laskar,et al.  Malaria Infected Erythrocyte Classification Based on the Histogram Features using Microscopic Images of Thin Blood Smear , 2016 .

[54]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[55]  M. Ranjit,et al.  Distribution of Plasmodium falciparum genotypes in clinically mild and severe malaria cases in Orissa, India. , 2005, Transactions of the Royal Society of Tropical Medicine and Hygiene.

[56]  Itishree Mohanty,et al.  Automatic Detection of Malaria Parasites Using Unsupervised Techniques , 2018 .

[57]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Laurent Najman,et al.  Watershed of a continuous function , 1994, Signal Process..

[59]  Fabio A. González,et al.  A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images , 2009, J. Biomed. Informatics.

[60]  Rich Caruana,et al.  Model compression , 2006, KDD '06.

[61]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[62]  Abien Fred Agarap An Architecture Combining Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for Image Classification , 2017, ArXiv.

[63]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[64]  Bibhudendra Acharya,et al.  ADVANCED IMAGE ANALYSIS BASED SYSTEM FOR AUTOMATIC DETECTION AND CLASSIFICATION OF MALARIAL PARASITE IN BLOOD IMAGES , 2012 .

[65]  Jozsef Vass,et al.  Significance-linked connected component analysis for wavelet image coding , 1999, IEEE Trans. Image Process..

[66]  G. R. K. Sai Subrahmanyam,et al.  Convolutional neural network‐based malaria diagnosis from focus stack of blood smear images acquired using custom‐built slide scanner , 2018, Journal of biophotonics.

[67]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .