A dataset and benchmark for malaria life-cycle classification in thin blood smear images

Malaria microscopy, microscopic examination of stained blood slides to detect parasite Plasmodium, is considered to be a gold-standard for detecting life-threatening disease malaria. Detecting the plasmodium parasite requires a skilled examiner and may take up to 10 to 15 minutes to completely go through the whole slide. Due to a lack of skilled medical professionals in the underdeveloped or resource deficient regions, many cases go misdiagnosed, which result in unavoidable medical complications. We propose to complement the medical professionals by creating a deep learning-based method to automatically detect (localize) the plasmodium parasites in the photograph of stained film. To handle the unbalanced nature of the dataset, we adopt a two-stage approach. Where the first stage is trained to detect blood cells and classify them into just healthy or infected. The second stage is trained to classify each detected cell further into the malaria life-cycle stage. To facilitate the research in machine learning-based malaria microscopy, we introduce a new large scale microscopic image malaria dataset. Thirty-eight thousand cells are tagged from the 345 microscopic images of different Giemsa-stained slides of blood samples. Extensive experimentation is performed using different Convolutional Neural Networks on this dataset. Our experiments and analysis reveal that the two-stage approach works better than the one-stage approach for malaria detection. To ensure the usability of our approach, we have also developed a mobile app that E-mail: waqas.sultani@itu.edu.pk · Information Technology University, Lahore, Pakistan University of North Carolina at Charlotte, USA Chughtai Institute of Pathology, Lahore, Pakistan Ittefaq hospital, Lahore, Pakistan will be used by local hospitals for investigation and educational purposes. The dataset, its annotations, and implementation codes will be released upon publication of the paper.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Bijaya Ketan Panigrahi,et al.  A Quantum-Inspired Self-Supervised Network model for automatic segmentation of brain MR images , 2020, Appl. Soft Comput..

[3]  Sameer Antani,et al.  Deep Learning for Smartphone-Based Malaria Parasite Detection in Thick Blood Smears , 2020, IEEE Journal of Biomedical and Health Informatics.

[4]  C. Wongsrichanalai,et al.  A review of malaria diagnostic tools: microscopy and rapid diagnostic test (RDT). , 2007, The American journal of tropical medicine and hygiene.

[5]  Andrew G. Dempster,et al.  Malaria Parasite Detection in Peripheral Blood Images , 2006, BMVC.

[6]  M. A. Khan,et al.  Malaria control in Pakistan: new tools at hand but challenging epidemiological realities. , 2010, Eastern Mediterranean health journal = La revue de sante de la Mediterranee orientale = al-Majallah al-sihhiyah li-sharq al-mutawassit.

[7]  A. Dempster,et al.  Automatic scanning of Malaria infected blood slide images using Mathematical Morphology , 2002 .

[8]  Mesut Toğaçar,et al.  Classification of white blood cells using deep features obtained from Convolutional Neural Network models based on the combination of feature selection methods , 2020, Appl. Soft Comput..

[9]  George R. Thoma,et al.  Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images , 2018, PeerJ.

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Dzulkifli Mohamad,et al.  Machine aided malaria parasitemia detection in Giemsa-stained thin blood smears , 2018, Neural Computing and Applications.

[12]  Amit Verma,et al.  Deep learning based enhanced tumor segmentation approach for MR brain images , 2019, Appl. Soft Comput..

[13]  Jianming Wang,et al.  AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system , 2020, Applied Soft Computing.

[14]  H. Alias,et al.  Spatial distribution of malaria in Peninsular Malaysia from 2000 to 2009 , 2014, Parasites & Vectors.

[15]  J. Rodellar,et al.  Sequential classification system for recognition of malaria infection using peripheral blood cell images , 2020, Journal of Clinical Pathology.

[16]  Rabul Hussain Laskar,et al.  Hybrid classifier based life cycle stages analysis for malaria-infected erythrocyte using thin blood smear images , 2017, Neural Computing and Applications.

[17]  Chandan Chakraborty,et al.  Computer-Aided Diagnosis of Thalassemia Using Scanning Electron Microscopic Images of Peripheral Blood: A Morphological Approach , 2012 .

[18]  M. Shamim Hossain,et al.  Leveraging Deep Learning Techniques for Malaria Parasite Detection Using Mobile Application , 2020, Wirel. Commun. Mob. Comput..

[19]  W. Khan,et al.  Malaria prevalence in Malakand district, the north western region of Pakistan. , 2019, JPMA. The Journal of the Pakistan Medical Association.

[20]  Tehreem Fatima,et al.  Automatic detection of Plasmodium parasites from microscopic blood images , 2019, Journal of Parasitic Diseases.

[21]  Rabul Hussain Laskar,et al.  Malaria infected erythrocyte classification based on a hybrid classifier using microscopic images of thin blood smear , 2016, Multimedia Tools and Applications.

[22]  Yunpeng Li,et al.  Bioacoustic detection with wavelet-conditioned convolutional neural networks , 2018, Neural Computing and Applications.

[23]  Anne E Carpenter,et al.  Annotated high-throughput microscopy image sets for validation , 2012, Nature Methods.

[24]  A. Vijayalakshmi,et al.  Deep learning approach to detect malaria from microscopic images , 2019, Multimedia Tools and Applications.

[25]  Megbaru Alemu,et al.  Performance of Laboratory Professionals Working on Malaria Microscopy in Tigray, North Ethiopia , 2017, Journal of parasitology research.

[26]  Bijayananda Panigrahi,et al.  3D Quantum-inspired Self-supervised Tensor Network for Volumetric Segmentation of Brain MR Images , 2020 .

[27]  Peter Chiodini,et al.  Computer-Automated Malaria Diagnosis and Quantitation Using Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[28]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[29]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[30]  Madhu S. Nair,et al.  Malaria Parasite Detection From Peripheral Blood Smear Images Using Deep Belief Networks , 2017, IEEE Access.

[31]  David Schellenberg,et al.  A Research Agenda for Malaria Eradication: Diagnoses and Diagnostics , 2011, PLoS medicine.

[32]  Cecilia Di Ruberto,et al.  MP-IDB: The Malaria Parasite Image Database for Image Processing and Analysis , 2018, SaMBa@MICCAI.

[33]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[34]  Riyanarto Sarno,et al.  A Robust Segmentation for Malaria Parasite Detection of Thick Blood Smear Microscopic Images , 2019 .

[35]  Andrew G. Dempster,et al.  Parasite detection and identification for automated thin blood film malaria diagnosis , 2010, Comput. Vis. Image Underst..

[36]  S. Ong,et al.  MalariaCount: an image analysis-based program for the accurate determination of parasitemia. , 2007, Journal of microbiological methods.

[37]  Adnan Khashman Investigation of different neural models for blood cell type identification , 2010, Neural Computing and Applications.

[38]  M. Pietikäinen,et al.  A Malaria Diagnostic Tool Based on Computer Vision Screening and Visualization of Plasmodium falciparum Candidate Areas in Digitized Blood Smears , 2014, PloS one.

[39]  Jennifer Luchavez,et al.  Developing standards for malaria microscopy: external competency assessment for malaria microscopists in the Asia-Pacific , 2012, Malaria Journal.

[40]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[41]  Haoyi Fan,et al.  WBC-Net: A white blood cell segmentation network based on UNet++ and ResNet , 2021, Appl. Soft Comput..

[42]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Fabio A. González,et al.  A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images , 2009, J. Biomed. Informatics.

[44]  Andrew G. Dempster,et al.  Analysis of infected blood cell images using morphological operators , 2002, Image Vis. Comput..

[45]  Shi Qiu,et al.  The ensemble deep learning model for novel COVID-19 on CT images , 2020, Applied Soft Computing.

[46]  Sim Heng Ong,et al.  Robust contour reconstruction of red blood cells and parasites in the automated identification of the stages of malarial infection , 2011, Machine Vision and Applications.