Expert‐level automated malaria diagnosis on routine blood films with deep neural networks

Over 200 million malaria cases globally lead to half a million deaths annually. Accurate malaria diagnosis remains a challenge. Automated imaging processing approaches to analyze Thick Blood Films (TBF) could provide scalable solutions, for urban healthcare providers in the holoendemic malaria sub‐Saharan region. Although several approaches have been attempted to identify malaria parasites in TBF, none have achieved negative and positive predictive performance suitable for clinical use in the west sub‐Saharan region. While malaria parasite object detection remains an intermediary step in achieving automatic patient diagnosis, training state‐of‐the‐art deep‐learning object detectors requires the human‐expert labor‐intensive process of labeling a large dataset of digitized TBF. To overcome these challenges and to achieve a clinically usable system, we show a novel approach. It leverages routine clinical‐microscopy labels from our quality‐controlled malaria clinics, to train a Deep Malaria Convolutional Neural Network classifier (DeepMCNN) for automated malaria diagnosis. Our system also provides total Malaria Parasite (MP) and White Blood Cell (WBC) counts allowing parasitemia estimation in MP/μL, as recommended by the WHO. Prospective validation of the DeepMCNN achieves sensitivity/specificity of 0.92/0.90 against expert‐level malaria diagnosis. Our approach PPV/NPV performance is of 0.92/0.90, which is clinically usable in our holoendemic settings in the densely populated metropolis of Ibadan. It is located within the most populous African country (Nigeria) and with one of the largest burdens of Plasmodium falciparum malaria. Our openly available method is of importance for strategies aimed to scale malaria diagnosis in urban regions where daily assessment of thousands of specimens is required.

[1]  Mahdieh Poostchi,et al.  Image analysis and machine learning for detecting malaria , 2018, Translational research : the journal of laboratory and clinical medicine.

[2]  Nathaniel K. Afolabi,et al.  Low plasma haptoglobin is a risk factor for life-threatening childhood severe malarial anemia and not an exclusive consequence of hemolysis , 2018, Scientific Reports.

[3]  Shawn K. McGuire,et al.  Automated microscopy and machine learning for expert-level malaria field diagnosis , 2015, 2015 IEEE Global Humanitarian Technology Conference (GHTC).

[4]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  Mayoore S. Jaiswal,et al.  Automated microscopy for routine malaria diagnosis: a field comparison on Giemsa-stained blood films in Peru , 2018, Malaria Journal.

[7]  Anne E Carpenter,et al.  Applying Faster R-CNN for Object Detection on Malaria Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[10]  Sameer Antani,et al.  Deep Learning for Smartphone-Based Malaria Parasite Detection in Thick Blood Smears , 2020, IEEE Journal of Biomedical and Health Informatics.

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ishan R. Dave Image analysis for malaria parasite detection from microscopic images of thick blood smear , 2017, 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[13]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[14]  Nathaniel K. Afolabi,et al.  Circulatory hepcidin is associated with the anti-inflammatory response but not with iron or anemic status in childhood malaria. , 2013, Blood.

[15]  Organización Mundial del Comercio World Trade Report 2013 , 2013 .

[16]  Nathaniel K. Afolabi,et al.  Severe Childhood Malaria Syndromes Defined by Plasma Proteome Profiles , 2012, PloS one.

[17]  Peter Chiodini,et al.  Computer-Automated Malaria Diagnosis and Quantitation Using Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[18]  T. Coetzer,et al.  Evaluation of automated malaria diagnosis using the Sysmex XN-30 analyser in a clinical setting , 2019, Malaria Journal.

[19]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  Jaime S. Cardoso,et al.  International Conference On Medical Imaging Understanding and Analysis 2016 , MIUA 2016 , 6-8 July 2016 , Loughborough , UK Automated detection of malaria parasites on thick blood smears via mobile devices , 2016 .

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  J. Nsungwa-Sabiiti,et al.  Malaria Rapid Diagnostic Tests and Malaria Microscopy for Guiding Malaria Treatment of Uncomplicated Fevers in Nigeria and Prereferral Cases in 3 African Countries , 2016, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[24]  Joseph Joel Pollak,et al.  Evaluation of the Parasight Platform for Malaria Diagnosis , 2016, Journal of Clinical Microbiology.

[25]  Y. Lau,et al.  Diagnostic tools in childhood malaria , 2018, Parasites & Vectors.

[26]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[27]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[28]  Yinghuan Shi,et al.  An Effective MR-Guided CT Network Training for Segmenting Prostate in CT Images , 2019, IEEE Journal of Biomedical and Health Informatics.

[29]  D K Das,et al.  Computational microscopic imaging for malaria parasite detection: a systematic review , 2015, Journal of microscopy.

[30]  L. Siahaan Laboratory diagnostics of malaria , 2018 .

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  Michael Unser,et al.  Complex wavelets for extended depth‐of‐field: A new method for the fusion of multichannel microscopy images , 2004, Microscopy research and technique.

[33]  J. Barnwell,et al.  Inter-rater reliability of malaria parasite counts and comparison of methods , 2009, Malaria Journal.

[34]  Juan Manuel Górriz,et al.  Digital image analysis for automatic enumeration of malaria parasites using morphological operations , 2015, Expert Syst. Appl..