Computer-Automated Malaria Diagnosis and Quantitation Using Convolutional Neural Networks

The optical microscope remains a widely-used tool for diagnosis and quantitation of malaria. An automated system that can match the performance of well-trained technicians is motivated by a shortage of trained microscopists. We have developed a computer vision system that leverages deep learning to identify malaria parasites in micrographs of standard, field-prepared thick blood films. The prototype application diagnoses P. falciparum with sufficient accuracy to achieve competency level 1 in the World Health Organization external competency assessment, and quantitates with sufficient accuracy for use in drug resistance studies. A suite of new computer vision techniques-global white balance, adaptive nonlinear grayscale, and a novel augmentation scheme-underpin the system's state-of-the-art performance. We outline a rich, global training set; describe the algorithm in detail; argue for patient-level performance metrics for the evaluation of automated diagnosis methods; and provide results for P. falciparum.

[1]  M. Pietikäinen,et al.  A Malaria Diagnostic Tool Based on Computer Vision Screening and Visualization of Plasmodium falciparum Candidate Areas in Digitized Blood Smears , 2014, PloS one.

[2]  Shawn K. McGuire,et al.  Automated microscopy and machine learning for expert-level malaria field diagnosis , 2015, 2015 IEEE Global Humanitarian Technology Conference (GHTC).

[3]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[7]  Jaime S. Cardoso,et al.  International Conference On Medical Imaging Understanding and Analysis 2016 , MIUA 2016 , 6-8 July 2016 , Loughborough , UK Automated detection of malaria parasites on thick blood smears via mobile devices , 2016 .

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[11]  Fred N. Kiwanuka,et al.  Automated Blood Smear Analysis for Mobile Malaria Diagnosis , 2022 .

[12]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[13]  J.P. VINK,et al.  An automatic vision‐based malaria diagnosis system , 2013, Journal of microscopy.

[14]  D. Warhurst,et al.  ACP Broadsheet no 148. July 1996. Laboratory diagnosis of malaria. , 1996, Journal of clinical pathology.

[15]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[16]  W. Karlen Automated Blood Smear Analysis for Mobile Malaria Diagnosis , 2018, Mobile Point-of-Care Monitors and Diagnostic Device Design.

[17]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[18]  Jaime S. Cardoso,et al.  A Review of Automatic Malaria Parasites Detection and Segmentation in Microscopic Images , 2016 .

[19]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[20]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[21]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[22]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[23]  NJ White,et al.  The parasite clearance curve , 2011, Malaria Journal.

[24]  D. Cox The Regression Analysis of Binary Sequences , 2017 .

[25]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[26]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[27]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[29]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[30]  C. Wongsrichanalai,et al.  A review of malaria diagnostic tools: microscopy and rapid diagnostic test (RDT). , 2007, The American journal of tropical medicine and hygiene.

[31]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Mark D. Perkins,et al.  Performance of Three LED-Based Fluorescence Microscopy Systems for Detection of Tuberculosis in Uganda , 2010, PloS one.

[33]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[34]  J. F. Brenner,et al.  An automated microscope for cytologic research a preliminary evaluation. , 1976, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  D K Das,et al.  Computational microscopic imaging for malaria parasite detection: a systematic review , 2015, Journal of microscopy.

[37]  Fabio A. González,et al.  A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images , 2009, J. Biomed. Informatics.

[38]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[39]  Jennifer Luchavez,et al.  Developing standards for malaria microscopy: external competency assessment for malaria microscopists in the Asia-Pacific , 2012, Malaria Journal.

[40]  A. Brink,et al.  Diagnostic disagreement--the lessons learnt from malaria diagnosis in Mpumalanga. , 1997, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.

[41]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[42]  S. Strugger Fluorescence microscope examination of bacteria in soil. , 1948, Canadian journal of research.