A Weakly Supervised Deep Learning Approach for Detecting Malaria and Sickle Cells in Blood Films

Machine vision analysis of blood films imaged under a brightfield microscope could provide scalable malaria diagnosis solutions in resource constrained endemic urban settings. The major bottleneck in successfully analyzing blood films with deep learning vision techniques is a lack of object-level annotations of disease markers such as parasites or abnormal red blood cells. To overcome this challenge, this work proposes a novel deep learning supervised approach that leverages weak labels readily available from routine clinical microscopy to diagnose malaria in thick blood film microscopy. This approach is based on aggregating the convolutional features of multiple objects present in one hundred high resolution image fields. We show that this method not only achieves expert-level malaria diagnostic accuracy without any hard object-level labels but can also identify individual malaria parasites in digitized thick blood films, which is useful in assessing disease severity and response to treatment. We demonstrate another application scenario where our approach is able to detect sickle cells in thin blood films. We discuss the wider applicability of the approach in automated analysis of thick blood films for the diagnosis of other blood disorders.

[1]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[2]  Zhipeng Jia,et al.  Constrained Deep Weak Supervision for Histopathology Image Segmentation , 2017, IEEE Transactions on Medical Imaging.

[3]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[4]  Sameer Antani,et al.  Parasite Detection in Thick Blood Smears Based on Customized Faster-RCNN on Smartphones , 2019, 2019 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[5]  Mayoore S. Jaiswal,et al.  Automated microscopy for routine malaria diagnosis: a field comparison on Giemsa-stained blood films in Peru , 2018, Malaria Journal.

[6]  Peter Chiodini,et al.  Computer-Automated Malaria Diagnosis and Quantitation Using Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[7]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[8]  J. S. Marron,et al.  Multiple Instance Learning for Heterogeneous Images: Training a CNN for Histopathology , 2018, MICCAI.

[9]  Tathagato Rai Dastidar,et al.  Analyzing Microscopic Images of Peripheral Blood Smear Using Deep Learning , 2017, DLMIA/ML-CDS@MICCAI.

[10]  Carlton Haywood,et al.  Sickle cell trait diagnosis: clinical and social implications. , 2015, Hematology. American Society of Hematology. Education Program.

[11]  G. Wainrib,et al.  Deep learning-based classification of mesothelioma improves prediction of patient outcome , 2019, Nature Medicine.

[12]  Michael Unser,et al.  Complex wavelets for extended depth‐of‐field: A new method for the fusion of multichannel microscopy images , 2004, Microscopy research and technique.

[13]  Brendan J. Frey,et al.  Classifying and segmenting microscopy images with deep multiple instance learning , 2015, Bioinform..

[14]  Nassir Navab,et al.  Multiclass Deep Active Learning for Detecting Red Blood Cell Subtypes in Brightfield Microscopy , 2019, MICCAI.

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jaime S. Cardoso,et al.  International Conference On Medical Imaging Understanding and Analysis 2016 , MIUA 2016 , 6-8 July 2016 , Loughborough , UK Automated detection of malaria parasites on thick blood smears via mobile devices , 2016 .

[17]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[18]  William J Moss,et al.  Malaria knowledge and bed net use in three transmission settings in southern Africa , 2018, Malaria Journal.

[19]  Juan Manuel Górriz,et al.  Digital image analysis for automatic enumeration of malaria parasites using morphological operations , 2015, Expert Syst. Appl..

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Sameer Antani,et al.  Deep Learning for Smartphone-Based Malaria Parasite Detection in Thick Blood Smears , 2020, IEEE Journal of Biomedical and Health Informatics.

[22]  D K Das,et al.  Computational microscopic imaging for malaria parasite detection: a systematic review , 2015, Journal of microscopy.

[23]  Hong Zhao,et al.  A deep convolutional neural network for classification of red blood cells in sickle cell anemia , 2017, PLoS Comput. Biol..