CNN-based image analysis for malaria diagnosis

Malaria is a major global health threat. The standard way of diagnosing malaria is by visually examining blood smears for parasite-infected red blood cells under the microscope by qualified technicians. This method is inefficient and the diagnosis depends on the experience and the knowledge of the person doing the examination. Automatic image recognition technologies based on machine learning have been applied to malaria blood smears for diagnosis before. However, the practical performance has not been sufficient so far. This study proposes a new and robust machine learning model based on a convolutional neural network (CNN) to automatically classify single cells in thin blood smears on standard microscope slides as either infected or uninfected. In a ten-fold cross-validation based on 27,578 single cell images, the average accuracy of our new 16-layer CNN model is 97.37%. A transfer learning model only achieves 91.99% on the same images. The CNN model shows superiority over the transfer learning model in all performance indicators such as sensitivity (96.99% vs 89.00%), specificity (97.75% vs 94.98%), precision (97.73% vs 95.12%), F1 score (97.36% vs 90.24%), and Matthews correlation coefficient (94.75% vs 85.25%).

[1]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[2]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[3]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[4]  S. Ong,et al.  MalariaCount: an image analysis-based program for the accurate determination of parasitemia. , 2007, Journal of microbiological methods.

[5]  Jeeseong Hwang,et al.  Band 3 modifications in Plasmodium falciparum-infected AA and CC erythrocytes assayed by autocorrelation analysis using quantum dots , 2005, Journal of Cell Science.

[6]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[7]  Madison,et al.  Malaria surveillance--United States, 2010. , 2012, Morbidity and mortality weekly report. Surveillance summaries.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  R. Vaillant,et al.  An original approach for the localization of objects in images , 1993 .

[11]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[12]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[13]  R. Vaillant,et al.  Original approach for the localisation of objects in images , 1994 .

[14]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[15]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  C. Chakraborty,et al.  Automated system for characterization and classification of malaria‐infected stages using light microscopic images of thin blood smears , 2015, Journal of microscopy.

[18]  Jimmy Xiangji Huang,et al.  DL-ADR: a novel deep learning model for classifying genomic variants into adverse drug reactions , 2016, BMC Medical Genomics.

[19]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Nancy Fullman,et al.  Global malaria mortality between 1980 and 2010: a systematic analysis , 2012, The Lancet.

[21]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Kannappan Palaniappan,et al.  Coupled edge profile active contours for red blood cell flow analysis , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[23]  Fabio A. González,et al.  A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images , 2009, J. Biomed. Informatics.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).