Deep learning enabled multi-wavelength spatial coherence microscope for the classification of malaria-infected stages with limited labelled data size

Abstract Malaria is a life-threatening mosquito-borne blood disease and therefore, early detection is essential for health. The standard detection technique is a Giemsa-stained blood smear test, which requires a highly skilled technician. Automated classifications of different phases of malaria continue to be a challenge with limited label data, especially in the case of early trophozoite and late trophozoite or schizont phase where the sensitivity is lower. The aim of the study is to develop a fast, robust and fully automated malaria classification system with limited labeled data set by using a multi-wavelength based system and a pre-trained convolutional neural networks (CNNs). The multi-wavelength system improves the classification performance by increasing the training dataset. We also compare our customized CNN performance with other conventional CNNs and show that our network with a lesser number of layers has a comparable performance. We believe that our approach can be applied to other limited annotated biological datasets.

[1]  M. Pietikäinen,et al.  A Malaria Diagnostic Tool Based on Computer Vision Screening and Visualization of Plasmodium falciparum Candidate Areas in Digitized Blood Smears , 2014, PloS one.

[2]  Gabriel Popescu,et al.  Quantitative Phase Imaging , 2012 .

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ujjwal Bhattacharya,et al.  Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[5]  Brett E. Bouma,et al.  Optical Coherence Tomography , 2013 .

[6]  Dalip Singh Mehta,et al.  Quantitative phase imaging of human red blood cells using phase-shifting white light interference microscopy with colour fringe analysis , 2012 .

[7]  Yongkeun Park,et al.  Static and dynamic light scattering of healthy and malaria-parasite blood cells , 2010 .

[8]  YongKeun Park,et al.  Learning-based screening of hematologic disorders using quantitative phase imaging of individual red blood cells. , 2019, Biosensors & bioelectronics.

[9]  Ibrahim Abdulhalim,et al.  Spatial and temporal coherence effects in interference microscopy and full‐field optical coherence tomography , 2012 .

[10]  Etienne Cuche,et al.  Numerical parametric lens for shifting, magnification, and complete aberration compensation in digital holographic microscopy. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Ming Lei,et al.  LED-based digital holographic microscopy with slightly off-axis interferometry , 2014 .

[12]  Myung K. Kim Principles and techniques of digital holographic microscopy , 2010 .

[13]  Hye-Jeong Song,et al.  Automatic detection of malaria parasite in blood images using two parameters. , 2015, Technology and health care : official journal of the European Society for Engineering and Medicine.

[14]  Taesik Go,et al.  Machine learning‐based in‐line holographic sensing of unstained malaria‐infected red blood cells , 2018, Journal of biophotonics.

[15]  Dalip Singh Mehta,et al.  High-resolution full-field spatial coherence gated optical tomography using monochromatic light source , 2013 .

[16]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[17]  Myungjoo Kang,et al.  An Image Analysis Algorithm for Malaria Parasite Stage Classification and Viability Quantification , 2013, PloS one.

[18]  Gabriel Popescu,et al.  Imaging red blood cell dynamics by quantitative phase microscopy. , 2008, Blood cells, molecules & diseases.

[19]  Dalip Singh Mehta,et al.  Reduction of spatial phase noise in the laser based digital holographic microscopy for the quantitative phase measurement of biological cells , 2017, European Conference on Biomedical Optics.

[20]  YoungJu Jo,et al.  Quantitative Phase Imaging Techniques for the Study of Cell Pathophysiology: From Principles to Applications , 2013, Sensors.

[21]  Dalip Singh Mehta,et al.  Multispectral quantitative phase imaging of human red blood cells using inexpensive narrowband multicolor LEDs. , 2016, Applied optics.

[22]  Sung-Kyu Kim,et al.  Phase Unwrapping using Modified Goldstein Algorithm in Digital Holography , 2007 .

[23]  M. Takeda,et al.  Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry , 1982 .

[24]  YongKeun Park,et al.  Optical imaging techniques for the study of malaria. , 2012, Trends in biotechnology.

[25]  Bahram Javidi,et al.  Identification of malaria infected red blood samples by digital holographic quantitative phase microscope , 2015, European Conference on Biomedical Optics.

[26]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[28]  YongKeun Park,et al.  High-resolution three-dimensional imaging of red blood cells parasitized by Plasmodium falciparum and in situ hemozoin crystals using optical diffraction tomography , 2013, Journal of biomedical optics.

[29]  SangYun Lee,et al.  Refractive index tomograms and dynamic membrane fluctuations of red blood cells from patients with diabetes mellitus , 2017 .

[30]  D K Das,et al.  Computational microscopic imaging for malaria parasite detection: a systematic review , 2015, Journal of microscopy.

[31]  Hyun-seok Min,et al.  Quantitative Phase Imaging and Artificial Intelligence: A Review , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[32]  J. Chi,et al.  Automated Detection of P. falciparum Using Machine Learning Algorithms with Quantitative Phase Images of Unstained Cells , 2016, PloS one.

[33]  V. Ryabukho,et al.  Wiener–Khintchin theorem for spatial coherence of optical wave field , 2013 .

[34]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[35]  J Rosen,et al.  Longitudinal spatial coherence applied for surface profilometry. , 2000, Applied optics.

[36]  V. Ryabukho,et al.  Longitudinal correlation properties of an optical field with broad angular and frequency spectra and their manifestation in interference microscopy , 2013 .

[37]  Hong Zhao,et al.  A deep convolutional neural network for classification of red blood cells in sickle cell anemia , 2017, PLoS Comput. Biol..

[38]  Pinhas Girshovitz,et al.  Doubling the field of view in off-axis low-coherence interferometric imaging , 2014, Light: Science & Applications.

[39]  Zeev Zalevsky,et al.  Toward fast malaria detection by secondary speckle sensing microscopy , 2012, Biomedical optics express.

[40]  C Zhang,et al.  Segmentation of clustered nuclei based on concave curve expansion , 2013, Journal of microscopy.

[41]  Madhu S. Nair,et al.  Malaria Parasite Detection From Peripheral Blood Smear Images Using Deep Belief Networks , 2017, IEEE Access.

[42]  Dalip Singh Mehta,et al.  Development of full-field optical spatial coherence tomography system for automated identification of malaria using the multilevel ensemble classifier. , 2018, Journal of biophotonics.

[43]  I. Moon,et al.  Quantitative analysis of three-dimensional morphology and membrane dynamics of red blood cells during temperature elevation , 2019, Scientific Reports.

[44]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[45]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[46]  Daniel L. Rubin,et al.  Differential Data Augmentation Techniques for Medical Imaging Classification Tasks , 2017, AMIA.

[47]  Anuradha Sharma,et al.  Quantitative phase imaging of biological cells and tissues using singleshot white light interference microscopy and phase subtraction method for extended range of measurement , 2016, SPIE BiOS.

[48]  Hui Li,et al.  Deep learning in breast cancer risk assessment: evaluation of convolutional neural networks on a clinical dataset of full-field digital mammograms , 2017, Journal of medical imaging.

[49]  Chandan Chakraborty,et al.  Machine learning approach for automated screening of malaria parasite using light microscopic images. , 2013, Micron.

[50]  Michał Grochowski,et al.  Data augmentation for improving deep learning in image classification problem , 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW).