A novel method based on a Mask R-CNN model for processing dPCR images

A digital polymerase chain reaction (dPCR) using fluorescence images for collecting quantitative information needs efficient software tools to automate the image analysis process. However, due to the broad range of fluorescence image characteristics, such as the uneven fluorescence intensity distribution, irregular structures of microarrays, and diverse and unpredictable morphologies of microchambers, existing tools fail to extract signals from these images properly, thus posing challenges for the improvement of detection accuracy. In this paper, a deep learning method based on the Mask R-CNN model was used for image processing to achieve more accurate quantification of nucleic acids in both microarray and droplet dPCR. This Mask R-CNN based method uses massive dPCR fluorescence image data to train a model that has the ability to recognize target signals in dPCR images precisely and automatically, regardless of the non-uniform luminosity or spot impurities appearing in dPCR images. When the Mask R-CNN model is used to process images with non-uniform luminosity, the true positive rate of this model can reach 97.56%. By contrast, the true positive rate of threshold segmentation is only 68.29%. As for dealing with images with spot impurities, which caused a 7.25% fault of the positive points in the threshold segmentation method, the error rate decreased to zero using the Mask R-CNN model. In addition, the labeling of annotated pictures is time-consuming. Therefore, an iteration method was used in the annotation stage to reduce time spent on labeling. With proper modifications, this method has great potential to serve as an alternative to achieve a highly efficient fluorescence image process for dPCR or other digital assays.

[1]  Yong Xia,et al.  Attention Residual Learning for Skin Lesion Classification , 2019, IEEE Transactions on Medical Imaging.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ming Dong,et al.  Objective Detection of Eloquent Axonal Pathways to Minimize Postoperative Deficits in Pediatric Epilepsy Surgery Using Diffusion Tractography and Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[4]  Ali Khademhosseini,et al.  Spot identification and quality control in cell-based microarrays. , 2012, ACS combinatorial science.

[5]  Bernard R Brooks,et al.  Automatic Spot Identification for High Throughput Microarray Analysis. , 2011, Journal of bioengineering & biomedical science.

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  B. Laufer,et al.  Alteration of Gene Expression, DNA Methylation, and Histone Methylation in Free Radical Scavenging Networks in Adult Mouse Hippocampus following Fetal Alcohol Exposure , 2016, PloS one.

[8]  Alfred M. Bruckstein,et al.  A new method for image segmentation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[9]  Qing Wang,et al.  Distance metric optimization driven convolutional neural network for age invariant face recognition , 2018, Pattern Recognit..

[10]  Qi Zhang,et al.  Microarray Technology for Major Chemical Contaminants Analysis in Food: Current Status and Prospects , 2012, Sensors.

[11]  Kunihiro Nishimura,et al.  Plasma microRNA 499 as a biomarker of acute myocardial infarction. , 2010, Clinical chemistry.

[12]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Kyoungmi Kim,et al.  Overdiagnosis of Clostridium difficile Infection in the Molecular Test Era. , 2015, JAMA internal medicine.

[14]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  A. Lee,et al.  1-Million droplet array with wide-field fluorescence imaging for digital PCR. , 2011, Lab on a chip.

[16]  Zhiqiang Cheng,et al.  Automatic Spot Identification Method for High Throughput Surface Plasmon Resonance Imaging Analysis , 2018, Biosensors.

[17]  Bofan Song,et al.  Automatic classification of dual-modalilty, smartphone-based oral dysplasia and malignancy images using deep learning. , 2018, Biomedical optics express.

[18]  Tao Zhang,et al.  A Thermosetting Oil for Droplet‐Based Real‐Time Monitoring of Digital PCR and Cell Culture , 2018, Advanced Functional Materials.

[19]  Linda S Birnbaum,et al.  Gene expression changes in immune response pathways following oral administration of tetrabromobisphenol A (TBBPA) in female Wistar Han rats. , 2017, Toxicology letters.

[20]  Zhenming Hu,et al.  A highly integrated real-time digital PCR device for accurate DNA quantitative analysis. , 2019, Biosensors & bioelectronics.

[21]  V. Affolter,et al.  Dermatopathology – the link between ancillary techniques and clinical lesions , 2017, Veterinary dermatology.

[22]  Yun Zhu,et al.  Fluorescence-Based Bioassays for the Detection and Evaluation of Food Materials , 2015, Sensors.

[23]  Jean Yee Hwa Yang,et al.  Gene-gene interaction filtering with ensemble of filters , 2011, BMC Bioinformatics.

[24]  Weibo Fang,et al.  Smartphone-based mobile digital PCR device for DNA quantitative analysis with high accuracy. , 2018, Biosensors & bioelectronics.

[25]  Ina Koch,et al.  Unsupervised image segmentation for microarray spots with irregular contours and inner holes , 2015, BMC Bioinformatics.

[26]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[27]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Els Goetghebeur,et al.  Model-Based Classification for Digital PCR: Your Umbrella for Rain. , 2017, Analytical chemistry.

[30]  Yan W. Asmann,et al.  Circulating Extracellular RNA Markers of Liver Regeneration , 2016, PloS one.

[31]  Marzena Wojtaszewska,et al.  Gene expression profiling of acute myeloid leukemia samples from adult patients with AML-M1 and -M2 through boutique microarrays, real-time PCR and droplet digital PCR , 2017, International journal of oncology.

[32]  Yanhui Guo,et al.  White blood cells identification system based on convolutional deep neural learning networks , 2017, Comput. Methods Programs Biomed..

[33]  Hamid Hassanpour,et al.  Employing image processing techniques for cancer detection using microarray images , 2017, Comput. Biol. Medicine.