A framework based on deep neural networks to extract anatomy of mosquitoes from images

We design a framework based on Mask Region-based Convolutional Neural Network to automatically detect and separately extract anatomical components of mosquitoes-thorax, wings, abdomen and legs from images. Our training dataset consisted of 1500 smartphone images of nine mosquito species trapped in Florida. In the proposed technique, the first step is to detect anatomical components within a mosquito image. Then, we localize and classify the extracted anatomical components, while simultaneously adding a branch in the neural network architecture to segment pixels containing only the anatomical components. Evaluation results are favorable. To evaluate generality, we test our architecture trained only with mosquito images on bumblebee images. We again reveal favorable results, particularly in extracting wings. Our techniques in this paper have practical applications in public health, taxonomy and citizen-science efforts.

[1]  Haripriya Mukundarajan,et al.  Using Mobile Phones as Acoustic Sensors for the Surveillance of Spatio-temporal Mosquito Ecology , 2017 .

[2]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Qihua Tan,et al.  Genetic and environmental variation in educational attainment: an individual-based analysis of 28 twin cohorts , 2020, Scientific Reports.

[4]  Atef Ali Kloub.  The Importance of Learning Identification of Larvae and Adult Mosquitoes , 2017 .

[5]  Ronan Collobert,et al.  Learning to Segment Object Candidates , 2015, NIPS.

[6]  Yi Li,et al.  Fully Convolutional Instance-Aware Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Thejus Pathmakumar,et al.  Vision-Based Perception and Classification of Mosquitoes Using Support Vector Machine , 2017 .

[8]  Dong In Kim,et al.  Classification and Morphological Analysis of Vector Mosquitoes using Deep Convolutional Neural Networks , 2020, Scientific Reports.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Eamonn J. Keogh,et al.  Flying insect detection and classification with inexpensive sensors. , 2014, Journal of visualized experiments : JoVE.

[11]  B. A. Harrison,et al.  The Anopheles (Anopheles) Crucians Subgroup in the United States (Diptera: Culicidae) , 1976 .

[12]  Gaya R. Ranawaka,et al.  First record of Anopheles stephensi in Sri Lanka: a potential challenge for prevention of malaria reintroduction , 2017, Malaria Journal.

[13]  Dionis A. Padilla,et al.  Detection of Aedes Aegypti mosquito by digital image processing techniques and support vector machine , 2016, 2016 IEEE Region 10 Conference (TENCON).

[14]  Abhishek Dutta,et al.  The VGG Image Annotator (VIA) , 2019, ArXiv.

[15]  Sriram Chellappan,et al.  Leveraging Smart-Phone Cameras and Image Processing Techniques to Classify Mosquito Species , 2018, MobiQuitous.

[16]  Abhishek Dutta,et al.  The VIA Annotation Software for Images, Audio and Video , 2019, ACM Multimedia.

[17]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Jeffrey M. Sieracki,et al.  Machine vision automated species identification scaled towards production levels , 2016 .

[19]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Jian Sun,et al.  Instance-Aware Semantic Segmentation via Multi-task Network Cascades , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  Sriram Chellappan,et al.  Automating the Surveillance of Mosquito Vectors from Trapped Specimens Using Computer Vision Techniques , 2020, COMPASS.

[24]  Catia Prandi,et al.  LOCOMOBIS: a low-cost acoustic-based sensing system to monitor and classify mosquitoes , 2019, 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[25]  Nachiket Kapre,et al.  Preventive Detection of Mosquito Populations using Embedded Machine Learning on Low Power IoT Platforms , 2016, ACM DEV.

[26]  M. Mildner,et al.  Re-epithelialization and immune cell behaviour in an ex vivo human skin model , 2020, Scientific Reports.

[27]  Haripriya Mukundarajan,et al.  Using Mobile Phones as Acoustic Sensors for High-throughput Surveillance of Mosquito Ecology , 2017 .

[28]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[29]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  A Bouattour.  [Medical entomology laboratory]. , 1997, Archives de l'Institut Pasteur de Tunis.