Application of convolutional neural networks for classification of adult mosquitoes in the field

Dengue, chikungunya and Zika are arboviruses transmitted by mosquitos of the genus Aedes and have caused several outbreaks in world over the past ten years. Morphological identification of mosquitos is currently restricted due to the small number of adequately trained professionals. We implemented a computational model based on a convolutional neural network (CNN) to extract features from mosquito images to identify adult mosquitoes from the species Aedes aegypti, Aedes albopictus and Culex quinquefasciatus. To train the CNN to perform automatic morphological classification of mosquitoes, we used a dataset that included 4,056 mosquito images. Three neural networks, including LeNet, AlexNet and GoogleNet, were used. During the validation phase, the accuracy of the mosquito classification was 57.5% using LeNet, 74.7% using AlexNet and 83.9% using GoogleNet. During the testing phase, the best result (76.2%) was obtained using GoogleNet; results of 52.4% and 51.2% were obtained using LeNet and AlexNet, respectively. Significantly, accuracies of 100% and 90% were achieved for the classification of Aedes and Culex, respectively. A classification accuracy of 82% was achieved for Aedes females. Our results provide information that is fundamental for the automatic morphological classification of adult mosquito species in field. The use of CNN's is an important method for autonomous identification and is a valuable and accessible resource for health workers and taxonomists for the identification of some insects that can transmit infectious agents to humans.

[1]  Simon Cauchemez,et al.  Association between Zika virus and microcephaly in French Polynesia, 2013–15: a retrospective study , 2016, The Lancet.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Donald E. Ingber,et al.  Distinct Contributions of Astrocytes and Pericytes to Neuroinflammation Identified in a 3D Human Blood-Brain Barrier on a Chip , 2016, PloS one.

[4]  David L. Smith,et al.  The global distribution of the arbovirus vectors Aedes aegypti and Ae. albopictus , 2015, eLife.

[5]  Jiangning Wang,et al.  A new automatic identification system of insect images at the order level , 2012, Knowl. Based Syst..

[6]  WangJiangning,et al.  A new automatic identification system of insect images at the order level , 2012 .

[7]  Pierre Taberlet,et al.  Detection of Invasive Mosquito Vectors Using Environmental DNA (eDNA) from Water Samples , 2016, PloS one.

[8]  Robert A Wyttenbach,et al.  Mosquito (Aedes aegypti) flight tones: frequency, harmonicity, spherical spreading, and phase relationships. , 2014, The Journal of the Acoustical Society of America.

[9]  H. Guzmán,et al.  Vertical Transmission of Zika Virus in Aedes aegypti Mosquitoes , 2016, The American journal of tropical medicine and hygiene.

[10]  P. Jambulingam,et al.  DNA Barcodes Can Distinguish Species of Indian Mosquitoes (Diptera: Culicidae) , 2007, Journal of medical entomology.

[11]  Yao Zhou,et al.  A Vision-Based Counting and Recognition System for Flying Insects in Intelligent Agriculture , 2018, Sensors.

[12]  B. Kesavaraju,et al.  New Technique to Count Mosquito Adults: Using ImageJ Software to Estimate Number of Mosquito Adults in a Trap , 2012, Journal of the American Mosquito Control Association.

[13]  Bradley J. Main,et al.  Vector competence of Aedes aegypti, Culex tarsalis, and Culex quinquefasciatus from California for Zika virus , 2018, PLoS neglected tropical diseases.

[14]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[15]  D. Jiang,et al.  Mapping the spatial distribution of Aedes aegypti and Aedes albopictus. , 2018, Acta tropica.

[16]  E. Scholte,et al.  Real-Time PCR Tests in Dutch Exotic Mosquito Surveys; Implementation of Aedes aegypti and Aedes albopictus Identification Tests, and the Development of Tests for the Identification of Aedes atropalpus and Aedes japonicus japonicus (Diptera: Culicidae) , 2015, Journal of medical entomology.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Antonio Sergio Ferraudo,et al.  Artificial Neural Network applied as a methodology of mosquito species identification. , 2015, Acta tropica.

[19]  Saeid Nahavandi,et al.  Assessment of ICount software, a precise and fast egg counting tool for the mosquito vector Aedes aegypti , 2016, Parasites & Vectors.

[20]  Vinícius M. A. de Souza,et al.  Classification of Data Streams Applied to Insect Recognition: Initial Results , 2013, 2013 Brazilian Conference on Intelligent Systems.

[21]  Association Between Zika Virus and Microcephaly in French Polynesia, 2013–2015: A Retrospective Study , 2016 .

[22]  F. Hernández-Chavarría,et al.  Scanning electron microscopy of the four larval instars of the Dengue fever vector Aedes aegypti (Diptera: Culicidae). , 2006, Revista de biologia tropical.

[23]  S. Paulson,et al.  Morphological Differentiation of the Eggs of North American Container-Inhabiting Aedes Mosquitoes , 2016, Journal of the American Mosquito Control Association.

[24]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[25]  R. Romi,et al.  Infection with chikungunya virus in Italy: an outbreak in a temperate region , 2007, The Lancet.

[26]  Daniel P. W. Ellis,et al.  Applying Machine Learning and Audio Analysis Techniques to Insect Recognition in Intelligent Traps , 2013, 2013 12th International Conference on Machine Learning and Applications.

[27]  Jun Lv,et al.  An Insect Imaging System to Automate Rice Light-Trap Pest Identification , 2012 .

[28]  L. del Carpio-Orantes,et al.  Zika and its vector mosquitoes in Mexico , 2018, Journal of Asia-Pacific Biodiversity.

[29]  Qingbin Zhan,et al.  A tool for developing an automatic insect identification system based on wing outlines , 2015, Scientific Reports.

[30]  Mariko Nakano-Miyatake,et al.  Mosquito larva classification method based on convolutional neural networks , 2017, 2017 International Conference on Electronics, Communications and Computers (CONIELECOMP).

[31]  M. Kraemer,et al.  Global risk mapping for major diseases transmitted by Aedes aegypti and Aedes albopictus. , 2018, International journal of infectious diseases : IJID : official publication of the International Society for Infectious Diseases.

[32]  D. Gubler,et al.  Unexpected outbreaks of arbovirus infections: lessons learned from the Pacific and tropical America. , 2018, The Lancet. Infectious diseases.

[33]  Motomi Ito,et al.  Current progress in DNA barcoding and future implications for entomology , 2011 .

[34]  W. Cao,et al.  Culex pipiens quinquefasciatus: a potential vector to transmit Zika virus , 2016, Emerging microbes & infections.

[35]  C. Peixoto,et al.  Zika virus replication in the mosquito Culex quinquefasciatus in Brazil , 2016, Emerging Microbes &Infections.

[36]  J. Dujardin,et al.  Wing shape of dengue vectors from around the world. , 2010, Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases.

[37]  B. M. Meneses,et al.  An integrated approach for the assessment of the Aedes aegypti and Aedes albopictus global spatial distribution, and determination of the zones susceptible to the development of Zika virus. , 2017, Acta tropica.

[38]  Surveillance and Control of Aedes aegypti and Aedes albopictus in the United States , 2020 .

[39]  G. Benelli,et al.  DNA barcoding of five Japanese encephalitis mosquito vectors (Culex fuscocephala, Culex gelidus, Culex tritaeniorhynchus, Culex pseudovishnui and Culex vishnui). , 2018, Acta tropica.

[40]  B. Pinsky,et al.  Zika and Chikungunya virus detection in naturally infected Aedes aegypti in Ecuador. , 2018, Acta tropica.

[41]  V. V. Gohokar,et al.  Detection and Classification of Pests in Greenhouse Using Image Processing , 2013 .

[42]  Megha Sharma,et al.  Rapid identification of medically important mosquitoes by matrix-assisted laser desorption/ionization time-of-flight mass spectrometry , 2018, Parasites & Vectors.

[43]  Eamonn J. Keogh,et al.  Towards Automatic Classification on Flying Insects Using Inexpensive Sensors , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[44]  A. Failloux,et al.  An overview of mosquito vectors of Zika virus. , 2018, Microbes and infection.

[45]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[46]  Joe-Air Jiang,et al.  Mosquito vector monitoring system based on optical wingbeat classification , 2015, Comput. Electron. Agric..

[47]  L. Epelboin,et al.  Zika virus: An updated review of competent or naturally infected mosquitoes , 2017, PLoS neglected tropical diseases.

[48]  Weida Tong,et al.  Species Identification of Food Contaminating Beetles by Recognizing Patterns in Microscopic Images of Elytra Fragments , 2016, PloS one.