Automatic Segmentation and Counting of Aphid Nymphs on Leaves Using Convolutional Neural Networks

The presence of pests is one of the main problems in crop production, and obtaining reliable statistics of pest infestation is essential for pest management. Detection of pests should be automated because human monitoring of pests is time-consuming and error-prone. Aphids are among the most destructive pests in greenhouses and they reproduce quickly. Automatic detection of aphid nymphs on leaves (especially on the lower surface) using image analysis is a challenging problem due to color similarity and complicated background. In this study, we propose a method for segmentation and counting of aphid nymphs on leaves using convolutional neural networks. Digital images of pakchoi leaves at different aphid infestation stages were obtained, and corresponding pixel-level binary mask annotated. In the test, segmentation results by the proposed method achieved high overlap with annotation by human experts (Dice coefficient of 0.8207). Automatic counting based on segmentation showed high precision (0.9563) and recall (0.9650). The correlation between aphid nymph count by the proposed method and manual counting was high (R2 = 0.99). The proposed method is generic and can be applied for other species of pests.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Haiyang Zhou,et al.  A smart-vision algorithm for counting whiteflies and thrips on sticky traps using two-dimensional Fourier transform spectrum , 2017 .

[3]  Jayme Garcia Arnal Barbedo,et al.  Using digital image processing for counting whiteflies on soybean leaves , 2014 .

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Tae-Soo Chon,et al.  Automatic identification and counting of small size pests in greenhouse conditions with low computational cost , 2015, Ecol. Informatics.

[6]  Thomas Brox,et al.  Descriptor Matching with Convolutional Neural Networks: a Comparison to SIFT , 2014, ArXiv.

[7]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Rodrigo Castañeda-Miranda,et al.  Original paper: Scale invariant feature approach for insect monitoring , 2011 .

[10]  Ben Glocker,et al.  Human-level CMR image analysis with deep fully convolutional networks , 2017, ArXiv.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Sreekala G. Bajwa,et al.  Detection of soybean aphids in a greenhouse using an image processing technique , 2017, Comput. Electron. Agric..

[13]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[14]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Heungsun Park,et al.  Development of Time-Efficient Method for Estimating Aphids Density Using Yellow Sticky Traps in Cucumber Greenhouses , 2001 .

[17]  Rodrigo Castañeda-Miranda,et al.  Machine vision algorithm for whiteflies (Bemisia tabaci Genn.) scouting under greenhouse environment , 2009 .

[18]  Tae-Soo Chon,et al.  Automatic identification of whiteflies, aphids and thrips in greenhouse based on image analysis , 2007 .

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[21]  Alejandro López,et al.  Combination of image processing and artificial neural networks as a novel approach for the identification of Bemisia tabaci and Frankliniella occidentalis on sticky traps in greenhouse agriculture , 2016, Comput. Electron. Agric..

[22]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[23]  Michael P. Parrella,et al.  Time-Efficient Use of Yellow Sticky Traps in Monitoring Insect Populations , 1992 .