Detection and Identification of Stored-Grain Insects Using Deep Learning: A More Effective Neural Network

The detection and identification of stored grain insects is important to ensure the safety of grain during grain storage. At present, insect identification methods primarily rely on manual classification; therefore, the automatic, rapid and accurate detection of stored grain insects remains a challenge. This paper proposes an improved detection neural network architecture based on R-FCN to solve the problem of detection and classification of eight common stored grain insects. In this network, we use the multiscale training strategy with a fully convolutional network to extract more features of the insects and automatically provide the location of potentially stored grain insects through an RPN from the feature map. By using the position-sensitive score map to replace some fully-connected layers, our network is more adaptive to detect insects in complicated backgrounds, and our detection speed is improved. In addition, we also used soft-NMS to solve the superposition interference between insects and to further improve the detection accuracy. Sufficient comparative experiments are performed using our two stored grain insect detection datasets, which are carefully annotated by entomologists. Quantitative comparisons against several prior state-of-the-art methods demonstrate the superiority of our approach. Experimental results show that the proposed method achieves a higher accuracy and is faster than the state-of-the-art insect image classification algorithms.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Doyeon Kim,et al.  Performance effect analysis for insect classification using convolutional neural network , 2017, 2017 7th IEEE International Conference on Control System, Computing and Engineering (ICCSCE).

[4]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[5]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jinyan Li,et al.  Automatic classification for field crop insects via multiple-task sparse representation and multiple-kernel learning , 2015, Comput. Electron. Agric..

[10]  Michael Mayo,et al.  Automatic species identification of live moths , 2006, Knowl. Based Syst..

[11]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Kevin J. Gaston,et al.  Automating insect identification: exploring the limitations of a prototype system , 1999 .

[13]  Rui Li,et al.  Multi-level learning features for automatic classification of field crop pests , 2018, Comput. Electron. Agric..

[14]  Xi Cheng,et al.  Pest identification via deep residual learning in complex background , 2017, Comput. Electron. Agric..

[15]  Digvir S. Jayas,et al.  The Ecosystem Approach to Grain Storage , 2012, Agricultural Research.

[16]  P. W. Flinn,et al.  DETECTION OF INSECTS IN BULK WHEAT SAMPLES WITH MACHINE VISION , 1998 .

[17]  Jiangtao Cui,et al.  Combined blur, translation, scale and rotation invariant image recognition by Radon and pseudo-Fourier-Mellin transforms , 2012, Pattern Recognit..

[18]  Jun Zhang,et al.  Insect Detection and Classification Based on an Improved Convolutional Neural Network , 2018, Sensors.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  Hulya Yalcin,et al.  Vision based automatic inspection of insects in pheromone traps , 2015, 2015 Fourth International Conference on Agro-Geoinformatics (Agro-geoinformatics).

[22]  Noel D.G. White,et al.  Detection techniques for stored-product insects in grain , 2007 .

[23]  Forrest N. Iandola,et al.  DenseNet: Implementing Efficient ConvNet Descriptor Pyramids , 2014, ArXiv.

[24]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[26]  Mingming Zhang,et al.  Identification of Maize Leaf Diseases Using Improved Deep Convolutional Neural Networks , 2018, IEEE Access.

[27]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[28]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Graham W. Taylor,et al.  Automatic moth detection from trap images for pest management , 2016, Comput. Electron. Agric..