Probabilistic faster R-CNN with stochastic region proposing: Towards object detection and recognition in remote sensing imagery

Abstract Object detection is one of the most important tasks involved in intelligent agriculture systems, especially in pest detection. This paper focuses on a most devastated agricultural disaster: grasshopper plagues. Grasshopper detection and monitoring is of paramount importance in preventing grasshopper plagues. This paper proposes a probabilistic faster R-CNN algorithm with stochastic region proposing, where a probabilistic region proposal network, an image classification network, and an object detection network are integrated to detect and locate grasshoppers. More specifically, in the proposed framework, the probabilistic region proposal network considers attributes (e.g. size, shape) of region proposals and the image classification network identifies the existence of grasshoppers while the object detection network scores recognition confidence for a region proposal. By integrating these three networks, the uncertainty can be passed from end to end, and the final confidence is obtained for each region proposal can be explicitly quantified. To enhance algorithm robustness, a stochastic region proposing algorithm is developed to screen region proposals rather than using a predetermined threshold. The proposed algorithm is validated by recently collected grasshopper datasets. The experimental results demonstrate that the proposed algorithm not only outperforms competing algorithms in terms of average precision (0.91), average missed rate (0.36), and maximum F1-score (0.9263), but also reduces the false positive rate of recognising the existence of grasshoppers in an open field.

[1]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[2]  Zhongzhi Han,et al.  Research on insect pest image detection and recognition based on bio-inspired methods , 2018 .

[3]  Gilles Burel,et al.  Detection and localization of faces on digital images , 1994, Pattern Recognit. Lett..

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Yizhou Yu,et al.  Contrast-Oriented Deep Neural Networks for Salient Object Detection , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[7]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Caifeng Shan,et al.  Deep Salient Object Detection With Contextual Information Guidance , 2020, IEEE Transactions on Image Processing.

[9]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Graham W. Taylor,et al.  Automatic moth detection from trap images for pest management , 2016, Comput. Electron. Agric..

[11]  Wei Wu,et al.  Detection of aphids in wheat fields using a computer vision technique , 2016 .

[12]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Xi Cheng,et al.  Pest identification via deep residual learning in complex background , 2017, Comput. Electron. Agric..

[14]  S. Carneiro,et al.  Transmission system expansion planning using a sigmoid function to handle integer investment variables , 2005, 2006 IEEE Power Engineering Society General Meeting.

[15]  Wenjie Li,et al.  A Confident Information First Principle for Parameter Reduction and Model Selection of Boltzmann Machines , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Wen-Hua Chen,et al.  Locust Recognition and Detection via Aggregate Channel Features , 2019, UK-RAS19 Conference: "Embedded Intelligence: Enabling and Supporting RAS Technologies" Proceedings.

[18]  Mark Coates,et al.  Bayesian graph convolutional neural networks for semi-supervised classification , 2018, AAAI.

[19]  Dacheng Tao,et al.  Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Qiang Zhang,et al.  Part-Object Relational Visual Saliency , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Saeid Minaei,et al.  Vision-based pest detection based on SVM classification method , 2017, Comput. Electron. Agric..

[22]  M. Zhang,et al.  Susceptibility and potential biochemical mechanism of Oedaleus asiaticus to beta-cypermethrin and deltamethrin in the Inner Mongolia, China. , 2016, Pesticide biochemistry and physiology.

[23]  Maureen Schmitter-Edgecombe,et al.  Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Wen-Hua Chen,et al.  An Auxiliary Particle Filtering Algorithm With Inequality Constraints , 2017, IEEE Transactions on Automatic Control.

[25]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[26]  Edward Jones,et al.  Improved image processing-based crop detection using Kalman filtering and the Hungarian algorithm , 2018, Comput. Electron. Agric..

[27]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[28]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[29]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[30]  Yang Li,et al.  Risk-based adaptive metric learning for nearest neighbour classification , 2015, Neurocomputing.

[31]  Jianlong Qiu,et al.  Synchronization criteria of delayed inertial neural networks with generally Markovian jumping , 2021, Neural Networks.

[32]  Banshidhar Majhi,et al.  Brain MR image classification using two-dimensional discrete wavelet transform and AdaBoost with random forests , 2016, Neurocomputing.

[33]  Anthony Griffin,et al.  Detecting and Counting Sheep with a Convolutional Neural Network , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[34]  Hiram Calvo,et al.  A practical framework for automatic food products classification using computer vision and inductive characterization , 2016, Neurocomputing.

[35]  Markos Avlonitis,et al.  Treating stochasticity of olive-fruit fly's outbreaks via machine learning algorithms , 2017, Neurocomputing.

[36]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Djamel Bouchaffra,et al.  Mapping Dynamic Bayesian Networks to $\alpha$-Shapes: Application to Human Faces Identification Across Ages , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Jinya Su,et al.  New Driver Workload Prediction Using Clustering-Aided Approaches , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[39]  Raul Queiroz Feitosa,et al.  Assessment of CNN-Based Methods for Individual Tree Detection on Images Captured by RGB Cameras Attached to UAVs , 2019, Sensors.

[40]  Chenglu Wen,et al.  Pose estimation-dependent identification method for field moth images using deep learning architecture , 2015 .

[41]  Jinya Su,et al.  Personalized Driver Workload Inference by Learning From Vehicle Related Measurements , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[42]  Arnold W. Schumann,et al.  Deep learning for image-based weed detection in turfgrass , 2019, European Journal of Agronomy.

[43]  Stefano Tubaro,et al.  Deep Convolutional Neural Networks for pedestrian detection , 2015, Signal Process. Image Commun..

[44]  Francisco Escolano,et al.  Entropy-Based Incremental Variational Bayes Learning of Gaussian Mixtures , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Sungho Jo,et al.  Bayesian Weight Decay on Bounded Approximation for Deep Convolutional Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.