Multi-Scale Proposal Regions Fusion Network for Detection and 3D Localization of the Infected Trees

Forest surveillance towers have the advantages of long observation time, wide observation range, stable and real-time observation. In this paper, a multi-scale proposal regions fusion network (MFRPN) is proposed for detecting the infected trees automatically on the enhanced images from the forest surveillance towers, which can solve the problem that small and large targets can’t be effectively detected on a single scale. The proposed MFRPN includes multi-scale images, three CNNs, three different RPNs, and proposal regions fusion model. In the proposed method, we train and run the scale-specific detectors in a multi-task fashion. And, to obtain the accurate spatial level location information of the infected trees, we achieve the three-dimensional (3D) coordinates localization of the digital elevation model (DEM) by using the principle of forest surveillance towers imaging and terrain elevation data. The experimental results show the detection accuracy achieves 91.63%, the detection time of a single image is 0.46 second, and the 3D localization error is less than 50m. The proposed network can realize the real-time detection and 3D localization of the infected trees.

[1]  Cunjun Li,et al.  Deep learning-based dead pine tree detection from unmanned aerial vehicle images , 2020 .

[2]  H. Robbins A Stochastic Approximation Method , 1951 .

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Marco Heurich,et al.  DETECTION OF SINGLE STANDING DEAD TREES FROM AERIAL COLOR INFRARED IMAGERY BY SEGMENTATION WITH SHAPE AND INTENSITY PRIORS , 2015 .

[5]  Lloyd Windrim,et al.  Tree Detection and Health Monitoring in Multispectral Aerial Imagery and Photogrammetric Pointclouds Using Machine Learning , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Francisco Herrera,et al.  Detection of Fir Trees (Abies sibirica) Damaged by the Bark Beetle in Unmanned Aerial Vehicle Images with Deep Learning , 2019, Remote. Sens..

[7]  Mutiara Syifa,et al.  Detection of the Pine Wilt Disease Tree Candidates for Drone Remote Sensing Using Artificial Intelligence Techniques , 2020 .

[8]  Marian-Daniel Iordache,et al.  A Machine Learning Approach to Detecting Pine Wilt Disease Using Airborne Spectral Imagery , 2020, Remote. Sens..

[9]  Kyunghyun Cho,et al.  Augmentation for small object detection , 2019, 9th International Conference on Advances in Computing and Information Technology (ACITY 2019).

[10]  O. Kulinich,et al.  Pine wilt disease: a short review of worldwide research , 2011 .

[11]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[14]  Zhenhong Li,et al.  Research Progress of Global High Resolution Digital Elevation Models 全球高分辨率数字高程模型研究进展与展望 , 2018 .