Deep Learning-Based Instance Segmentation Method of Litchi Canopy from UAV-Acquired Images

Instance segmentation of fruit tree canopies from images acquired by unmanned aerial vehicles (UAVs) is of significance for the precise management of orchards. Although deep learning methods have been widely used in the fields of feature extraction and classification, there are still phenomena of complex data and strong dependence on software performances. This paper proposes a deep learning-based instance segmentation method of litchi trees, which has a simple structure and lower requirements for data form. Considering that deep learning models require a large amount of training data, a labor-friendly semi-auto method for image annotation is introduced. The introduction of this method allows for a significant improvement in the efficiency of data pre-processing. Facing the high requirement of a deep learning method for computing resources, a partition-based method is presented for the segmentation of high-resolution digital orthophoto maps (DOMs). Citrus data is added to the training set to alleviate the lack of diversity of the original litchi dataset. The average precision (AP) is selected to evaluate the metric of the proposed model. The results show that with the help of training with the litchi-citrus datasets, the best AP on the test set reaches 96.25%.

[1]  Yiannis Ampatzidis,et al.  UAV-Based High Throughput Phenotyping in Citrus Utilizing Multispectral Imaging and Artificial Intelligence , 2019, Remote. Sens..

[2]  Suha Berberoglu,et al.  Computer vision-based citrus tree detection in a cultivated environment using UAV imagery , 2021, Comput. Electron. Agric..

[3]  A. M. Hafiz,et al.  A survey on instance segmentation: state of the art , 2020, International Journal of Multimedia Information Retrieval.

[4]  Danielle Elis Garcia Furuya,et al.  Semantic segmentation of citrus-orchard using deep neural networks and multispectral UAV-based imagery , 2021, Precision Agriculture.

[5]  Nilton Nobuhiro Imai,et al.  A convolutional neural network approach for counting and geolocating citrus-trees in UAV multispectral imagery , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[6]  Emanuel Peres,et al.  UAV-Based Automatic Detection and Monitoring of Chestnut Trees , 2019, Remote. Sens..

[7]  Yong Xu,et al.  Applications of deep-learning approaches in horticultural research: a review , 2021, Horticulture Research.

[8]  Lan Yubin,et al.  Detection and Location of Dead Trees with Pine Wilt Disease Based on Deep Learning and UAV Remote Sensing , 2020, AgriEngineering.

[9]  D. Mulla.  Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps , 2013 .

[10]  Xinyu Dong,et al.  Extraction of Information about Individual Trees from High-Spatial-Resolution UAV-Acquired Images of an Orchard , 2020, Remote. Sens..

[11]  Stefan Hinz,et al.  Review on Convolutional Neural Networks (CNN) in vegetation remote sensing , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Jagannath Aryal,et al.  Mapping Urban Tree Cover Changes Using Object-Based Convolution Neural Network (OB-CNN) , 2020, Remote. Sens..

[13]  M. Onishi,et al.  Explainable identification and mapping of trees using UAV RGB image and deep learning , 2021, Scientific Reports.

[14]  Adam Van Etten,et al.  You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery , 2018, ArXiv.

[15]  José Marcato Junior,et al.  Benchmarking Anchor-Based and Anchor-Free State-of-the-Art Deep Learning Methods for Individual Tree Detection in RGB High-Resolution Images , 2021, Remote. Sens..

[16]  C. Daughtry,et al.  What good are unmanned aircraft systems for agricultural remote sensing and precision agriculture? , 2018 .

[17]  Guillermo Kemper,et al.  Automatic Segmentation of Mauritia flexuosa in Unmanned Aerial Vehicle (UAV) Imagery Using Deep Learning , 2018, Forests.

[18]  Maggi Kelly,et al.  Identification of Citrus Trees from Unmanned Aerial Vehicle Imagery Using Convolutional Neural Networks , 2018, Drones.

[19]  Yong He,et al.  Citrus Tree Segmentation from UAV Images Based on Monocular Machine Vision in a Natural Orchard Environment , 2019, Sensors.

[20]  Helmi Zulhaidi Mohd Shafri,et al.  Young and mature oil palm tree detection and counting using convolutional neural network deep learning method , 2019, International Journal of Remote Sensing.

[21]  Giuseppe Modica,et al.  Monitoring the vegetation vigor in heterogeneous citrus and olive orchards. A multiscale object-based approach to extract trees' crowns from UAV multispectral imagery , 2020, Comput. Electron. Agric..