Citrus Tree Segmentation from UAV Images Based on Monocular Machine Vision in a Natural Orchard Environment

The segmentation of citrus trees in a natural orchard environment is a key technology for achieving the fully autonomous operation of agricultural unmanned aerial vehicles (UAVs). Therefore, a tree segmentation method based on monocular machine vision technology and a support vector machine (SVM) algorithm are proposed in this paper to segment citrus trees precisely under different brightness and weed coverage conditions. To reduce the sensitivity to environmental brightness, a selective illumination histogram equalization method was developed to compensate for the illumination, thereby improving the brightness contrast for the foreground without changing its hue and saturation. To accurately differentiate fruit trees from different weed coverage backgrounds, a chromatic aberration segmentation algorithm and the Otsu threshold method were combined to extract potential fruit tree regions. Then, 14 color features, five statistical texture features, and local binary pattern features of those regions were calculated to establish an SVM segmentation model. The proposed method was verified on a dataset with different brightness and weed coverage conditions, and the results show that the citrus tree segmentation accuracy reached 85.27% ± 9.43%; thus, the proposed method achieved better performance than two similar methods.

[1]  Jorge Torres-Sánchez,et al.  Mapping the 3D structure of almond trees using UAV acquired photogrammetric point clouds and object-based image analysis , 2018, Biosystems Engineering.

[2]  YangQuan Chen,et al.  Comparing U-Net convolutional network with mask R-CNN in the performances of pomegranate tree canopy segmentation , 2018, Asia-Pacific Remote Sensing.

[3]  Yangzi Cong,et al.  3D Forest Mapping Using A Low-Cost UAV Laser Scanning System: Investigation and Comparison , 2019, Remote. Sens..

[4]  Yong He,et al.  Computer vision-based localisation of picking points for automatic litchi harvesting applications towards natural scenarios , 2019, Biosystems Engineering.

[5]  Xin-Yu Xue,et al.  Droplet deposition and control effect of insecticides sprayed with an unmanned aerial vehicle against plant hoppers , 2016 .

[6]  Q. Guo,et al.  An integrated UAV-borne lidar system for 3D habitat mapping in three forest ecosystems across China , 2017 .

[7]  Victor M. Becerra,et al.  Autonomous Control of Unmanned Aerial Vehicles , 2019, Electronics.

[8]  Ahmad Kamal Nasir,et al.  Precision Forestry: Trees Counting in Urban Areas Using Visible Imagery based on an Unmanned Aerial Vehicle , 2016 .

[9]  Dilek Koc-San,et al.  Automatic citrus tree extraction from UAV images and digital surface models using circular Hough transform , 2018, Comput. Electron. Agric..

[10]  G. Castilla,et al.  Detection of Coniferous Seedlings in UAV Imagery , 2018, Forests.

[11]  Emanuel Peres,et al.  UAV-Based Automatic Detection and Monitoring of Chestnut Trees , 2019, Remote. Sens..

[12]  Ming Zhu,et al.  An Improved Multi-scale Retinex Fog and Haze Image Enhancement Method , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[13]  J. M. Molina-Martínez,et al.  An Automatic Non-Destructive Method for the Classification of the Ripeness Stage of Red Delicious Apples in Orchards Using Aerial Video , 2019, Agronomy.

[14]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[15]  Matthew Bardeen,et al.  Detection and Segmentation of Vine Canopy in Ultra-High Spatial Resolution RGB Imagery Obtained from Unmanned Aerial Vehicle (UAV): A Case Study in a Commercial Vineyard , 2017, Remote. Sens..

[16]  Andréa Britto Mattos,et al.  Automatic Citrus Tree Detection from UAV Images based on Convolutional Neural Networks , 2018 .

[17]  C. Blaix,et al.  Quantification of regulating ecosystem services provided by weeds in annual cropping systems using a systematic map approach , 2018 .

[18]  Lee-Sup Kim,et al.  An advanced contrast enhancement using partially overlapped sub-block histogram equalization , 2001, IEEE Trans. Circuits Syst. Video Technol..

[19]  Zhenyu Zhong,et al.  Lychee Fruit Detection Based on Monocular Machine Vision in Orchard Environment , 2019, Sensors.

[20]  Eija Honkavaara,et al.  Estimating Biomass and Nitrogen Amount of Barley and Grass Using UAV and Aircraft Based Spectral and Photogrammetric 3D Features , 2018, Remote. Sens..

[21]  Bazila Bashir,et al.  Tree Crown Detection, Delineation and Counting in UAV Remote Sensed Images: A Neural Network Based Spectral–Spatial Method , 2018, Journal of the Indian Society of Remote Sensing.

[22]  Yunjun Yao,et al.  Use of UAV oblique imaging for the detection of individual trees in residential environments , 2015 .

[23]  Xiaoming Li,et al.  Corn Classification System based on Computer Vision , 2019, Symmetry.

[24]  Cyrill Stachniss,et al.  UAV-based crop and weed classification for smart farming , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Junjiang Xiong,et al.  Tear Resistance of Orthogonal Kevlar-PWF-reinforced TPU Film , 2011 .

[26]  F. Baret,et al.  Estimation of Wheat Plant Density at Early Stages Using High Resolution Imagery , 2017, Front. Plant Sci..

[27]  Eduardo González-Ferreiro,et al.  Short Communication. Using high resolution UAV imagery to estimate tree variables in Pinus pinea plantation in Portugal , 2016 .

[28]  Ma Yanyan,et al.  Rapid detection of chlorophyll content and distribution in citrus orchards based on low-altitude remote sensing and bio-sensors , 2018 .

[29]  Maggi Kelly,et al.  Identification of Citrus Trees from Unmanned Aerial Vehicle Imagery Using Convolutional Neural Networks , 2018, Drones.

[30]  Matthew F. McCabe,et al.  Using Multi-Spectral UAV Imagery to Extract Tree Crop Structural Properties and Assess Pruning Effects , 2018, Remote. Sens..

[31]  Yeong-Ho Ha,et al.  Real-time multi-scale Retinex to enhance night scene of vehicular camera , 2011, 2011 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[32]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[34]  Preesan Rakwatin,et al.  Oil Palm Tree Detection with High Resolution Multi-Spectral Satellite Imagery , 2014, Remote. Sens..

[35]  S. H. Shah Newaz,et al.  Design and development of an autonomous agricultural drone for sowing seeds , 2018 .

[36]  Seth C. Murray,et al.  Multitemporal field-based plant height estimation using 3D point clouds generated from small unmanned aerial systems high-resolution imagery , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[37]  George C. Zalidis,et al.  An autonomous multi-sensor UAV system for reduced-input precision agriculture applications , 2016, 2016 24th Mediterranean Conference on Control and Automation (MED).

[38]  F. Baret,et al.  Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery. , 2017 .

[39]  Nan Yang,et al.  A Multi-View Dense Point Cloud Generation Algorithm Based on Low-Altitude Remote Sensing Images , 2016, Remote. Sens..

[40]  Han Li,et al.  An Improved Multi-Scale Retinex Algorithm for Vehicle Shadow Elimination Based on Variational Kimmel , 2010, 2010 7th International Conference on Ubiquitous Intelligence & Computing and 7th International Conference on Autonomic & Trusted Computing.

[41]  Xin Shen,et al.  Assessment of Individual Tree Detection and Canopy Cover Estimation using Unmanned Aerial Vehicle based Light Detection and Ranging (UAV-LiDAR) Data in Planted Forests , 2019, Remote. Sens..

[42]  M.Y. Nam,et al.  An efficient face recognition for variant illumination condition , 2004, Proceedings of 2004 International Symposium on Intelligent Signal Processing and Communication Systems, 2004. ISPACS 2004..

[43]  Zhang Yi,et al.  A Fractional-Order Variational Framework for Retinex: Fractional-Order Partial Differential Equation-Based Formulation for Multi-Scale Nonlocal Contrast Enhancement with Texture Preserving , 2018, IEEE Transactions on Image Processing.

[44]  Yu Tang,et al.  Effects of operation height and tree shape on droplet deposition in citrus trees using an unmanned aerial vehicle , 2018, Comput. Electron. Agric..

[45]  Nor Ashidi Mat Isa,et al.  Exposure Based Multi-Histogram Equalization Contrast Enhancement for Non-Uniform Illumination Images , 2019, IEEE Access.