Assessment of Tree Detection Methods in Multispectral Aerial Images

Detecting individual trees and quantifying their biomass is crucial for carbon accounting procedures at the stand, landscape, and national levels. A significant challenge for many organizations is the amount of effort necessary to document carbon storage levels, especially in terms of human labor. To advance towards the goal of efficiently assessing the carbon content of forest, we evaluate methods to detect trees from high-resolution images taken from unoccupied aerial systems (UAS). In the process, we introduce the Digital Elevated Vegetation Model (DEVM), a representation that combines multispectral images, digital surface models, and digital terrain models. We show that the DEVM facilitates the development of refined synthetic data to detect individual trees using deep learning-based approaches. We carried out experiments in two tree fields located in different countries. Simultaneously, we perform comparisons among an array of classical and deep learning-based methods highlighting the precision and reliability of the DEVM.

[1]  Yinghai Ke,et al.  A review of methods for automatic individual tree-crown detection and delineation from passive remote sensing , 2011 .

[2]  Linhai Jing,et al.  A New Individual Tree Crown Delineation Method for High Resolution Multispectral Imagery , 2020, Remote. Sens..

[3]  Zhang Jian,et al.  Single-Tree Detection in High-Resolution Remote-Sensing Images Based on a Cascade Neural Network , 2018, ISPRS Int. J. Geo Inf..

[4]  Uwe Rascher,et al.  Multi-Scale Evaluation of Drone-Based Multispectral Surface Reflectance and Vegetation Indices in Operational Conditions , 2020, Remote. Sens..

[5]  Markus Immitzer,et al.  Estimating stand density, biomass and tree species from very high resolution stereo-imagery- towards an all-in-one sensor for forestry applications? , 2017 .

[6]  Julia Armesto,et al.  Individual Tree Detection in a Eucalyptus Plantation Using Unmanned Aerial Vehicle (UAV)-LiDAR , 2020, Remote. Sens..

[7]  Vijay Kumar,et al.  Counting Apples and Oranges With Deep Learning: A Data-Driven Approach , 2017, IEEE Robotics and Automation Letters.

[8]  Hui Lin,et al.  An automatic extraction method for individual tree crowns based on self-adaptive mutual information and tile computing , 2015, Int. J. Digit. Earth.

[9]  T. Carlson,et al.  On the relation between NDVI, fractional vegetation cover, and leaf area index , 1997 .

[10]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Hans Pretzsch,et al.  The single tree-based stand simulator SILVA: construction, application and evaluation , 2002 .

[12]  Rongjun Qin,et al.  Individual Tree Detection and Crown Delineation with 3D Information from Multi-view Satellite Images , 2019, Photogrammetric Engineering & Remote Sensing.

[13]  John P. Kerekes,et al.  Overview of Passive Optical Multispectral and Hyperspectral Image Simulation Techniques , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  B. Wylie,et al.  NDVI saturation adjustment: A new approach for improving cropland performance estimates in the Greater Platte River Basin, USA , 2013 .

[15]  Weijia Li,et al.  Deep Learning Based Oil Palm Tree Detection and Counting for High-Resolution Remote Sensing Images , 2016, Remote. Sens..

[16]  Przemyslaw Prusinkiewicz,et al.  The use of plant models in deep learning: an application to leaf counting in rosette plants , 2018, Plant Methods.

[17]  Mohammad Sadegh Taskhiri,et al.  Enhancing Methods for Under-Canopy Unmanned Aircraft System Based Photogrammetry in Complex Forests for Tree Diameter Measurement , 2020, Remote. Sens..

[18]  Yingfeng Cai,et al.  A Comparative Study of State-of-the-Art Deep Learning Algorithms for Vehicle Detection , 2019, IEEE Intelligent Transportation Systems Magazine.

[19]  Douglas J. King,et al.  Automated tree crown detection and delineation in high-resolution digital camera imagery of coniferous forest regeneration , 2002 .

[20]  Maggi Kelly,et al.  Identification of Citrus Trees from Unmanned Aerial Vehicle Imagery Using Convolutional Neural Networks , 2018, Drones.

[21]  A. de Vicente,et al.  Detection of White Root Rot in Avocado Trees by Remote Sensing. , 2019, Plant disease.

[22]  Qiming Qin,et al.  A novel dynamic stretching solution to eliminate saturation effect in NDVI and its application in drought monitoring , 2012, Chinese Geographical Science.

[23]  Helmi Zulhaidi Mohd Shafri,et al.  Young and mature oil palm tree detection and counting using convolutional neural network deep learning method , 2019, International Journal of Remote Sensing.

[24]  Asli Ozdarici-Ok,et al.  Automatic detection and delineation of citrus trees from VHR satellite imagery , 2015 .

[25]  F. Hartig,et al.  Using synthetic data to evaluate the benefits of large field plots for forest biomass estimation with LiDAR , 2018, Remote Sensing of Environment.

[26]  Xu Huang,et al.  A STUDY OF USING FULLY CONVOLUTIONAL NETWORK FOR TREETOP DETECTION ON REMOTE SENSING DATA , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[27]  Germán Castellanos-Domínguez,et al.  Individual Detection of Citrus and Avocado Trees Using Extended Maxima Transform Summation on Digital Surface Models , 2020, Remote. Sens..

[28]  Maoguo Gong,et al.  Automatic Tobacco Plant Detection in UAV Images via Deep Neural Networks , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[30]  Florentin Wörgötter,et al.  Large Scale Palm Tree Detection in High Resolution Satellite Images Using U-Net , 2019, Remote. Sens..

[31]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[32]  Stefan W. Maier,et al.  Efficiency of Individual Tree Detection Approaches Based on Light-Weight and Low-Cost UAS Imagery in Australian Savannas , 2018, Remote. Sens..

[33]  Weijia Li,et al.  Large-Scale Oil Palm Tree Detection from High-Resolution Satellite Images Using Two-Stage Convolutional Neural Networks , 2018, Remote. Sens..

[34]  Wayne Luk,et al.  A Real-Time Tree Crown Detection Approach for Large-Scale Remote Sensing Images on FPGAs , 2019, Remote. Sens..

[35]  Josef Kittler,et al.  Automatic watershed segmentation of randomly textured color images , 1997, IEEE Trans. Image Process..

[36]  Haiyan Guan,et al.  A self-adaptive mean shift tree-segmentation method Using UAV LiDAR data , 2020, Remote. Sens..

[37]  Xiaolin Zhu,et al.  Automatic detection of individual oil palm trees from UAV images using HOG features and an SVM classifier , 2018, International Journal of Remote Sensing.

[38]  Raul Queiroz Feitosa,et al.  Assessment of CNN-Based Methods for Individual Tree Detection on Images Captured by RGB Cameras Attached to UAVs , 2019, Sensors.

[39]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[40]  Jakob J. Assmann,et al.  Illumination Geometry and Flying Height Influence Surface Reflectance and NDVI Derived from Multispectral UAS Imagery , 2019, Drones.

[41]  Ronen Basri,et al.  A Survey on Structure from Motion , 2017, ArXiv.

[42]  Dilek Koc-San,et al.  Automatic citrus tree extraction from UAV images and digital surface models using circular Hough transform , 2018, Comput. Electron. Agric..

[43]  Matthias Schubert,et al.  Automated Detection of Conifer Seedlings in Drone Imagery Using Convolutional Neural Networks , 2019, Remote. Sens..

[44]  Philippe Maillard,et al.  Detection of Tree Crowns in Very High Spatial Resolution Images , 2016 .

[45]  Cem Ünsalan,et al.  Tree crown detection and delineation in satellite images using probabilistic voting , 2017 .

[46]  Serdar Selim,et al.  Semi-automatic Tree Detection from Images of Unmanned Aerial Vehicle Using Object-Based Image Analysis Method , 2018, Journal of the Indian Society of Remote Sensing.

[47]  Yongjun Zhang,et al.  A Two-Step Semiglobal Filtering Approach to Extract DTM From Middle Resolution DSM , 2017, IEEE Geoscience and Remote Sensing Letters.

[48]  S LewMichael,et al.  Deep learning for visual understanding , 2016 .

[49]  Arnt-Børre Salberg,et al.  Tree species classification in Norway from airborne hyperspectral and airborne laser scanning data , 2018 .

[50]  Sergio Marconi,et al.  Individual Tree-Crown Detection in RGB Imagery Using Semi-Supervised Deep Learning Neural Networks , 2019, Remote. Sens..