Individual tree detection from Unmanned Aerial Vehicle (UAV) derived canopy height model in an open canopy mixed conifer forest

Advances in Unmanned Aerial Vehicle (UAV) technology and data processing capabilities have made it feasible to obtain high-resolution imagery and three dimensional (3D) data which can be used for forest monitoring and assessing tree attributes. This study evaluates the applicability of low consumer grade cameras attached to UAVs and structure-from-motion (SfM) algorithm for automatic individual tree detection (ITD) using a local-maxima based algorithm on UAV-derived Canopy Height Models (CHMs). This study was conducted in a private forest at Cache Creek located east of Jackson city, Wyoming. Based on the UAV-imagery, we allocated 30 field plots of 20 m × 20 m. For each plot, the number of trees was counted manually using the UAV-derived orthomosaic for reference. A total of 367 reference trees were counted as part of this study and the algorithm detected 312 trees resulting in an accuracy higher than 85% (F-score of 0.86). Overall, the algorithm missed 55 trees (omission errors), and falsely detected 46 trees (commission errors) resulting in a total count of 358 trees. We further determined the impact of fixed tree window sizes (FWS) and fixed smoothing window sizes (SWS) on the ITD accuracy, and detected an inverse relationship between tree density and FWS. From our results, it can be concluded that ITD can be performed with an acceptable accuracy (F > 0.80) from UAV-derived CHMs in an open canopy forest, and has the potential to supplement future research directed towards estimation of above ground biomass and stem volume from UAV-imagery.

[1]  K. Kraus,et al.  Determination of terrain models in wooded areas with airborne laser scanner data , 1998 .

[2]  Tomas Brandtberg,et al.  Automated delineation of individual tree crowns in high spatial resolution aerial images by multiple-scale analysis , 1998, Machine Vision and Applications.

[3]  K. O. Niemann,et al.  Local Maximum Filtering for the Extraction of Tree Locations and Basal Area from High Spatial Resolution Imagery , 2000 .

[4]  Peng Gong,et al.  3D Model-Based Tree Measurement from High-Resolution Aerial Imagery , 2002 .

[5]  G. Asner,et al.  Spectral unmixing of vegetation, soil and dry carbon cover in arid regions: Comparing multispectral and hyperspectral observations , 2002 .

[6]  Ronald J. Hall,et al.  Operational mapping of the land cover of the forested area of Canada with Landsat data: EOSD land cover program , 2003 .

[7]  Åsa Persson,et al.  Identifying species of individual trees using airborne laser scanner , 2004 .

[8]  P. Gong,et al.  Individual Tree-Crown Delineation and Treetop Detection in High-Spatial-Resolution Aerial Imagery , 2004 .

[9]  Xavier Descombes,et al.  Tree Crown Extraction using a Three States Markov Random Field , 2005 .

[10]  Éric Gaussier,et al.  A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation , 2005, ECIR.

[11]  P. Gong,et al.  Isolating individual trees in a savanna woodland using small footprint lidar data , 2006 .

[12]  Woo-kyun Lee,et al.  PREDICTING FOREST STAND CHARACTERISTICS WITH DETECTION OF INDIVIDUAL TREE , 2006 .

[13]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[14]  Josiane Zerubia,et al.  A Non-Bayesian Model for Tree Crown Extraction using Marked Point Processes , 2006 .

[15]  B. Koch,et al.  Detection of individual tree crowns in airborne lidar data , 2006 .

[16]  P. Gong,et al.  Detection of individual trees and estimation of tree height using LiDAR data , 2007, Journal of Forest Research.

[17]  Conghe Song,et al.  Estimating tree crown size with spatial information of high resolution optical remotely sensed imagery , 2007 .

[18]  Christian Ginzler,et al.  High‐resolution digital surface models (DSMs) for modelling fractional shrub/tree cover in a mire environment , 2008 .

[19]  Hans-Gerd Maas,et al.  Automatic forest inventory parameter determination from terrestrial laser scanner data , 2008 .

[20]  Lars T. Waser,et al.  High‐quality image matching and automated generation of 3D tree models , 2008 .

[21]  J. Dushoff,et al.  SCALING FROM TREES TO FORESTS: TRACTABLE MACROSCOPIC EQUATIONS FOR FOREST DYNAMICS , 2008 .

[22]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  J. Barlow,et al.  The cost-effectiveness of biodiversity surveys in tropical forests. , 2008, Ecology letters.

[24]  Paul E. Gessler,et al.  The influence of conifer forest canopy cover on the accuracy of two individual tree measurement algorithms using lidar data , 2008 .

[25]  Michael G. Wing,et al.  Horizontal Measurement Performance of Five Mapping-Grade Global Positioning System Receiver Configurations in Several Forested Settings , 2008 .

[26]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[27]  L. Tang,et al.  Roles of digital technology in China's sustainable forestry development , 2009 .

[28]  Camillo Ressl,et al.  Digital Photogrammetric Camera Evaluation - Generation of Di- gital Elevation Models , 2010 .

[29]  M. Maltamo,et al.  Imputation of single-tree attributes using airborne laser scanning-based height, intensity, and alpha shape metrics , 2010 .

[30]  Aníbal Ollero,et al.  Automatic Forest-Fire Measuring Using Ground Stations and Unmanned Aerial Systems , 2011, Sensors.

[31]  Geert Verhoeven,et al.  Taking computer vision aloft – archaeological three‐dimensional reconstructions from aerial photographs with photoscan , 2011 .

[32]  Morten Andreas Dahl Larsen,et al.  Comparison of six individual tree crown detection algorithms evaluated under varying forest conditions , 2011 .

[33]  C. Strecha,et al.  The Accuracy of Automatic Photogrammetric Techniques on Ultra-light UAV Imagery , 2012 .

[34]  D. Gillieson,et al.  Near-infrared imagery from unmanned aerial systems and satellites can be used to specify fertilizer application rates in tree crops , 2011 .

[35]  Fabio Remondino,et al.  UAV PHOTOGRAMMETRY FOR MAPPING AND 3D MODELING - CURRENT STATUS AND FUTURE PERSPECTIVES - , 2012 .

[36]  Salah Sukkarieh,et al.  Multi-class predictive template for tree crown detection , 2012 .

[37]  N. Strigul.  Individual-Based Models and Scaling Methods for Ecological Forestry: Implications of Tree Phenotypic Plasticity , 2012 .

[38]  S. Wich,et al.  Dawn of Drone Ecology: Low-Cost Autonomous Aerial Vehicles for Conservation , 2012 .

[39]  Jörgen Wallerman,et al.  Forest height estimation using semi-individual tree detection in multi-spectral 3D aerial DMC data , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[40]  S. Robson,et al.  Straightforward reconstruction of 3D surfaces and topography with a camera: Accuracy and geoscience application , 2012 .

[41]  Stephan Getzin,et al.  Assessing biodiversity in forests using very high‐resolution images and unmanned aerial vehicles , 2012 .

[42]  Aníbal Ollero,et al.  Journal of Intelligent & Robotic Systems manuscript No. (will be inserted by the editor) An Unmanned Aircraft System for Automatic Forest Fire Monitoring and Measurement , 2022 .

[43]  Maggi Kelly,et al.  A New Method for Segmenting Individual Trees from the Lidar Point Cloud , 2012 .

[44]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[45]  Markus Hollaus,et al.  Comparison of Methods for Estimation of Stem Volume, Stem Number and Basal Area from Airborne Laser Scanning Data in a Hemi-Boreal Forest , 2012, Remote. Sens..

[46]  Juha Hyyppä,et al.  Automatic Stem Mapping Using Single-Scan Terrestrial Laser Scanning , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Juha Hyyppä,et al.  Automatic Stem Mapping by Merging Several Terrestrial Laser Scans at the Feature and Decision Levels , 2013, Sensors.

[48]  C. Justice,et al.  High-Resolution Global Maps of 21st-Century Forest Cover Change , 2013, Science.

[49]  Joanne C. White,et al.  The Utility of Image-Based Point Clouds for Forest Inventory: A Comparison with Airborne Laser Scanning , 2013 .

[50]  Erle C. Ellis,et al.  High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision , 2013 .

[51]  M. Pierrot-Deseilligny,et al.  A Photogrammetric Workflow for the Creation of a Forest Canopy Height Model from Small Unmanned Aerial System Imagery , 2013 .

[52]  J. Zerubia,et al.  Mapping local density of young Eucalyptus plantations by individual tree detection in high spatial resolution satellite images , 2013 .

[53]  B. Koch,et al.  UAV-BASED PHOTOGRAMMETRIC POINT CLOUDS – TREE STEM MAPPING IN OPEN STANDS IN COMPARISON TO TERRESTRIAL LASER SCANNER POINT CLOUDS , 2013 .

[54]  Barbara Koch,et al.  Potential of Unmanned Aerial Vehicle Based Photogrammetric Point Clouds for Automatic Single Tree Detection , 2014 .

[55]  AstrupRasmus,et al.  Approaches for estimating stand-level volume using terrestrial laser scanning in a single-scan mode , 2014 .

[56]  Barbara Koch,et al.  Automatic Single Tree Detection in Plantations using UAV-based Photogrammetric Point clouds , 2014 .

[57]  Arko Lucieer,et al.  Direct Georeferencing of Ultrahigh-Resolution UAV Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Pablo J. Zarco-Tejada,et al.  A Novel Methodology to Estimate Single-Tree Biophysical Parameters from 3D Digital Imagery Compared to Aerial Laser Scanner Data , 2014, Remote. Sens..

[59]  Lian Pin Koh,et al.  Small Drones for Community-Based Forest Monitoring: An Assessment of Their Feasibility and Potential in Tropical Areas , 2014 .

[60]  Ali Azadeh,et al.  Artificial immune simulation for improved forecasting of electricity consumption with random variations , 2014 .

[61]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[62]  WhiteheadKen,et al.  Remote sensing of the environment with small unmanned aircraft systems (UASs), part 1: a review of progress and challenges1 , 2014 .

[63]  Arko Lucieer,et al.  Detecting pruning of individual stems using Airborne Laser Scanning data captured from an Unmanned Aerial Vehicle , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[64]  Sharon A. Robinson,et al.  Using an Unmanned Aerial Vehicle (UAV) to capture micro-topography of Antarctic moss beds , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[65]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[66]  Arko Lucieer,et al.  Evaluating Tree Detection and Segmentation Routines on Very High Resolution UAV LiDAR Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Andrew Bevan,et al.  A comparative assessment of structure from motion methods for archaeological research , 2014 .

[68]  S. Robson,et al.  Mitigating systematic error in topographic models derived from UAV and ground‐based image networks , 2014 .

[69]  J. Théau,et al.  Recent applications of unmanned aerial imagery in natural resource management , 2014 .

[70]  Nicholas L. Crookston,et al.  Imputing Forest Structure Attributes from Stand Inventory and Remotely Sensed Data in Western Oregon, USA , 2014 .

[71]  Marc Olano,et al.  Optimal Altitude, Overlap, and Weather Conditions for Computer Vision UAV Estimates of Forest Structure , 2015, Remote. Sens..

[72]  C. Bettigole,et al.  Mapping tree density at a global scale , 2015, Nature.

[73]  Tetsuji Ota,et al.  Aboveground Biomass Estimation Using Structure from Motion Approach with Aerial Photographs in a Seasonal Tropical Forest , 2015 .

[74]  Joanne C. White,et al.  Comparing ALS and Image-Based Point Cloud Metrics and Modelled Forest Inventory Attributes in a Complex Coastal Forest Environment , 2015 .

[75]  Richard E. Brazier,et al.  Aerial photography collected with a multirotor drone reveals impact of Eurasian beaver reintroduction on ecosystem structure1 , 2015 .

[76]  Terje Gobakken,et al.  Inventory of Small Forest Areas Using an Unmanned Aerial System , 2015, Remote. Sens..

[77]  Markus Hollaus,et al.  A Benchmark of Lidar-Based Single Tree Detection Methods Using Heterogeneous Forest Data from the Alpine Space , 2015 .

[78]  Jorge Torres-Sánchez,et al.  High-Throughput 3-D Monitoring of Agricultural-Tree Plantations with Unmanned Aerial Vehicle (UAV) Technology , 2015, PloS one.

[79]  Hien Phu La,et al.  Extraction of individual tree crown using hyperspectral image and LiDAR data , 2015 .

[80]  Park,et al.  Calculation of Tree Height and Canopy Crown from Drone Images Using Segmentation , 2015 .

[81]  Nikolay S. Strigul,et al.  3D Tree Dimensionality Assessment Using Photogrammetry and Small Unmanned Aerial Vehicles , 2015, PloS one.

[82]  L. Tang,et al.  Drone remote sensing for forestry research and practices , 2015, Journal of Forestry Research.

[83]  Terje Gobakken,et al.  Modeling Aboveground Biomass in Dense Tropical Submontane Rainforest Using Airborne Laser Scanner Data , 2015, Remote. Sens..

[84]  Yunjun Yao,et al.  Use of UAV oblique imaging for the detection of individual trees in residential environments , 2015 .

[85]  D. Pitt,et al.  A Comparison of Airborne Laser Scanning and Image Point Cloud Derived Tree Size Class Distribution Models in Boreal Ontario , 2015 .

[86]  Christian Mielke,et al.  Assessment of Red-Edge Position Extraction Techniques: A Case Study for Norway Spruce Forests Using HyMap and Simulated Sentinel-2 Data , 2016 .

[87]  Joshua B. Fisher,et al.  An Individual Tree-Based Automated Registration of Aerial Images to Lidar Data in a Forested Area , 2016 .

[88]  L. M. Moskal,et al.  Object-Based Tree Species Classification in Urban Ecosystems Using LiDAR and Hyperspectral Data , 2016 .

[89]  P. Jat,et al.  Bayesian Maximum Entropy space/time estimation of surface water chloride in Maryland using river distances. , 2016, Environmental pollution.

[90]  Shelley A. Hinsley,et al.  Comparison of small-footprint discrete return and full waveform airborne lidar data for estimating multiple forest variables , 2016 .

[91]  K. Harnish,et al.  Valuation and production possibilities on a working forest using multi-objective programming, Woodstock, timber NPV, and carbon storage and sequestration , 2016 .

[92]  Jian Zhang,et al.  Seeing the forest from drones: Testing the potential of lightweight drones as a tool for long-term forest monitoring , 2016 .

[93]  Remote Sensing: Past and Present , 2016 .

[94]  C. Silva,et al.  Imputation of Individual Longleaf Pine (Pinus palustris Mill.) Tree Attributes from Field and LiDAR Data , 2016 .

[95]  M. Detto,et al.  Drones as a Tool for Monoculture Plantation Assessment in the Steepland Tropics , 2017 .

[96]  Aaron N. Johnston,et al.  High‐resolution habitat modeling with airborne LiDAR for red tree voles , 2017 .

[97]  I. Woodhouse,et al.  Structure from Motion (SfM) Photogrammetry with Drone Data: A Low Cost Method for Monitoring Greenhouse Gas Emissions from Forests in Developing Countries , 2017 .

[98]  U. Avdan,et al.  Estimating tree heights with images from an unmanned aerial vehicle , 2017 .

[99]  M. Mokroš,et al.  Accuracy of Photogrammetric UAV-Based Point Clouds under Conditions of Partially-Open Forest Canopy , 2017 .

[100]  Juha Hyyppä,et al.  Individual Tree Detection and Classification with UAV-Based Photogrammetric Point Clouds and Hyperspectral Imaging , 2017, Remote. Sens..

[101]  Friedrich Leisch,et al.  Automatic Mapping of Forest Stands Based on Three-Dimensional Point Clouds Derived from Terrestrial Laser-Scanning , 2017 .

[102]  Wan Shafrina Wan Mohd Jaafar,et al.  Predicting stem total and assortment volumes in an industrial Pinus taeda L. forest plantation using airborne laser scanning data and random forest , 2017 .

[103]  Reiner Zimmermann,et al.  Measurement of Within-Season Tree Height Growth in a Mixed Forest Stand Using UAV Imagery , 2017 .

[104]  P. Surový,et al.  Determining tree height and crown diameter from high-resolution UAV imagery , 2017 .

[105]  Terje Gobakken,et al.  Assessing 3D point clouds from aerial photographs for species-specific forest inventories , 2017 .

[106]  Bernd Hamann,et al.  Multi-scale visual analysis of time-varying electrocorticography data via clustering of brain regions , 2017, BMC Bioinformatics.

[107]  D 4 AR – A 4-DIMENSIONAL AUGMENTED REALITY MODEL FOR AUTOMATING CONSTRUCTION PROGRESS MONITORING DATA COLLECTION , PROCESSING AND COMMUNICATION , 2022 .