Sensor Agnostic Semantic Segmentation of Structurally Diverse and Complex Forest Point Clouds Using Deep Learning

Forest inventories play an important role in enabling informed decisions to be made for the management and conservation of forest resources; however, the process of collecting inventory information is laborious. Despite advancements in mapping technologies allowing forests to be digitized in finer granularity than ever before, it is still common for forest measurements to be collected using simple tools such as calipers, measuring tapes, and hypsometers. Dense understory vegetation and complex forest structures can present substantial challenges to point cloud processing tools, often leading to erroneous measurements, and making them of less utility in complex forests. To address this challenge, this research demonstrates an effective deep learning approach for semantically segmenting high-resolution forest point clouds from multiple different sensing systems in diverse forest conditions. Seven diverse point cloud datasets were manually segmented to train and evaluate this model, resulting in per-class segmentation accuracies of Terrain: 95.92%, Vegetation: 96.02%, Coarse Woody Debris: 54.98%, and Stem: 96.09%. By exploiting the segmented point cloud, we also present a method of extracting a Digital Terrain Model (DTM) from such segmented point clouds. This approach was applied to a set of six point clouds that were made publicly available as part of a benchmarking study to evaluate the DTM performance. The mean DTM error was 0.04 m relative to the reference with 99.9% completeness. These approaches serve as useful steps toward a fully automated and reliable measurement extraction tool, agnostic to the sensing technology used or the complexity of the forest, provided that the point cloud has sufficient coverage and accuracy. Ongoing work will see these models incorporated into a fully automated forest measurement tool for the extraction of structural metrics for applications in forestry, conservation, and research.

[1]  F. Hall,et al.  Importance of structure and its measurement in quantifying function of forest ecosystems , 2010 .

[2]  Xinlian Liang,et al.  Evaluation of Close-Range Photogrammetry Image Collection Methods for Estimating Tree Diameters , 2018, ISPRS Int. J. Geo Inf..

[3]  E. Casella,et al.  LeWoS: A universal leaf‐wood classification method to facilitate the 3D modelling of large tropical trees using terrestrial LiDAR , 2020, Methods in Ecology and Evolution.

[4]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[5]  Xiangguo Lin,et al.  Classification of ALS Point Cloud with Improved Point Cloud Segmentation and Random Forests , 2017, Remote. Sens..

[6]  Di Wang,et al.  Unsupervised semantic and instance segmentation of forest point clouds , 2020 .

[7]  Roland Siegwart,et al.  Automatic Segmentation of Tree Structure From Point Cloud Data , 2018, IEEE Robotics and Automation Letters.

[8]  Norbert Pfeifer,et al.  International benchmarking of terrestrial laser scanning approaches for forest inventories , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[9]  M. Herold,et al.  Nondestructive estimates of above‐ground biomass using terrestrial laser scanning , 2015 .

[10]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[11]  Lloyd Windrim,et al.  Detection, Segmentation, and Model Fitting of Individual Tree Stems from Airborne Laser Scanning of Forests Using Deep Learning , 2020, Remote. Sens..

[12]  Phillip B. Gibbons,et al.  Forest and woodland stand structural complexity: Its definition and measurement , 2005 .

[13]  Luiz Carlos Estraviz Rodriguez,et al.  Performance of stem denoising and stem modelling algorithms on single tree point clouds from terrestrial laser scanning , 2017, Comput. Electron. Agric..

[14]  A. Fernández-Landa,et al.  Mapping fire risk in the Model Forest of Urbión (Spain) based on airborne LiDAR measurements , 2012 .

[15]  Daniel J. Hayes,et al.  The Use of Three-Dimensional Convolutional Neural Networks to Interpret LiDAR for Forest Inventory , 2018, Remote. Sens..

[16]  Takashi Kanai,et al.  Segmentation of unbalanced and in-homogeneous point clouds and its application to 3D scanned trees , 2020, Vis. Comput..

[17]  Yanjun Su,et al.  A Point-Based Fully Convolutional Neural Network for Airborne LiDAR Ground Point Filtering in Forested Environments , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Laura S. Kenefic,et al.  Layer Stacking: A Novel Algorithm for Individual Forest Tree Segmentation from LiDAR Point Clouds , 2017 .

[19]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[20]  P. Gibbons,et al.  An objective and quantitative methodology for constructing an index of stand structural complexity , 2006 .

[21]  Mohammad Sadegh Taskhiri,et al.  Enhancing Methods for Under-Canopy Unmanned Aircraft System Based Photogrammetry in Complex Forests for Tree Diameter Measurement , 2020, Remote. Sens..

[22]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Mathias Disney,et al.  Extracting individual trees from lidar point clouds using treeseg , 2018, Methods in Ecology and Evolution.

[24]  P. Raumonen,et al.  Massive-Scale Tree Modelling from Tls Data , 2015 .

[25]  Albert I. J. M. van Dijk,et al.  Deriving comprehensive forest structure information from mobile laser scanning observations using automated point cloud classification , 2016, Environ. Model. Softw..

[26]  Sruthi M. Krishna Moorthy,et al.  Terrestrial laser scanning in forest ecology: Expanding the horizon , 2020 .

[27]  Di Wang,et al.  Terrestrial Structure from Motion Photogrammetry for Deriving Forest Inventory Data , 2019, Remote. Sens..

[28]  G. Asner,et al.  A universal airborne LiDAR approach for tropical forest carbon mapping , 2011, Oecologia.

[29]  Werner Rammer,et al.  Increasing forest disturbances in Europe and their impact on carbon storage. , 2014, Nature climate change.

[30]  Chad M. Hoffman,et al.  Spatially explicit measurements of forest structure and fire behavior following restoration treatments in dry forests , 2017 .

[31]  J. Trochta,et al.  3D Forest: An application for descriptions of three-dimensional forest structures using terrestrial LiDAR , 2017, PloS one.

[32]  Johannes Heinzel,et al.  Detecting Tree Stems from Volumetric TLS Data in Forest Environments with Rich Understory , 2016, Remote. Sens..

[33]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[34]  Peter Surový,et al.  Mapping Forest Structure Using UAS inside Flight Capabilities , 2018, Sensors.

[35]  K. Jarrod Millman,et al.  Array programming with NumPy , 2020, Nat..

[36]  M. Vastaranta,et al.  Detecting and characterizing downed dead wood using terrestrial laser scanning , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.