Filtering Stems and Branches from Terrestrial Laser Scanning Point Clouds Using Deep 3-D Fully Convolutional Networks

Terrestrial laser scanning (TLS) can produce precise and detailed point clouds of forest environment, thus enabling quantitative structure modeling (QSM) for accurate tree morphology and wood volume allocation. Applying QSM to plot-scale wood delineation is highly dependent on wood visibility from forest scans. A common problem is to filter wood point from noisy leafy points in the crowns and understory. This study proposed a deep 3-D fully convolution network (FCN) to filter both stem and branch points from complex plot scans. To train the 3-D FCN, reference stem and branch points were delineated semi-automatically for 14 sampled areas and three common species. Among seven testing areas, agreements between reference and model prediction, measured by intersection over union (IoU) and overall accuracy (OA), were 0.89 (stem IoU), 0.54 (branch IoU), 0.79 (mean IoU), and 0.94 (OA). Wood filtering results were further incorporated to a plot-scale QSM to extract individual tree forms, isolated wood, and understory wood from three plot scans with visual assessment. The wood filtering experiment provides evidence that deep learning is a powerful tool in 3-D point cloud processing and parsing.

[1]  D. Baldocchi,et al.  On seeing the wood from the leaves and the role of voxel size in determining leaf area distribution of forests with terrestrial LiDAR , 2014 .

[2]  F. Mark Danson,et al.  Developing a dual-wavelength full-waveform terrestrial laser scanner to characterize forest canopy structure , 2014 .

[3]  Hui Xu,et al.  Knowledge and heuristic-based modeling of laser-scanned trees , 2007, TOGS.

[4]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[5]  Liviu Theodor Ene,et al.  Estimating Single-Tree Crown Biomass of Norway Spruce by Airborne Laser Scanning: A Comparison of Methods with and without the Use of Terrestrial Laser Scanning to Obtain the Ground Reference Data , 2014 .

[6]  C. Hopkinson,et al.  Automating Plot-Level Stem Analysis from Terrestrial Laser Scanning , 2016 .

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Gernot Riegler,et al.  OctNet: Learning Deep 3D Representations at High Resolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[11]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  J. Chave,et al.  Towards a Worldwide Wood Economics Spectrum 2 . L E a D I N G D I M E N S I O N S I N W O O D F U N C T I O N , 2022 .

[13]  J. Holmgren,et al.  Estimation of stem attributes using a combination of terrestrial and airborne laser scanning , 2012, European Journal of Forest Research.

[14]  Jonathan P. Sheppard,et al.  Highly Accurate Tree Models Derived from Terrestrial Laser Scan Data: A Method Description , 2014 .

[15]  Alan H. Strahler,et al.  Separating leaves from trunks and branches with dual-wavelength terrestrial lidar scanning , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[16]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[17]  C. Hopkinson,et al.  Assessing forest metrics with a ground-based scanning lidar , 2004 .

[18]  M. D. Nelson,et al.  Mapping U.S. forest biomass using nationwide forest inventory data and moderate resolution information , 2008 .

[19]  Boris Jutzi,et al.  SHAPE DISTRIBUTION FEATURES FOR POINT CLOUD ANALYSIS - A GEOMETRIC HISTOGRAM APPROACH ON MULTIPLE SCALES , 2014 .

[20]  Juha Hyyppä,et al.  Individual tree biomass estimation using terrestrial laser scanning , 2013 .

[21]  Felix Järemo Lawin,et al.  Deep Projective 3 D Semantic Segmentation , 2017 .

[22]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[23]  James B. Domingo,et al.  Estimates of live-tree carbon stores in the Pacific Northwest are sensitive to model selection , 2011, Carbon balance and management.

[24]  Hao Zhang,et al.  Automatic reconstruction of tree skeletal structures from point clouds , 2010, SIGGRAPH 2010.

[25]  Wei Huang,et al.  A Convolutional Neural Network-Based 3D Semantic Labeling Method for ALS Point Clouds , 2017, Remote. Sens..

[26]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[29]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[30]  H. Spiecker,et al.  Non Destructive Method for Biomass Prediction Combining TLS Derived Tree Volume and Wood Density , 2015 .

[31]  S. Magnussen,et al.  Mapping attributes of Canada ’ s forests at moderate resolution through k NN and MODIS imagery , 2014 .

[32]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Olga Sorkine,et al.  Laplacian Mesh Processing , 2005 .

[34]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[35]  Alexandre Boulch,et al.  Unstructured Point Cloud Semantic Labeling Using Deep Segmentation Networks , 2017, 3DOR@Eurographics.

[36]  M. Herold,et al.  Nondestructive estimates of above‐ground biomass using terrestrial laser scanning , 2015 .

[37]  C. Qi Deep Learning on Point Sets for 3 D Classification and Segmentation , 2016 .

[38]  Hans Pretzsch,et al.  Structural crown properties of Norway spruce (Picea abies [L.] Karst.) and European beech (Fagus sylvatica [L.]) in mixed versus pure stands revealed by terrestrial laser scanning , 2013, Trees.

[39]  Richard A. Fournier,et al.  The structural and radiative consistency of three-dimensional tree reconstructions from terrestrial lidar , 2009 .

[40]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  N. Pfeifer,et al.  AUTOMATIC RECONSTRUCTION OF SINGLE TREES FROM TERRESTRIAL LASER SCANNER DATA , 2004 .

[42]  Philip Lewis,et al.  Rapid characterisation of forest structure from TLS and 3D modelling , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[43]  Richard A. Fournier,et al.  An architectural model of trees to estimate forest structural attributes using terrestrial LiDAR , 2011, Environ. Model. Softw..

[44]  Dong-Ming Yan,et al.  Efficient and robust reconstruction of botanical branching structure from laser scanned points , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[45]  W. Gander,et al.  Least-squares fitting of circles and ellipses , 1994 .

[46]  Ben Graham,et al.  Sparse 3D convolutional neural networks , 2015, BMVC.

[47]  Philip Lewis,et al.  Fast Automatic Precision Tree Models from Terrestrial Laser Scanner Data , 2013, Remote. Sens..

[48]  F. Raulier,et al.  Canadian national tree aboveground biomass equations , 2005 .

[49]  Michael Felsberg,et al.  Deep Projective 3D Semantic Segmentation , 2017, CAIP.

[50]  P. Raumonen,et al.  Massive-Scale Tree Modelling from Tls Data , 2015 .

[51]  Jing Huang,et al.  Point cloud labeling using 3D Convolutional Neural Network , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[52]  StinsonG.,et al.  Mapping attributes of Canada’s forests at moderate resolution through kNN and MODIS imagery , 2014 .