SEMANTIC SEGMENTATION OF FOREST STANDS OF PURE SPECIES AS A GLOBAL OPTIMIZATION PROBLEM

Abstract. Forest stand delineation is a fundamental task for forest management purposes, that is still mainly manually performed through visual inspection of geospatial (very) high spatial resolution images. Stand detection has been barely addressed in the literature which has mainly focused, in forested environments, on individual tree extraction and tree species classification. From a methodological point of view, stand detection can be considered as a semantic segmentation problem. It offers two advantages. First, one can retrieve the dominant tree species per segment. Secondly, one can benefit from existing low-level tree species label maps from the literature as a basis for high-level object extraction. Thus, the semantic segmentation issue becomes a regularization issue in a weakly structured environment and can be formulated in an energetical framework. This papers aims at investigating which regularization strategies of the literature are the most adapted to delineate and classify forest stands of pure species. Both airborne lidar point clouds and multispectral very high spatial resolution images are integrated for that purpose. The local methods (such as filtering and probabilistic relaxation) are not adapted for such problem since the increase of the classification accuracy is below 5%. The global methods, based on an energy model, tend to be more efficient with an accuracy gain up to 15%. The segmentation results using such models have an accuracy ranging from 96% to 99%.

[1]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Philip H. S. Torr,et al.  What, Where and How Many? Combining Object Detectors and CRFs , 2010, ECCV.

[3]  Norbert Pfeifer,et al.  Forest Delineation Based on Airborne LIDAR Data , 2012, Remote. Sens..

[4]  Michael Ying Yang,et al.  EFFICIENT SEMANTIC SEGMENTATION OF MAN-MADE SCENES USING FULLY-CONNECTED CONDITIONAL RANDOM FIELD , 2016 .

[5]  M. Maltamo,et al.  AUTOMATIC DELINEATION OF FOREST STANDS FROM LIDAR DATA , 2008 .

[6]  Annika Kangas,et al.  Forest inventory: methodology and applications. , 2006 .

[7]  Konrad Schindler,et al.  An Overview and Comparison of Smooth Labeling Methods for Land-Cover Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Michele Volpi,et al.  Semantic segmentation of urban scenes by learning local class interactions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Vladimir Kolmogorov,et al.  Minimizing Nonsubmodular Functions with Graph Cuts-A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michele Dalponte,et al.  Delineation of Individual Tree Crowns from ALS and Hyperspectral data: a comparison among four methods , 2015 .

[11]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[12]  Joost van de Weijer,et al.  Harmony Potentials , 2011, International Journal of Computer Vision.

[13]  Pushmeet Kohli,et al.  Inference Methods for CRFs with Co-occurrence Statistics , 2012, International Journal of Computer Vision.

[14]  Christian Heipke,et al.  CONTEXTUAL LAND USE CLASSIFICATION: HOW DETAILED CAN THE CLASS STRUCTURE BE? , 2016 .

[15]  Carola-Bibiane Schönlieb,et al.  Individual Tree Species Classification From Airborne Multisensor Imagery Using Robust PCA , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Jon Atli Benediktsson,et al.  Land-Cover Mapping by Markov Modeling of Spatial–Contextual Information in Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[17]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[18]  L. Bruzzone,et al.  Tree species classification in the Southern Alps based on the fusion of very high geometrical resolution multispectral/hyperspectral images and LiDAR data , 2012 .

[19]  Joanne C. White,et al.  Remote Sensing Technologies for Enhancing Forest Inventories: A Review , 2016 .

[20]  Jitendra Malik,et al.  Semantic segmentation using regions and parts , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  J. Means,et al.  Predicting forest stand characteristics with airborne scanning lidar , 2000 .

[22]  Philip J. Howarth,et al.  Performance analyses of probabilistic relaxation methods for land-cover classification☆ , 1989 .

[23]  Konrad Schindler,et al.  SEMANTIC SEGMENTATION OF AERIAL IMAGES IN URBAN AREAS WITH CLASS-SPECIFIC HIGHER-ORDER CLIQUES , 2015 .

[24]  Christian Thom,et al.  A large format camera system for national mapping purposes , 2014 .

[25]  Carsten Rother,et al.  Efficient Likelihood Learning of a Generic CNN-CRF Model for Semantic Segmentation , 2015, ArXiv.

[26]  Chen Zheng,et al.  Semantic Segmentation of Remote Sensing Imagery Using Object-Based Markov Random Field Model With Regional Penalties , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Barbara Koch,et al.  AUTOMATIC SEGMENTATION AND CHARACTERISATION OF FOREST STAND PARAMETERS USING AIRBORNE LIDAR DATA , MULTISPECTRAL AND FOGIS DATA , 2004 .

[28]  M. Heurich,et al.  OBJECT-BASED SEMI-AUTOMATIC MAPPING OF FOREST STANDS WITH LASER SCANNER AND MULTI-SPECTRAL DATA , 2004 .

[29]  V. Gouet-Brunet,et al.  Semantic segmentation of forest stands of pure species combining airborne lidar data and very high resolution multispectral imagery , 2017 .

[30]  Uwe Stilla,et al.  SEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS , 2016 .

[31]  Pascal Fua,et al.  Are spatial and global constraints really necessary for segmentation? , 2011, 2011 International Conference on Computer Vision.