A New Individual Tree Species Recognition Method Based on a Convolutional Neural Network and High-Spatial Resolution Remote Sensing Imagery

Tree species surveys are crucial to forest resource management and can provide references for forest protection policy making. The traditional tree species survey in the field is labor-intensive and time-consuming, supporting the practical significance of remote sensing. The availability of high-resolution satellite remote sensing data enable individual tree species (ITS) recognition at low cost. In this study, the potential of the combination of such images and a convolutional neural network (CNN) to recognize ITS was explored. Firstly, individual tree crowns were delineated from a high-spatial resolution WorldView-3 (WV3) image and manually labeled as different tree species. Next, a dataset of the image subsets of the labeled individual tree crowns was built, and several CNN models were trained based on the dataset for ITS recognition. The models were then applied to the WV3 image. The results show that the distribution maps of six ITS offered an overall accuracy of 82.7% and a kappa coefficient of 0.79 based on the modified GoogLeNet, which used the multi-scale convolution kernel to extract features of the tree crown samples and was modified for small-scale samples. The ITS recognition method proposed in this study, with multi-scale individual tree crown delineation, avoids artificial tree crown delineation. Compared with the random forest (RF) and support vector machine (SVM) approaches, this method can automatically extract features and outperform RF and SVM in the classification of six tree species.

[1]  P. Gong,et al.  Isolating individual trees in a savanna woodland using small footprint lidar data , 2006 .

[2]  Juha Hyyppä,et al.  Assessment of Low Density Full-Waveform Airborne Laser Scanning for Individual Tree Detection and Tree Species Classification , 2014 .

[3]  Zulkiflee Abd Latif,et al.  Carbon sinks and tropical forest biomass estimation: a review on role of remote sensing in aboveground-biomass modelling , 2017 .

[4]  Qi Zhang,et al.  Deep learning-based tree classification using mobile LiDAR data , 2015 .

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Nicolas Brown,et al.  Mapping dead forest cover using a deep convolutional neural network and digital aerial photography , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[7]  V. Liesenberg,et al.  Comparative performance of convolutional neural network, weighted and conventional support vector machine and random forest for classifying tree species using hyperspectral and photogrammetric data , 2020, GIScience & Remote Sensing.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[10]  Neal W. Aven,et al.  Mapping urban tree species using integrated airborne hyperspectral and LiDAR remote sensing data , 2017 .

[11]  Niklaus E. Zimmermann,et al.  Predicting tree species presence and basal area in Utah: A comparison of stochastic gradient boosting, generalized additive models, and tree-based methods , 2006 .

[12]  Bing Liu,et al.  Deep convolutional recurrent neural network with transfer learning for hyperspectral image classification , 2018, Journal of Applied Remote Sensing.

[13]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[14]  Validation of Statistic Based Forest Types Classification Methods Using Hyperspectral Data , 2007 .

[15]  Johannes R. Sveinsson,et al.  Random Forests for land cover classification , 2006, Pattern Recognit. Lett..

[16]  Linhai Jing,et al.  A New Individual Tree Crown Delineation Method for High Resolution Multispectral Imagery , 2020, Remote. Sens..

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Marine Louarn,et al.  "Kill Two Birds with One Stone": Urban Tree Species Classification Using Bi-Temporal Pléiades Images to Study Nesting Preferences of an Invasive Bird , 2017, Remote. Sens..

[19]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[20]  J. Reitberger,et al.  Analysis of full waveform LIDAR data for the classification of deciduous and coniferous trees , 2008 .

[21]  Maitiniyazi Maimaitijiang,et al.  Urban Tree Species Classification Using a WorldView-2/3 and LiDAR Data Fusion Approach and Deep Learning , 2019, Sensors.

[22]  Gregory Asner,et al.  Tree species mapping in tropical forests using multi-temporal imaging spectroscopy: Wavelength adaptive spectral mixture analysis , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[23]  Jungho Im,et al.  Synergistic use of QuickBird multispectral imagery and LIDAR data for object-based forest species classification , 2010 .

[24]  Janet Franklin,et al.  A Convolutional Neural Network Classifier Identifies Tree Species in Mixed-Conifer Forest from Hyperspectral Imagery , 2019, Remote. Sens..

[25]  Niti B. Mishra,et al.  Species-Level Vegetation Mapping in a Himalayan Treeline Ecotone Using Unmanned Aerial System (UAS) Imagery , 2018, ISPRS Int. J. Geo Inf..

[26]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[27]  Felipe Bravo,et al.  Managing forest ecosystems : the challenge of climate change , 2008 .

[28]  A. Hovi,et al.  LiDAR waveform features for tree species classification and their sensitivity to tree- and acquisition related parameters , 2016 .

[29]  Ming Cheng,et al.  Tree Classification in Complex Forest Point Clouds Based on Deep Learning , 2017, IEEE Geoscience and Remote Sensing Letters.

[30]  Y. Shimabukuro,et al.  Mapping tree species in tropical seasonal semi-deciduous forests with hyperspectral and multispectral data , 2016 .

[31]  Carola-Bibiane Schönlieb,et al.  Individual Tree Species Classification From Airborne Multisensor Imagery Using Robust PCA , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Xiuping Jia,et al.  Hyperspectral Image Classification Using Convolutional Neural Networks and Multiple Feature Learning , 2018, Remote. Sens..

[33]  Linhai Jing,et al.  An individual tree crown delineation method based on multi-scale segmentation of imagery , 2012 .

[34]  Annika Kangas,et al.  Forest inventory: methodology and applications. , 2006 .

[35]  Stefan Hinz,et al.  Review on Convolutional Neural Networks (CNN) in vegetation remote sensing , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  A. Suratno,et al.  Tree species identification in mixed coniferous forest using airborne laser scanning , 2009 .

[37]  Clement Atzberger,et al.  Tree Species Classification with Random Forest Using Very High Spatial Resolution 8-Band WorldView-2 Satellite Data , 2012, Remote. Sens..

[38]  Aniruddha Ghosh,et al.  A framework for mapping tree species combining hyperspectral and LiDAR data: Role of selected classifiers and sensor across three spatial scales , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[39]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[40]  Jianya Gong,et al.  Forest Type Identification with Random Forest Using Sentinel-1A, Sentinel-2A, Multi-Temporal Landsat-8 and DEM Data , 2018, Remote. Sens..

[41]  Michael A. Lefsky,et al.  Review of studies on tree species classification from remotely sensed data , 2016 .

[42]  S. Franklin,et al.  Deciduous tree species classification using object-based analysis and machine learning with unmanned aerial vehicle multispectral data , 2018 .

[43]  N. Coops,et al.  High Spatial Resolution Remotely Sensed Data for Ecosystem Characterization , 2004 .

[44]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.