Tree Crown Delineation Algorithm Based on a Convolutional Neural Network

Tropical forests concentrate the largest diversity of species on the planet and play a key role in maintaining environmental processes. Due to the importance of those forests, there is growing interest in mapping their components and getting information at an individual tree level to conduct reliable satellite-based forest inventory for biomass and species distribution qualification. Individual tree crown information could be manually gathered from high resolution satellite images; however, to achieve this task at large-scale, an algorithm to identify and delineate each tree crown individually, with high accuracy, is a prerequisite. In this study, we propose the application of a convolutional neural network—Mask R-CNN algorithm—to perform the tree crown detection and delineation. The algorithm uses very high-resolution satellite images from tropical forests. The results obtained are promising—the R e c a l l , P r e c i s i o n , and F 1 score values obtained were were 0.81 , 0.91 , and 0.86 , respectively. In the study site, the total of tree crowns delineated was 59,062 . These results suggest that this algorithm can be used to assist the planning and conduction of forest inventories. As the algorithm is based on a Deep Learning approach, it can be systematically trained and used for other regions.

[1]  Zhiguo Jiang,et al.  Inshore Ship Detection Based on Mask R-CNN , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[2]  I. Yücel Özbek,et al.  Mask R-CNN Algoritması ile Hangar Tespiti Hangar Detection with Mask R-CNN Algorithm , 2019, 2019 27th Signal Processing and Communications Applications Conference (SIU).

[3]  B. R. Ramesh,et al.  Pan‐tropical prediction of forest structure from the largest trees , 2018, Global Ecology and Biogeography.

[4]  Morten Andreas Dahl Larsen,et al.  Comparison of six individual tree crown detection algorithms evaluated under varying forest conditions , 2011 .

[5]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[6]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael A. Lefsky,et al.  Review of studies on tree species classification from remotely sensed data , 2016 .

[8]  Fabian Ewald Fassnacht,et al.  Convolutional Neural Networks enable efficient, accurate and fine-grained segmentation of plant species and communities from high-resolution UAV imagery , 2019, Scientific Reports.

[9]  Paulo I. Prado,et al.  How much do we know about the endangered Atlantic Forest? Reviewing nearly 70 years of information on tree community surveys , 2015, Biodiversity and Conservation.

[10]  Christian Szegedy,et al.  DeepPose: Human Pose Estimation via Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Bazila Bashir,et al.  Tree Crown Detection, Delineation and Counting in UAV Remote Sensed Images: A Neural Network Based Spectral–Spatial Method , 2018, Journal of the Indian Society of Remote Sensing.

[12]  Joanne C. White,et al.  Remote Sensing Technologies for Enhancing Forest Inventories: A Review , 2016 .

[13]  P. Couteron,et al.  Contrasted allometries between stem diameter, crown area, and tree height in five tropical biogeographic areas , 2016, Trees.

[14]  D. Roberts,et al.  Hyperspectral discrimination of tropical rain forest tree species at leaf to crown scales , 2005 .

[15]  J. Terborgh,et al.  Markedly divergent estimates of Amazon forest carbon density from ground plots and satellites , 2014, Global ecology and biogeography : a journal of macroecology.

[16]  B. S. Tan,et al.  Mapping and Characterizing Selected Canopy Tree Species at the Angkor World Heritage Site in Cambodia Using Aerial Data , 2015, PloS one.

[17]  D. King,et al.  Image modelling of forest changes associated with acid mine drainage , 1999 .

[18]  Y. Shimabukuro,et al.  Tree species classification in tropical forests using visible to shortwave infrared WorldView-3 images and texture analysis , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  T. H. Meyer,et al.  Evaluation of pansharpening algorithms in support of earth observation based rapid-mapping workflows , 2013 .

[20]  Xiaoming Liu,et al.  Do Convolutional Neural Networks Learn Class Hierarchy? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[21]  Min Bai,et al.  Deep Watershed Transform for Instance Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Y. Shimabukuro,et al.  Mapping tree species in tropical seasonal semi-deciduous forests with hyperspectral and multispectral data , 2016 .

[23]  B. Manly,et al.  Forest destructuring as revealed by the temporal dynamics of fundamental species - Case study of Santa Genebra Forest in Brazil , 2014 .

[24]  M. Keller,et al.  Amazon Forest Structure from IKONOS Satellite Data and the Automated Characterization of Forest Canopy Properties , 2008 .

[25]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[26]  Darius S. Culvenor,et al.  TIDA: an algorithm for the delineation of tree crowns in high spatial resolution remotely sensed imagery , 2002 .

[27]  Huawu Deng,et al.  Individual tree crown detection in sub-meter satellite imagery using Marked Point Processes and a geometrical-optical model , 2018, Remote Sensing of Environment.

[28]  Yanfei Liu,et al.  Scene Classification Based on a Deep Random-Scale Stretched Convolutional Neural Network , 2018, Remote. Sens..

[29]  C. Silva,et al.  Imputation of Individual Longleaf Pine (Pinus palustris Mill.) Tree Attributes from Field and LiDAR Data , 2016 .

[30]  Liviu Theodor Ene,et al.  Tree crown delineation and tree species classification in boreal forests using hyperspectral and ALS data , 2014 .

[31]  F. Achard,et al.  Determination of Deforestation Rates of the World's Humid Tropical Forests , 2002, Science.

[32]  C. Justice,et al.  High-Resolution Global Maps of 21st-Century Forest Cover Change , 2013, Science.

[33]  O. Phillips,et al.  Individual tree crown delineation in a highly diverse tropical forest using very high resolution satellite images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[34]  David Kenfack,et al.  An estimate of the number of tropical tree species , 2015, Proceedings of the National Academy of Sciences.

[35]  O. Phillips,et al.  Using the U‐net convolutional network to map forest types and disturbance in the Atlantic rainforest with very high resolution images , 2019, Remote Sensing in Ecology and Conservation.

[36]  Carola-Bibiane Schönlieb,et al.  Individual Tree Species Classification From Airborne Multisensor Imagery Using Robust PCA , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Lindi J. Quackenbush,et al.  A comparison of three methods for automatic tree crown detection and delineation from high spatial resolution imagery , 2011 .

[38]  Cem Ünsalan,et al.  Tree crown detection and delineation in satellite images using probabilistic voting , 2017 .

[39]  Lênio Soares Galvão,et al.  Quantifying Canopy Tree Loss and Gap Recovery in Tropical Forests under Low-Intensity Logging Using VHR Satellite Imagery and Airborne LiDAR , 2019, Remote. Sens..

[40]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[41]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[42]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Salah Sukkarieh,et al.  Cattle segmentation and contour extraction based on Mask R-CNN for precision livestock farming , 2019, Comput. Electron. Agric..

[44]  R. Betts,et al.  Climate Change, Deforestation, and the Fate of the Amazon , 2008, Science.

[45]  Sergio Marconi,et al.  Individual Tree-Crown Detection in RGB Imagery Using Semi-Supervised Deep Learning Neural Networks , 2019, Remote. Sens..

[46]  B. Koch,et al.  Detection of individual tree crowns in airborne lidar data , 2006 .

[47]  Jocelyn Chanussot,et al.  On the use of binary partition trees for the tree crown segmentation of tropical rainforest hyperspectral images , 2015 .

[48]  Weijia Li,et al.  Deep Learning Based Oil Palm Tree Detection and Counting for High-Resolution Remote Sensing Images , 2016, Remote. Sens..

[49]  Rodney A. Walker,et al.  Towards automatic tree crown detection and delineation in spectral feature space using PCNN and morphological reconstruction , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[50]  Douglas J. King,et al.  Automated tree crown detection and delineation in high-resolution digital camera imagery of coniferous forest regeneration , 2002 .

[51]  O. Phillips,et al.  Carbon uptake by mature Amazon forests has mitigated Amazon nations’ carbon emissions , 2017, Carbon Balance and Management.

[52]  Hao Wu,et al.  Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[53]  Yinghai Ke,et al.  A review of methods for automatic individual tree-crown detection and delineation from passive remote sensing , 2011 .

[54]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.