DeepForest: A Python package for RGB deep learning tree crown delineation

Remote sensing of forested landscapes can transform the speed, scale, and cost of forest research. The delineation of individual trees in remote sensing images is an essential task in forest analysis. Here we introduce a new Python package, DeepForest, that detects individual trees in high resolution RGB imagery using deep learning. While deep learning has proven highly effective in a range of computer vision tasks, it requires large amounts of training data that are typically difficult to obtain in ecological studies. DeepForest overcomes this limitation by including a model pre-trained on over 30 million algorithmically generated crowns from 22 forests and fine-tuned using 10,000 hand-labeled crowns from 6 forests. The package supports the application of this general model to new data, fine tuning the model to new datasets with user labeled crowns, training new models, and evaluating model predictions. This simplifies the process of using and retraining deep learning models for a range of forests, sensors, and spatial resolutions. We illustrate the workflow of DeepForest using data from the National Ecological Observatory Network, a tropical forest in French Guiana, and street trees from Portland, Oregon.

[1]  Sarah J. Graves,et al.  Rethinking the fundamental unit of ecological remote sensing: Estimating individual level plant traits at scale , 2019, bioRxiv.

[2]  Sergio Marconi,et al.  Individual Tree-Crown Detection in RGB Imagery Using Semi-Supervised Deep Learning Neural Networks , 2019, Remote. Sens..

[3]  Ben. G. Weinstein A computer vision for animal ecology. , 2018, The Journal of animal ecology.

[4]  Clement Atzberger,et al.  Individual Tree Crown Segmentation and Classification of 13 Tree Species Using Airborne Hyperspectral Data , 2018, Remote. Sens..

[5]  Jun Zhang,et al.  A robust approach for tree segmentation in deciduous forests using small-footprint airborne LiDAR data , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[6]  Sassan Saatchi,et al.  Lidar detection of individual tree size in tropical forests , 2016 .

[7]  Michele Dalponte,et al.  Area-based vs tree-centric approaches to mapping forest carbon in Southeast Asian forests from airborne laser scanning data , 2017 .

[8]  Sassan Saatchi,et al.  A Comparative Assessment of the Performance of Individual Tree Crowns Delineation Algorithms from ALS Data in Tropical Forests , 2019, Remote. Sens..

[9]  Michele Dalponte,et al.  Tree‐centric mapping of forest carbon density from airborne laser scanning and hyperspectral data , 2016, Methods in ecology and evolution.

[10]  Sergio Marconi,et al.  Cross-site learning in deep learning RGB tree crown detection , 2020, Ecol. Informatics.

[11]  Michele Dalponte,et al.  How to map forest structure from aircraft, one tree at a time , 2018, Ecology and evolution.

[12]  Shawn P. Serbin,et al.  Leaf area density from airborne LiDAR: Comparing sensors and resolutions in a temperate broadleaf forest ecosystem , 2019, Forest Ecology and Management.

[13]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.