Detection of Pine Shoot Beetle (PSB) Stress on Pine Forests at Individual Tree Level using UAV-Based Hyperspectral Imagery and Lidar

In recent years, the outbreak of the pine shoot beetle (PSB), Tomicus spp., has caused serious shoots damage and the death of millions of trees in Yunnan pine forests in southwestern China. It is urgent to develop a convincing approach to accurately assess the shoot damage ratio (SDR) for monitoring the PSB insects at an early stage. Unmanned airborne vehicles (UAV)-based sensors, including hyperspectral imaging (HI) and lidar, have very high spatial and spectral resolutions, which are very useful to detect forest health. However, very few studies have utilized HI and lidar data to estimate SDRs and compare the predictive power for mapping PSB damage at the individual tree level. Additionally, the data fusion of HI and lidar may improve the detection accuracy, but it has not been well studied. In this study, UAV-based HI and lidar data were fused to detect PSB. We systematically evaluated the potential of a hyperspectral approach (only-HI data), a lidar approach (only-lidar data), and a combined approach (HI plus lidar data) to characterize PSB damage of individual trees using the Random Forest (RF) algorithm, separately. The most innovative point is the proposed new method to extract the three dimensional (3D) shadow distribution of each tree crown based on a lidar point cloud and the 3D radiative transfer model RAPID. The results show that: (1) for the accuracy of estimating the SDR of individual trees, the lidar approach (R2 = 0.69, RMSE = 12.28%) performed better than hyperspectral approach (R2 = 0.67, RMSE = 15.87%), and in addition, it was useful to detect dead trees with an accuracy of 70%; (2) the combined approach has the highest accuracy (R2 = 0.83, RMSE = 9.93%) for mapping PSB damage degrees; and (3) when combining HI and lidar data to predict SDRs, two variables have the most contributions, which are the leaf chlorophyll content (Cab) derived from hyperspectral data and the return intensity of the top of shaded crown (Int_Shd_top) from lidar metrics. This study confirms the high possibility to accurately predict SDRs at individual tree level if combining HI and lidar data. The 3D radiative transfer model can determine the 3D crown shadows from lidar, which is a key information to combine HI and lidar. Therefore, our study provided a guidance to combine the advantages of hyperspectral and lidar data to accurately measure the health of individual trees, enabling us to prioritize areas for forest health promotion. This method may also be used for other 3D land surfaces, like urban areas.

[1]  Stéphane Jacquemoud,et al.  PROSPECT-D: towards modeling leaf optical properties through a complete lifecycle , 2017 .

[2]  Robert A. Leathers,et al.  A novel method for illumination suppression in hyperspectral images , 2008, SPIE Defense + Commercial Sensing.

[3]  D. Donoghue,et al.  Remote sensing of species mixtures in conifer plantations using LiDAR height and intensity data , 2007 .

[4]  Clement Atzberger,et al.  Tree Species Classification with Random Forest Using Very High Spatial Resolution 8-Band WorldView-2 Satellite Data , 2012, Remote. Sens..

[5]  Qibing Zhu,et al.  Automatic threshold method and optimal wavelength selection for insect-damaged vegetable soybean detection using hyperspectral images , 2014 .

[6]  Carlos Alberto Silva,et al.  Optimizing the Remote Detection of Tropical Rainforest Structure with Airborne Lidar: Leaf Area Profile Sensitivity to Pulse Density and Spatial Sampling , 2019, Remote. Sens..

[7]  Neil Sims,et al.  Spectral mixture analysis to monitor defoliation in mixed-aged Eucalyptus globulus Labill plantations in southern Australia using Landsat 5-TM and EO-1 Hyperion data , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[8]  Michael Sprintsin,et al.  Combining land surface temperature and shortwave infrared reflectance for early detection of mountain pine beetle infestations in western Canada , 2011 .

[9]  Juha Hyyppä,et al.  Classification of Defoliated Trees Using Tree-Level Airborne Laser Scanning Data Combined with Aerial Images , 2010, Remote. Sens..

[10]  Elfatih M. Abdel-Rahman,et al.  Random forest regression and spectral band selection for estimating sugarcane leaf nitrogen concentration using EO-1 Hyperion hyperspectral data , 2013 .

[11]  Erik Næsset,et al.  Mapping defoliation during a severe insect attack on Scots pine using airborne laser scanning , 2006 .

[12]  DeLiang Wang,et al.  Remote Sensing Image Segmentation by Combining Spectral and Texture Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  F. Fassnacht,et al.  Intra-annual Ips typographus outbreak monitoring using a multi-temporal GIS analysis based on hyperspectral and ALS data in the Białowieża Forests , 2019, Forest Ecology and Management.

[14]  Beat Wermelinger,et al.  Ecology and management of the spruce bark beetle Ips typographus—a review of recent research , 2004 .

[15]  Eija Honkavaara,et al.  Using UAV-Based Photogrammetry and Hyperspectral Imaging for Mapping Bark Beetle Damage at Tree-Level , 2015, Remote. Sens..

[16]  Jason S. Sibold,et al.  Modeling a Historical Mountain Pine Beetle Outbreak Using Landsat MSS and Multiple Lines of Evidence , 2014 .

[17]  Onisimo Mutanga,et al.  High density biomass estimation for wetland vegetation using WorldView-2 imagery and random forest regression algorithm , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[18]  M. Wingfield,et al.  Planted forest health: The need for a global strategy , 2015, Science.

[19]  Warren B. Cohen,et al.  A Landsat time series approach to characterize bark beetle and defoliator impacts on tree mortality and surface fuels in conifer forests , 2011 .

[20]  Cornelius Senf,et al.  Characterizing spectral-temporal patterns of defoliator and bark beetle disturbances using Landsat time series , 2015 .

[21]  Huaguo Huang,et al.  Detection of Shoot Beetle Stress on Yunnan Pine Forest Using a Coupled LIBERTY2-INFORM Simulation , 2018, Remote. Sens..

[22]  Sergey V. Alexandrov,et al.  Mapping individual tree health using full-waveform airborne laser scans and imaging spectroscopy: A case study for a floodplain eucalypt forest , 2016 .

[23]  P. Kempeneers,et al.  Chlorophyll content estimation in an open-canopy conifer forest with Sentinel-2A and hyperspectral imagery in the context of forest decline , 2019, Remote sensing of environment.

[24]  William R. Raun,et al.  Spectral Reflectance Indices as a Potential Indirect Selection Criteria for Wheat Yield under Irrigation , 2006 .

[25]  M. Kautz,et al.  Quantifying spatio-temporal dispersion of bark beetle infestations in epidemic and non-epidemic conditions , 2011 .

[26]  Antanas Verikas,et al.  Mining data with random forests: A survey and results of new tests , 2011, Pattern Recognit..

[27]  Matti Pietikäinen,et al.  Adaptive document image binarization , 2000, Pattern Recognit..

[28]  Jonathan A. Walter,et al.  Multi-temporal analysis reveals that predictors of mountain pine beetle infestation change during outbreak cycles , 2013 .

[29]  G. D. Amman.  The mountain pine beetle-identification, biology, causes of outbreaks, and entomological research needs , 1982 .

[30]  Feng Zhao,et al.  Mapping canopy defoliation by herbivorous insects at the individual tree level using bi-temporal airborne imaging spectroscopy and LiDAR measurements , 2018, Remote Sensing of Environment.

[31]  José F. Moreno,et al.  Multiple Cost Functions and Regularization Options for Improved Retrieval of Leaf Chlorophyll Content and LAI through Inversion of the PROSAIL Model , 2013, Remote. Sens..

[32]  G. Carter,et al.  Early detection of plant stress by digital imaging within narrow stress-sensitive wavebands , 1994 .

[33]  Qing Xiao,et al.  Unified Optical-Thermal Four-Stream Radiative Transfer Theory for Homogeneous Vegetation Canopies , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[34]  M. Ayres,et al.  Assessing the consequences of global change for forest disturbance from herbivores and pathogens. , 2000, The Science of the total environment.

[35]  Gregory Asner,et al.  An Approach for Foliar Trait Retrieval from Airborne Imaging Spectroscopy of Tropical Forests , 2018, Remote. Sens..

[36]  J. Hicke,et al.  Evaluating the potential of multispectral imagery to map multiple stages of tree mortality , 2011 .

[37]  Anna Maria Jönsson,et al.  Spatio‐temporal impact of climate change on the activity and voltinism of the spruce bark beetle, Ips typographus , 2009 .

[38]  G. A. Blackburn,et al.  Quantifying Chlorophylls and Caroteniods at Leaf and Canopy Scales: An Evaluation of Some Hyperspectral Approaches , 1998 .

[39]  A. Skidmore,et al.  Important LiDAR metrics for discriminating forest tree species in Central Europe , 2018 .

[40]  Jocelyn Chanussot,et al.  On the use of binary partition trees for the tree crown segmentation of tropical rainforest hyperspectral images , 2015 .

[41]  R. Macarthur,et al.  Foliage Profile by Vertical Measurements , 1969 .

[42]  J. Negrón,et al.  Mountain pine beetle-caused mortality over eight years in two pine hosts in mixed-conifer stands of the southern Rocky Mountains , 2014 .

[43]  Joanne C. White,et al.  Multi-temporal analysis of high spatial resolution imagery for disturbance monitoring , 2008 .

[44]  Maggi Kelly,et al.  A New Method for Segmenting Individual Trees from the Lidar Point Cloud , 2012 .

[45]  Clayton C. Kingdon,et al.  A general Landsat model to predict canopy defoliation in broadleaf deciduous forests , 2012 .

[46]  Lawrence A. Corp,et al.  NASA Goddard's LiDAR, Hyperspectral and Thermal (G-LiHT) Airborne Imager , 2013, Remote. Sens..

[47]  Huaguo Huang,et al.  Detecting Shoot Beetle Damage on Yunnan Pine Using Landsat Time-Series Data , 2018 .

[48]  F. Baret,et al.  PROSPECT: A model of leaf optical properties spectra , 1990 .

[49]  P. Townsend,et al.  Spatial dynamics of a gypsy moth defoliation outbreak and dependence on habitat characteristics , 2013, Landscape Ecology.

[50]  Patrick Hostert,et al.  Remote sensing of forest insect disturbances: Current state and future directions , 2017, Int. J. Appl. Earth Obs. Geoinformation.

[51]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[52]  John A. Gamon,et al.  Assessing leaf pigment content and activity with a reflectometer , 1999 .

[53]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .

[54]  Richard A. Hallett,et al.  Ash decline assessment in emerald ash borer-infested regions: A test of tree-level, hyperspectral technologies , 2008 .

[55]  Kellie J. Archer,et al.  Empirical characterization of random forest variable importance measures , 2008, Comput. Stat. Data Anal..

[56]  Nicholas C. Coops,et al.  Assessing changes in forest fragmentation following infestation using time series Landsat imagery , 2010 .

[57]  Svein Solberg,et al.  Assessment of defoliation during a pine sawfly outbreak: Calibration of airborne laser scanning data with hemispherical photography , 2007 .

[58]  Luis Alonso,et al.  Optimizing LUT-Based RTM Inversion for Semiautomatic Mapping of Crop Biophysical Parameters from Sentinel-2 and -3 Data: Role of Cost Functions , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Richard H. Waring,et al.  Modifying Lodgepole Pine Stands to Change Susceptibility to Mountain Pine Beetle Attack , 1985 .

[60]  N. Pfeifer,et al.  Correction of laser scanning intensity data: Data and model-driven approaches , 2007 .

[61]  W. Verhoef,et al.  PROSPECT+SAIL models: A review of use for vegetation characterization , 2009 .

[62]  Yanjun Su,et al.  Improved progressive TIN densification filtering algorithm for airborne LiDAR data in forested areas , 2016 .

[63]  Andrew K. Skidmore,et al.  Retrieval of forest leaf functional traits from HySpex imagery using radiative transfer models and continuous wavelet analysis , 2016 .

[64]  A. Arneth,et al.  Simulating the recent impacts of multiple biotic disturbances on forest carbon cycling across the United States , 2018, Global change biology.

[65]  Wenhan Qin,et al.  RAPID: A Radiosity Applicable to Porous IndiviDual Objects for directional reflectance over complex vegetated scenes , 2013 .

[66]  Kenton W. Ross,et al.  Assessment of MODIS NDVI time series data products for detecting forest defoliation by gypsy moth outbreaks , 2011 .

[67]  G. Asner,et al.  Airborne laser-guided imaging spectroscopy to map forest trait diversity and guide conservation , 2017, Science.

[68]  Marco Heurich,et al.  Tree species classification using plant functional traits from LiDAR and hyperspectral data , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[69]  Jean-Baptiste Féret,et al.  Retrieving structural and chemical properties of individual tree crowns in a highly diverse tropical forest with 3D radiative transfer modeling and imaging spectroscopy , 2018, Remote Sensing of Environment.

[70]  Dirk Pflugmacher,et al.  A multi-scale analysis of western spruce budworm outbreak dynamics , 2017, Landscape Ecology.

[71]  N. Coops,et al.  Monitoring the impacts of mountain pine beetle mitigation , 2009 .

[72]  Michael A. Wulder,et al.  Surveying mountain pine beetle damage of forests: A review of remote sensing opportunities , 2006 .

[73]  D. Sims,et al.  Relationships between leaf pigment content and spectral reflectance across a wide range of species, leaf structures and developmental stages , 2002 .

[74]  Richard Hallett,et al.  A 10-Year Assessment of Hemlock Decline in the Catskill Mountain Region of New York State using Hyperspectral Remote Sensing Techniques , 2015, Journal of economic entomology.

[75]  J. Chen.  Evaluation of Vegetation Indices and a Modified Simple Ratio for Boreal Applications , 1996 .

[76]  Nicholas C. Coops,et al.  Assessment of QuickBird high spatial resolution imagery to detect red attack damage due to mountain pine beetle infestation , 2006 .

[77]  R. Coulson,et al.  Heterogeneity of forest landscapes and the distribution and abundance of the southern pine beetle , 1999 .

[78]  A. Hovi,et al.  LiDAR waveform features for tree species classification and their sensitivity to tree- and acquisition related parameters , 2016 .

[79]  Neal W. Aven,et al.  Mapping urban tree species using integrated airborne hyperspectral and LiDAR remote sensing data , 2017 .

[80]  Juha Hyyppä,et al.  A comprehensive but efficient framework of proposing and validating feature parameters from airborne LiDAR data for tree species classification , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[81]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[82]  Nicolas Lauret,et al.  Influence of 3D Spruce Tree Representation on Accuracy of Airborne and Satellite Forest Reflectance Simulated in DART , 2019, Forests.

[83]  O. Mutanga,et al.  Integrating environmental variables and WorldView-2 image data to improve the prediction and mapping of Thaumastocoris peregrinus (bronze bug) damage in plantation forests , 2014 .