Detecting newly grown tree leaves from unmanned-aerial-vehicle images using hyperspectral target detection techniques

Abstract Phenological events of tree leaves from initiation to senescence is generally influenced by temperature and water availability. Detection of newly grown leaves (NGL) is useful in the diagnosis of growth of trees, tree stress and even climatic change. Utilizing very high resolution UAV images, this paper examines the feasibility of NGL detection using hyperspectral detection algorithms and anomaly detectors. The issues of pixel resolution and hard decision thresholding in deriving accurate NGL maps are also explored. Results showed that the blind-detection algorithms RXDs are not suitable for NGL detection due to the spectra similarity between NGL and both mature leaves and grass, while brighter pixels, such as those produced by soil and concrete materials, are more easily recognized as anomaly in contrast to forest. Matching filter (MF) based detectors are, however, able to accurately detect NGL over forest stands and are even more effective in the sense of achieving satisfactory true positives and true negatives while providing minimal false alarms. Of the tested partial knowledge MF algorithms, the covariance matched filter based distance (KMFD) detector performed very well with overall accuracy (OA) 0.97 and kappa coefficient ( κ ^ ) 0.60 on a natural resolution of 6.75 cm image. When a variety of mature-leaf nonobjective targets are included in the detection, the orthogonal subspace projector (OSP) tends to suppress NGL pixels as an unwanted signature and this leads to poor detection. Conversely, the target constrained interference minimized filter (TCIMF) detector is still able to effectively detect NGL with a satisfactory OA and κ ^ through effective matching filter of the target signature as the hard-decision threshold is subject to a level of 5% or 1% probability of false alarms. From decimeter resolution satellite images, the KMFD and TCIMF detectors are capable of achieving an accuracy of OA = 0.94 and κ ^  = 0.56 or OA = 0.87 and κ ^  = 0.48 for images with a resolution of 33.75 cm or 67.50 cm respectively. This indicates that hyperspectral target detection techniques have great potential in NGL detection via high spatial resolution satellite multispectral images.

[1]  P. Zarco-Tejada,et al.  Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera , 2012 .

[2]  Nithya Rajan,et al.  Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research , 2016, PloS one.

[3]  Andrew M. Cunliffe,et al.  Ultra-fine grain landscape-scale quantification of dryland vegetation structure with drone-acquired structure-from-motion photogrammetry , 2016 .

[4]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[5]  N. Ori,et al.  Leaf development and morphogenesis , 2014, Development.

[6]  Peter Bajorski,et al.  Analytical Comparison of the Matched Filter and Orthogonal Subspace Projection Detectors for Hyperspectral Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[8]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[9]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[10]  Chang-Hoi Ho,et al.  Phenology shifts at start vs. end of growing season in temperate vegetation over the Northern Hemisphere for the period 1982–2008 , 2011 .

[11]  Chao-Cheng Wu,et al.  Effects of atmospheric correction and pansharpening on LULC classification accuracy using WorldView-2 imagery , 2015 .

[12]  Erle C. Ellis,et al.  High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision , 2013 .

[13]  Zhang Peng,et al.  The design of Top-Hat morphological filter and application to infrared target detection , 2006 .

[14]  Yoshihisa Kawahara,et al.  UAV Photogrammetry for Monitoring Changes in River Topography and Vegetation , 2016 .

[15]  Chinsu Lin,et al.  Temporal variations in phenological events of forests, grasslands and desert steppe ecosystems in Mongolia: a remote sensing approach , 2016 .

[16]  Wei Tang,et al.  Robust Hyperspectral Image Target Detection Using an Inequality Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[17]  K. Macdicken,et al.  Global Forest Resources Assessment 2015: how are the world's forests changing? , 2015 .

[18]  Chein-I Chang,et al.  Target-constrained interference-minimized approach to subpixel target detection for hyperspectral images , 2000 .

[19]  Gavin Thomson,et al.  An IPCC-Compliant Technique for Forest Carbon Stock Assessment Using Airborne LiDAR-Derived Tree Metrics and Competition Index , 2016, Remote. Sens..

[20]  A. Wingler Comparison of signaling interactions determining annual and perennial plant growth in response to low temperature , 2015, Front. Plant Sci..

[21]  Kyung-Ok Kim,et al.  Tracking Road Centerlines from High Resolution Remote Sensing Images by Least Squares Correlation Matching , 2004 .

[22]  Lutz Plümer,et al.  Unsupervised domain adaptation for early detection of drought stress in hyperspectral images , 2017 .

[23]  Steven Johnson Constrained energy minimization and the target-constrained interference-minimized filter , 2003 .

[24]  Kenlo Nishida Nasahara,et al.  Uncertainties involved in leaf fall phenology detected by digital camera , 2015, Ecol. Informatics.

[25]  Jianfeng Zhou,et al.  Aerial multispectral imaging for crop hail damage assessment in potato , 2016, Comput. Electron. Agric..

[26]  Pablo J. Zarco-Tejada,et al.  Detecting water stress effects on fruit quality in orchards with time-series PRI airborne imagery , 2010 .

[27]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[28]  Claus Brenner,et al.  Extraction of buildings and trees in urban environments , 1999 .

[29]  P. Zarco-Tejada,et al.  Unmanned aerial platform-based multi-spectral imaging for field phenotyping of maize , 2015, Plant Methods.

[30]  Jean-Yves Tourneret,et al.  The Adaptive Coherence Estimator is the Generalized Likelihood Ratio Test for a Class of Heterogeneous Environments , 2008, IEEE Signal Processing Letters.

[31]  Jurandy Almeida,et al.  Modeling plant phenology database: Blending near-surface remote phenology with on-the-ground observations , 2016 .

[32]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[33]  Jan Pisek,et al.  Measuring leaf angle distribution in broadleaf canopies using UAVs , 2016 .

[34]  M. Dubbini,et al.  Digital elevation models from unmanned aerial vehicle surveys for archaeological interpretation of terrain anomalies: case study of the Roman castrum of Burnum (Croatia) , 2016 .

[35]  Antonio J. Plaza,et al.  Spatial Preprocessing for Endmember Extraction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Sukhendu Das,et al.  Use of Salient Features for the Design of a Multistage Framework to Extract Roads From High-Resolution Multispectral Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Chinsu Lin,et al.  Comparison of carbon sequestration potential in agricultural and afforestation farming systems , 2013 .

[38]  Jie Ma,et al.  A Robust Directional Saliency-Based Method for Infrared Small-Target Detection Under Various Complex Backgrounds , 2013, IEEE Geoscience and Remote Sensing Letters.

[39]  Sorin C. Popescu,et al.  A novel reflectance-based model for evaluating chlorophyll concentrations of fresh and water-stressed leaves , 2013 .

[40]  S. Penfield Temperature perception and signal transduction in plants. , 2008, The New phytologist.

[41]  Antonio J. Plaza,et al.  Spectral–Spatial Classification of Hyperspectral Data Using Local and Global Probabilities for Mixed Pixel Characterization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Samuel T. Thiele,et al.  Ground-based and UAV-Based photogrammetry: A multi-scale, high-resolution mapping tool for structural geology and paleoseismology , 2014 .

[43]  Yanfei Zhong,et al.  Multi-class geospatial object detection based on a position-sensitive balancing framework for high spatial resolution remote sensing imagery , 2018 .

[44]  Luis Merino,et al.  Unmanned aerial vehicles as tools for forest-fire fighting , 2006 .

[45]  George Pallis,et al.  Use of unmanned vehicles in search and rescue operations in forest fires: advantages and limitations observed in a field trial , 2015 .

[46]  Arko Lucieer,et al.  Evaluating Tree Detection and Segmentation Routines on Very High Resolution UAV LiDAR Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Salah Sukkarieh,et al.  Multi-class predictive template for tree crown detection , 2012 .

[48]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.

[49]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Vanni Nardino,et al.  Estimation of canopy attributes in beech forests using true colour digital images from a small fixed-wing UAV , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[51]  Arko Lucieer,et al.  An Assessment of the Repeatability of Automatic Forest Inventory Metrics Derived From UAV-Borne Laser Scanning Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[53]  Vivien Rossi,et al.  Water Availability Is the Main Climate Driver of Neotropical Tree Growth , 2012, PloS one.