Generating a hyperspectral digital surface model using a hyperspectral 2D frame camera

Abstract Miniaturised 2D frame format hyperspectral camera technology that is suitable for small unmanned aerial vehicles (UAVs) has entered the market, making the generation of hyperspectral digital surface models (HDSMs) feasible. HDSMs offer a rigorous approach to capturing the target spectral and 3D geometric data. The main objective of this investigation was to study and develop techniques for the generation of HDSMs in forest areas using novel hyperspectral 2D frame camera technologies. An approach based on object-space image matching was developed, adapting the traditional vertical line locus (VLL) method for HDSM generation; this was then named the hyperspectral VLL (HVLL) approach. Additionally, image classification was introduced into the processing chain in order to adapt the matching parameters, based on different classes. We also proposed a method for extracting the spectral and viewing angle information of the points. An empirical study was carried out using UAV datasets from tropical and boreal forests using 2D format hyperspectral cameras, based on tuneable Fabry-Perot interferometer (FPI) technology. Quality assessment was performed using DSMs based on state-of-the-art commercial software and airborne laser scanning (ALS). The results showed that the proposed technique generated a high-quality HDSM in both tested environments. The HDSM had higher deviations over the continuous canopy cover than the digital surface models (DSMs) generated using commercial software. The method using image classification information outperformed the commercial approach with respect to the ability to measure ground points in shadowed areas and in canopy gaps. The proposed method is of great interest in supporting automated interpretations of novel multi- and hyperspectral imaging technologies, especially when applied complex objects, such as forests.

[1]  D. Roberts,et al.  Hyperspectral discrimination of tropical rain forest tree species at leaf to crown scales , 2005 .

[2]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[3]  Teemu Hakala,et al.  Fast and nondestructive method for leaf level chlorophyll estimation using hyperspectral LiDAR , 2014 .

[4]  Eija Honkavaara,et al.  Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera , 2012, Sensors.

[5]  Changjae Kim,et al.  New Methodologies for True Orthophoto Generation , 2007 .

[6]  Clement Atzberger,et al.  Potential of Multi-Angular Data Derived From a Digital Aerial Frame Camera for Forest Classification , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  G. Takao,et al.  Performance of a photogrammetric digital elevation model in a tropical montane forest environment. , 2016 .

[8]  Uwe Stilla,et al.  Coregistration refinement of hyperspectral images and DSM: An object-based approach using spectral information , 2015 .

[9]  Teemu Hakala,et al.  Technical Note: Multispectral lidar time series of pine canopy chlorophyll content , 2015 .

[10]  E. Mikhail,et al.  Introduction to modern photogrammetry , 2001 .

[11]  Juha Hyyppä,et al.  Object-based analysis of multispectral airborne laser scanner data for land cover classification and map updating , 2017 .

[12]  Barbara Koch,et al.  Status and future of laser scanning, synthetic aperture radar and hyperspectral remote sensing data for forest biomass assessment , 2010 .

[13]  Hans-Peter Röser,et al.  Hyperspectral Remote Sensing with the UAS “Stuttgarter Adler” – System Setup, Calibration and First Results , 2014 .

[14]  K. Kraus Photogrammetry: Geometry from Images and Laser Scans , 2007 .

[15]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[16]  E. Honkavaara,et al.  Using Hyperspectral Frame Images from Unmanned Airborne Vehicle for Detailed Measurement of Boreal Forest 3D Structure , 2016 .

[17]  A. Gruen Development and Status of Image Matching in Photogrammetry , 2012 .

[18]  Lorenzo Bruzzone,et al.  Fusion of Hyperspectral and LIDAR Remote Sensing Data for Classification of Complex Forest Areas , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[19]  D. Roberts,et al.  Estimation of tropical rain forest aboveground biomass with small-footprint lidar and hyperspectral sensors , 2011 .

[20]  Meizhen Wang,et al.  An enhanced multi-view vertical line locus matching algorithm of object space ground primitives based on positioning consistency for aerial and space images , 2018 .

[21]  Jan G. P. W. Clevers,et al.  Mapping Reflectance Anisotropy of a Potato Canopy Using Aerial Images Acquired with an Unmanned Aerial Vehicle , 2017, Remote. Sens..

[22]  J. Hyyppä,et al.  Review of methods of small‐footprint airborne laser scanning for extracting forest inventory data in boreal forests , 2008 .

[23]  Andreas Burkart,et al.  Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance , 2015 .

[24]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[25]  Heikki Saari,et al.  Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture , 2013, Remote. Sens..

[26]  Lars T. Waser,et al.  High‐quality image matching and automated generation of 3D tree models , 2008 .

[27]  G. Henebry,et al.  Remote sensing of vegetation 3-D structure for biodiversity and habitat: Review and implications for lidar and radar spaceborne missions , 2009 .

[28]  Gong Wei,et al.  Multi-wavelength canopy LiDAR for remote sensing of vegetation: Design and system performance , 2012 .

[29]  V. Liesenberg,et al.  Variations in reflectance with seasonality and viewing geometry: Implications for classification of Brazilian savanna physiognomies with MISR/Terra data , 2007 .

[30]  Yongjun Zhang,et al.  Direct Digital Surface Model Generation by Semi-Global Vertical Line Locus Matching , 2017, Remote. Sens..

[31]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[33]  Juha Hyyppä,et al.  Individual Tree Detection and Classification with UAV-Based Photogrammetric Point Clouds and Hyperspectral Imaging , 2017, Remote. Sens..

[34]  Nilton Nobuhiro Imai,et al.  Mapping Mosaic Virus in Sugarcane Based on Hyperspectral Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Heikki Saari,et al.  Unmanned Aerial Vehicle (UAV) operated spectral camera system for forest and agriculture applications , 2011, Remote Sensing.

[36]  Eija Honkavaara,et al.  Using UAV-Based Photogrammetry and Hyperspectral Imaging for Mapping Bark Beetle Damage at Tree-Level , 2015, Remote. Sens..

[37]  Eija Honkavaara,et al.  Band registration of tuneable frame format hyperspectral UAV imagers in complex scenes , 2017 .

[38]  Luis Alonso,et al.  Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer , 2015, Remote. Sens..

[39]  Eija Honkavaara,et al.  Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows , 2018, Remote. Sens..

[40]  Juha Suomalainen,et al.  A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles , 2014, Remote. Sens..

[41]  Richard Gloaguen,et al.  The Need for Accurate Geometric and Radiometric Corrections of Drone-Borne Hyperspectral Data for Mineral Exploration: MEPHySTo - A Toolbox for Pre-Processing Drone-Borne Hyperspectral Data , 2017, Remote. Sens..

[42]  Eija Honkavaara,et al.  Identification of Successional Stages and Cover Changes of Tropical Forest Based on Digital Surface Model Analysis , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  Heikki Saari,et al.  Unmanned aerial vehicle (UAV) operated megapixel spectral camera , 2011, Security + Defence.

[44]  Li Zhang Automatic Digital Surface Model (DSM) generation from linear array images , 2005 .

[45]  L. Wallace,et al.  Assessment of Forest Structure Using Two UAV Techniques: A Comparison of Airborne Laser Scanning and Structure from Motion (SfM) Point Clouds , 2016 .

[46]  E. Honkavaara,et al.  Geometric Calibration of a Hyperspectral Frame Camera , 2016 .

[47]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .