REAL-TIME AND POST-PROCESSED GEOREFERENCING FOR HYPERPSPECTRAL DRONE REMOTE SENSING

Abstract. The use of drones and photogrammetric technologies are increasing rapidly in different applications. Currently, drone processing workflow is in most cases based on sequential image acquisition and post-processing, but there are great interests towards real-time solutions. Fast and reliable real-time drone data processing can benefit, for instance, environmental monitoring tasks in precision agriculture and in forest. Recent developments in miniaturized and low-cost inertial measurement systems and GNSS sensors, and Real-time kinematic (RTK) position data are offering new perspectives for the comprehensive remote sensing applications. The combination of these sensors and light-weight and low-cost multi- or hyperspectral frame sensors in drones provides the opportunity of creating near real-time or real-time remote sensing data of target object. We have developed a system with direct georeferencing onboard drone to be used combined with hyperspectral frame cameras in real-time remote sensing applications. The objective of this study is to evaluate the real-time georeferencing comparing with post-processing solutions. Experimental data sets were captured in agricultural and forested test sites using the system. The accuracy of onboard georeferencing data were better than 0.5 m. The results showed that the real-time remote sensing is promising and feasible in both test sites.

[1]  Frank Dellaert,et al.  On-Manifold Preintegration for Real-Time Visual--Inertial Odometry , 2015, IEEE Transactions on Robotics.

[2]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[3]  Eija Honkavaara,et al.  Modelling and automated calibration of a general multi‐projective camera , 2018 .

[4]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[5]  C. Rizos,et al.  Reference station network based RTK systems-concepts and progress , 2003, Wuhan University Journal of Natural Sciences.

[6]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[8]  Robert Guinness,et al.  P3: A Public Precise Positioning Service based on a national GNSS network , 2014, International Conference on Localization and GNSS 2014 (ICL-GNSS 2014).

[9]  Eija Honkavaara,et al.  Radiometric Correction of Close-Range Spectral Image Blocks Captured Using an Unmanned Aerial Vehicle with a Radiometric Block Adjustment , 2018, Remote. Sens..

[10]  Juha Suomalainen,et al.  A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles , 2014, Remote. Sens..

[11]  Eija Honkavaara,et al.  Band registration of tuneable frame format hyperspectral UAV imagers in complex scenes , 2017 .

[12]  Cyrill Stachniss,et al.  Fast and effective online pose estimation and mapping for UAVs , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Trond Løke,et al.  Real-time hyperspectral image processing for UAV applications, using HySpex Mjolnir-1024 , 2017, Defense + Security.

[14]  Christian Eling,et al.  Real-Time Single-Frequency GPS/MEMS-IMU Attitude Determination of Lightweight UAVs , 2015, Sensors.

[15]  E. Khoramshahi An Automatic Method for Adjustment of a Camera Calibration Room , 2017 .

[16]  Heikki Saari,et al.  Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture , 2013, Remote. Sens..

[17]  Erica Nocerino,et al.  Towards real-time underwater photogrammetry for subsea metrology applications , 2019, OCEANS 2019 - Marseille.

[18]  Kiwon Lee,et al.  Auto-Scaling of Geo-Based Image Processing in an OpenStack Cloud Computing Environment , 2016, Remote. Sens..

[19]  James Nightingale,et al.  A UAV-Cloud System for Disaster Sensing Applications , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[20]  E. Honkavaara,et al.  Geometric Calibration of a Hyperspectral Frame Camera , 2016 .