Refining the Interior Orientation of a Hyperspectral Frame Camera With Preliminary Bands Co-Registration

Lightweight hyperspectral sensors carried by unmanned aerial vehicles (UAVs) are becoming powerful remote sensing tools for several applications, for example, forestry and agriculture. Sequential frame acquisition by scanning the spectral bands with tunable Fabry–Pérot interferometer (FPI) is one of the technologies suitable for these applications. The accurate co-registration of the individual bands to produce a hypercube and the bundle adjustment of all bands are still challenging tasks. Because of the geometry and internal optical components of this kind of camera, modeling of the interior geometry of the image bands requires more than a single set of interior orientation parameters (IOP). This paper developed a new method that applies a preliminary two-dimensional (2-D) geometric transformation to co-register all bands, based on projective parameters estimated during the calibration process. This preprocessing avoids the use of several sets of IOPs, simplifying the computation of image orientation with bundle adjustment. Experiments using a close range calibration setup and a UAV-based aerial image block showed that the new method was effective and improved the accuracy of the three-dimensional (3-D) point determination. Accuracy of one times ground sample distance (GSD) in horizontal coordinates and 1.2 GSD in height coordinate was achieved in the bundle adjustment using a single set of IOPs.

[1]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[2]  Bing Zhang,et al.  A Method Suitable for Vicarious Calibration of a UAV Hyperspectral Remote Sensor , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Heikki Saari,et al.  Novel miniaturized hyperspectral sensor for UAV and space applications , 2009, Remote Sensing.

[4]  Nicolas Dobigeon,et al.  Hyperspectral Image Unmixing With LiDAR Data-Aided Spatial Regularization , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Eija Honkavaara,et al.  Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows , 2018, Remote. Sens..

[6]  Andy Lambrechts,et al.  Characterization of VNIR hyperspectral sensors with monolithically integrated optical filters , 2016 .

[7]  Eija Honkavaara,et al.  A STUDY ON THE VARIATIONS OF INNER ORIENTATION PARAMETERS OF A HYPERSPECTRAL FRAME CAMERA , 2018, ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[8]  Juha Suomalainen,et al.  A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles , 2014, Remote. Sens..

[9]  Tian Zhou,et al.  Boresight Calibration of GNSS/INS-Assisted Push-Broom Hyperspectral Scanners on UAV Platforms , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  T. Clarke,et al.  The Development of Camera Calibration Methods and Models , 1998 .

[11]  Melba M. Crawford,et al.  Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Ning Wang,et al.  Spectral Calibration of Hyperspectral Data Observed From a Hyperspectrometer Loaded on an Unmanned Aerial Vehicle Platform , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Michael Cramer,et al.  ON THE USE OF RPAS IN NATIONAL MAPPING - THE EUROSDR POINT OF VIEW , 2013 .

[14]  Heikki Saari,et al.  Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture , 2013, Remote. Sens..

[15]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[16]  Yukio Kosugi,et al.  Development of a Low-Cost, Lightweight Hyperspectral Imaging System Based on a Polygon Mirror and Compact Spectrometers , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Jim H. Chandler,et al.  Motion blur disturbs – the influence of motion‐blurred images in photogrammetry , 2014 .

[18]  Eija Honkavaara,et al.  Band registration of tuneable frame format hyperspectral UAV imagers in complex scenes , 2017 .

[19]  Juha Suomalainen,et al.  Generation of Spectral–Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Hans-Peter Röser,et al.  Hyperspectral Remote Sensing with the UAS “Stuttgarter Adler” – System Setup, Calibration and First Results , 2014 .

[21]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[22]  E. Honkavaara,et al.  Orientation and calibration requirements for hyperpectral imaging using UAVS: A case study , 2016 .

[23]  Almir Olivette Artero,et al.  UTILIZAÇÃO DE ALVOS CODIFICADOS DO TIPO ARUCO NA AUTOMAÇÃO DO PROCESSO DE CALIBRAÇÃO DE CÂMARAS , 2014 .

[24]  Yukio Kosugi,et al.  Characterization of Rice Paddies by a UAV-Mounted Miniature Hyperspectral Sensor System , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  E. Honkavaara,et al.  Geometric Calibration of a Hyperspectral Frame Camera , 2016 .