The DOM Generation and Precise Radiometric Calibration of a UAV-Mounted Miniature Snapshot Hyperspectral Imager

Hyperspectral remote sensing is used in precision agriculture to remotely and quickly acquire crop phenotype information. This paper describes the generation of a digital orthophoto map (DOM) and radiometric calibration for images taken by a miniaturized snapshot hyperspectral camera mounted on a lightweight unmanned aerial vehicle (UAV). The snapshot camera is a relatively new type of hyperspectral sensor that can acquire an image cube with one spectral and two spatial dimensions at one exposure. The images acquired by the hyperspectral snapshot camera need to be mosaicked together to produce a DOM and radiometrically calibrated before analysis. However, the spatial resolution of hyperspectral cubes is too low to mosaic the images together. Furthermore, there are no systematic radiometric calibration methods or procedures for snapshot hyperspectral images acquired from low-altitude carrier platforms. In this study, we obtained hyperspectral imagery using a snapshot hyperspectral sensor mounted on a UAV. We quantitatively evaluated the radiometric response linearity (RRL) and radiometric response variation (RRV) and proposed a method to correct the RRV effect. We then introduced a method to interpolate position and orientation system (POS) information and generate a DOM with low spatial resolution and a digital elevation model (DEM) using a 3D mesh model built from panchromatic images with high spatial resolution. The relative horizontal geometric precision of the DOM was validated by comparison with a DOM generated from a digital RGB camera. A surface crop model (CSM) was produced from the DEM, and crop height for 48 sampling plots was extracted and compared with the corresponding field-measured crop height to verify the relative precision of the DEM. Finally, we applied two absolute radiometric calibration methods to the generated DOM and verified their accuracy via comparison with spectra measured with an ASD Field Spec Pro spectrometer (Analytical Spectral Devices, Boulder, CO, USA). The DOM had high relative horizontal accuracy, and compared with the digital camera-derived DOM, spatial differences were below 0.05 m (RMSE = 0.035). The determination coefficient for a regression between DEM-derived and field-measured crop height was 0.680. The radiometric precision was 5% for bands between 500 and 945 nm, and the reflectance curve in the infrared spectral region did not decrease as in previous research. The pixel and data sizes for the DOM corresponding to a field area of approximately 85 m × 34 m were small (0.67 m and approximately 13.1 megabytes, respectively), which is convenient for data transmission, preprocessing and analysis. The proposed method for radiometric calibration and DOM generation from hyperspectral cubes can be used to yield hyperspectral imagery products for various applications, particularly precision agriculture.

[1]  Wu Qiong,et al.  Field monitoring of wheat seedling stage with hyperspectral imaging , 2016 .

[2]  Lei Deng,et al.  Building change detection with RGB-D map generated from UAV images , 2016, Neurocomputing.

[3]  Xin Chen,et al.  Detecting ozone effects in four wheat cultivars using hyperspectral measurements under fully open-air field conditions , 2016 .

[4]  Andrew M. Cunliffe,et al.  Ultra-fine grain landscape-scale quantification of dryland vegetation structure with drone-acquired structure-from-motion photogrammetry , 2016 .

[5]  Zhou Zhang,et al.  Automated Ortho-Rectification of UAV-Based Hyperspectral Data over an Agricultural Field Using Frame RGB Imagery , 2016, Remote. Sens..

[6]  Nathaniel J. C. Libatique,et al.  UAV aerial imaging applications for post-disaster assessment, environmental management and infrastructure development , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Marco Bindi,et al.  Use of digital images to disclose canopy architecture in olive tree , 2016 .

[8]  Nicholas C. Coops,et al.  Invasive Shrub Mapping in an Urban Environment from Hyperspectral and LiDAR-Derived Attributes , 2016, Front. Plant Sci..

[9]  Chunjiang Zhao,et al.  Fast detection and visualization of early decay in citrus using Vis-NIR hyperspectral imaging , 2016, Comput. Electron. Agric..

[10]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[11]  A. Burkart,et al.  A Novel UAV-Based Ultra-Light Weight Spectrometer for Field Spectroscopy , 2014, IEEE Sensors Journal.

[12]  Yoav Y. Schechner,et al.  Portable polarimetric underwater imaging system with a linear response , 2004, SPIE Defense + Commercial Sensing.

[13]  Adrian Groza,et al.  Improving remote sensing crop classification by argumentation-based conflict resolution in ensemble learning , 2016, Expert Syst. Appl..

[14]  Marco Dubbini,et al.  Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images , 2015, Remote. Sens..

[15]  Shuang-Li Qi,et al.  Remote detection of canopy leaf nitrogen concentration in winter wheat by using water resistance vegetation indices from in-situ hyperspectral data , 2016 .

[16]  S. M. Jong,et al.  Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography , 2014 .

[17]  Junqing Yu,et al.  Dense 3D reconstruction combining depth and RGB information , 2016, Neurocomputing.

[18]  Andrea Adami,et al.  UAV-Based Photogrammetry and Integrated Technologies for Architectural Applications—Methodological Strategies for the After-Quake Survey of Vertical Structures in Mantua (Italy) , 2015, Sensors.

[19]  Enrico Natalizio,et al.  UAV-assisted disaster management: Applications and open issues , 2016, 2016 International Conference on Computing, Networking and Communications (ICNC).

[20]  Heikki Saari,et al.  A Process for Radiometric Correction of UAV Image Blocks Verfahren zur radiometrischen Korrektur von UAV Bildblöcken , 2012 .

[21]  Görres Grenzdörffer,et al.  Imagine All the Plants: Evaluation of a Light-Field Camera for On-Site Crop Growth Monitoring , 2016, Remote. Sens..

[22]  Johanna Link,et al.  Combined Spectral and Spatial Modeling of Corn Yield Based on Aerial Images and Crop Surface Models Acquired with an Unmanned Aircraft System , 2014, Remote. Sens..

[23]  Noel D.G. White,et al.  Detection of fungal infection and Ochratoxin A contamination in stored barley using near-infrared hyperspectral imaging , 2016 .

[24]  Bruce W. Pengra,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[25]  N.M. Nasrabadi.  Multisensor joint fusion and detection of mines using SAR and Hyperspectral , 2008, 2008 IEEE Sensors.

[26]  R. Jenssen,et al.  1 THE HYMAP TM AIRBORNE HYPERSPECTRAL SENSOR : THE SYSTEM , CALIBRATION AND PERFORMANCE , 1998 .

[27]  Mark W. Smith,et al.  From experimental plots to experimental landscapes: topography, erosion and deposition in sub‐humid badlands from Structure‐from‐Motion photogrammetry , 2015 .

[28]  Tapash Kumar Sarkar,et al.  Estimating Moisture Content of Cucumber Seedling Using Hyperspectral Imagery , 2016 .

[29]  Robert W. Basedow,et al.  HYDICE: an airborne system for hyperspectral imaging , 1993, Defense, Security, and Sensing.

[30]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[31]  A. S. Mahiny,et al.  A comparison of four common atmospheric correction methods , 2007 .

[32]  D. Mulla.  Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps , 2013 .

[33]  Arko Lucieer,et al.  Assessing the Accuracy of Georeferenced Point Clouds Produced via Multi-View Stereopsis from Unmanned Aerial Vehicle (UAV) Imagery , 2012, Remote. Sens..

[34]  Xiang-Dong Liu,et al.  Early assessment of the yield loss in rice due to the brown planthopper using a hyperspectral remote sensing method , 2016 .

[35]  Edward J. Milton,et al.  Estimating the spectral response function of the CASI-2 , 2004 .

[36]  Simon Bennertz,et al.  Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging , 2014, Remote. Sens..

[37]  P. Milano,et al.  FULLY AUTOMATIC UAV IMAGE-BASED SENSOR ORIENTATION , 2010 .

[38]  Simon Bennertz,et al.  Introduction and preliminary results of a calibration for full-frame hyperspectral cameras to monitor agricultural crops with UAVs , 2014 .

[39]  Ning Wang,et al.  Spectral Calibration of Hyperspectral Data Observed From a Hyperspectrometer Loaded on an Unmanned Aerial Vehicle Platform , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Andreas Burkart,et al.  Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance , 2015 .

[41]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[42]  Arko Lucieer,et al.  HyperUAS—Imaging Spectroscopy from a Multirotor Unmanned Aircraft System , 2014, J. Field Robotics.

[43]  Chunhua Zhang,et al.  The application of small unmanned aerial systems for precision agriculture: a review , 2012, Precision Agriculture.

[44]  Xiang Wu,et al.  A Novel Method for Detection of Pieris rapae Larvae on Cabbage Leaves Using NIR Hyperspectral Imaging , 2016 .

[45]  Dan B. Goldman,et al.  Vignette and exposure calibration and compensation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[46]  Hiroya Yamano,et al.  Evaluation of DSMs generated from multi-temporal aerial photographs using emerging structure from motion–multi-view stereo technology , 2016 .

[47]  F. Visser,et al.  Quantifying submerged fluvial topography using hyperspatial resolution UAS imagery and structure from motion photogrammetry , 2015 .

[48]  Clement Atzberger,et al.  Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information Needs , 2013, Remote. Sens..

[49]  Manfred Ehlers,et al.  Multi-sensor image fusion for pansharpening in remote sensing , 2010 .

[50]  Pablo Rischbeck,et al.  Data fusion of spectral, thermal and canopy height parameters for improved yield prediction of drought stressed spring barley , 2016 .

[51]  Arko Lucieer,et al.  An Automated Technique for Generating Georectified Mosaics from Ultra-High Resolution Unmanned Aerial Vehicle (UAV) Imagery, Based on Structure from Motion (SfM) Point Clouds , 2012, Remote. Sens..

[52]  Eija Honkavaara,et al.  Digital Airborne Photogrammetry - A New Tool for Quantitative Remote Sensing? - A State-of-the-Art Review On Radiometric Aspects of Digital Photogrammetric Images , 2009, Remote. Sens..

[53]  Stephen Lin,et al.  Single-image vignetting correction using radial gradient symmetry , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Yi Ma,et al.  Evaluating chlorophyll density in winter oilseed rape (Brassica napus L.) using canopy hyperspectral red-edge parameters , 2016, Comput. Electron. Agric..