Robust and adaptive band-to-band image transform of UAS miniature multi-lens multispectral camera

Abstract Utilizing miniature multispectral (MS) or hyperspectral (HS) cameras by mounting them on an Unmanned Aerial System (UAS) has the benefits of convenience and flexibility to collect remote sensing imagery for precision agriculture, vegetation monitoring, and environment investigation applications. Most miniature MS cameras adopt a multi-lens structure to record discrete MS bands of visible and invisible information. The differences in lens distortion, mounting positions, and viewing angles among lenses mean that the acquired original MS images have significant band misregistration errors. We have developed a Robust and Adaptive Band-to-Band Image Transform (RABBIT) method for dealing with the band co-registration of various types of miniature multi-lens multispectral cameras (Mini-MSCs) to obtain band co-registered MS imagery for remote sensing applications. The RABBIT utilizes modified projective transformation (MPT) to transfer the multiple image geometry of a multi-lens imaging system to one sensor geometry, and combines this with a robust and adaptive correction (RAC) procedure to correct several systematic errors and to obtain sub-pixel accuracy. This study applies three state-of-the-art Mini-MSCs to evaluate the RABBIT method’s performance, specifically the Tetracam Miniature Multiple Camera Array (MiniMCA), Micasense RedEdge, and Parrot Sequoia. Six MS datasets acquired at different target distances and dates, and locations are also applied to prove its reliability and applicability. Results prove that RABBIT is feasible for different types of Mini-MSCs with accurate, robust, and rapid image processing efficiency.

[1]  Diofantos G. Hadjimitsis,et al.  Evaluation of Broadband and Narrowband Vegetation Indices for the Identification of Archaeological Crop Marks , 2012, Remote. Sens..

[2]  Jiann-Yeou Rau,et al.  Band-to-band registration and ortho-rectification of multilens/multispectral imagery: A case study of MiniMCA-12 acquired by a fixed-wing UAS , 2016 .

[3]  J. Tamás,et al.  Analysis of a small agricultural watershed using remote sensing techniques , 2006 .

[4]  Torsten Prinz,et al.  Analysis of Unmanned Aerial System-Based CIR Images in Forestry—A New Perspective to Monitor Pest Infestation Levels , 2015 .

[5]  Gordon Petrie,et al.  Airborne digital imaging technology: a new overview , 2007 .

[6]  Eija Honkavaara,et al.  Band registration of tuneable frame format hyperspectral UAV imagers in complex scenes , 2017 .

[7]  Aiwu Zhang,et al.  A Multispectral Image Creating Method for a New Airborne Four-Camera System with Different Bandpass Filters , 2015, Sensors.

[8]  Charles K. Toth,et al.  Remote sensing platforms and sensors: A survey , 2016 .

[9]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[10]  P. Zarco-Tejada,et al.  Modelling PRI for water stress detection using radiative transfer models , 2009 .

[11]  Albert Rango,et al.  Multispectral Remote Sensing from Unmanned Aircraft: Image Processing Workflows and Applications for Rangeland Environments , 2011, Remote. Sens..

[12]  Agnès Bégué,et al.  Can Commercial Digital Cameras Be Used as Multispectral Sensors? A Crop Monitoring Test , 2008, Sensors.

[13]  J. Baluja,et al.  Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV) , 2012, Irrigation Science.

[14]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[15]  Heikki Saari,et al.  Remote Sensing of 3-D Geometry and Surface Moisture of a Peat Production Area Using Hyperspectral Frame Cameras in Visible to Short-Wave Infrared Spectral Ranges Onboard a Small Unmanned Airborne Vehicle (UAV) , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yubin Lan,et al.  An Airborne Multispectral Imaging System Based on Two Consumer-Grade Cameras for Agricultural Remote Sensing , 2014, Remote. Sens..

[17]  K. Swain,et al.  Adoption of an unmanned helicopter for low-altitude remote sensing to estimate yield and total biomass of a rice crop. , 2010 .

[18]  Arko Lucieer,et al.  Sensor Correction of a 6-Band Multispectral Imaging Sensor for UAV Remote Sensing , 2012, Remote. Sens..

[19]  Yubin Lan,et al.  Multispectral imaging systems for airborne remote sensing to support agricultural production management , 2010 .

[20]  F. López-Granados,et al.  Configuration and Specifications of an Unmanned Aerial Vehicle (UAV) for Early Site Specific Weed Management , 2013, PloS one.

[21]  Konstantinos Karantzalos,et al.  Automatic Descriptor-Based Co-Registration of Frame Hyperspectral Data , 2014, Remote. Sens..

[22]  H. Saari,et al.  2D HYPERSPECTRAL FRAME IMAGER CAMERA DATA IN PHOTOGRAMMETRIC MOSAICKING , 2013 .

[23]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[24]  Sharon A. Robinson,et al.  Spatial Co-Registration of Ultra-High Resolution Visible, Multispectral and Thermal Images Acquired with a Micro-UAV over Antarctic Moss Beds , 2014, Remote. Sens..

[25]  Craig S. T. Daughtry,et al.  NIR-Green-Blue High-Resolution Digital Images for Assessment of Winter Cover Crop Biomass , 2011 .

[26]  S. Sankaran,et al.  Low-altitude, high-resolution aerial imaging systems for row and field crop phenotyping: A review , 2015 .

[27]  John J. Sulik,et al.  Spectral considerations for modeling yield of canola , 2016 .

[28]  N. Coops,et al.  Monitoring plant condition and phenology using infrared sensitive consumer grade digital cameras , 2014 .

[29]  Chenghai Yang,et al.  Evaluation of an Airborne Remote Sensing Platform Consisting of Two Consumer-Grade Cameras for Crop Identification , 2016, Remote. Sens..

[30]  Won Suk Lee,et al.  Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees , 2013 .