Optimizing the Processing of UAV-Based Thermal Imagery

The current standard procedure for aligning thermal imagery with structure-from-motion (SfM) software uses GPS logger data for the initial image location. As input data, all thermal images of the flight are rescaled to cover the same dynamic scale range, but they are not corrected for changes in meteorological conditions during the flight. This standard procedure can give poor results, particularly in datasets with very low contrast between and within images or when mapping very complex 3D structures. To overcome this, three alignment procedures were introduced and tested: camera pre-calibration, correction of thermal imagery for small changes in air temperature, and improved estimation of the initial image position by making use of the alignment of RGB (visual) images. These improvements were tested and evaluated in an agricultural (low temperature contrast data) and an afforestation (complex 3D structure) dataset. In both datasets, the standard alignment procedure failed to align the images properly, either by resulting in point clouds with several gaps (images that were not aligned) or with unrealistic 3D structure. Using initial thermal camera positions derived from RGB image alignment significantly improved thermal image alignment in all datasets. Air temperature correction had a small yet positive impact on image alignment in the low-contrast agricultural dataset, but a minor effect in the afforestation area. The effect of camera calibration on the alignment was limited in both datasets. Still, in both datasets, the combination of all three procedures significantly improved the alignment, in terms of number of aligned images and of alignment quality.

[1]  Nithya Rajan,et al.  Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research , 2016, PloS one.

[2]  P. J. Zarco-Tejada,et al.  Detection of downy mildew of opium poppy using high-resolution multi-spectral and thermal imagery acquired with an unmanned aerial vehicle , 2014, Precision Agriculture.

[3]  P. Surový,et al.  Forest Stand Inventory Based on Combined Aerial and Terrestrial Close-Range Photogrammetry , 2016 .

[4]  S. M. Jong,et al.  Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography , 2014 .

[5]  M. Brook.  Structure from motion in the geosciences , 2017 .

[6]  Arko Lucieer,et al.  The Impact of the Calibration Method on the Accuracy of Point Clouds Derived Using Unmanned Aerial Vehicle Multi-View Stereopsis , 2015, Remote. Sens..

[7]  Alfredo Huete,et al.  Soil moisture controls on phenology and productivity in a semi-arid critical zone. , 2016, The Science of the total environment.

[8]  B. Muys,et al.  Does energy dissipation increase with ecosystem succession? Testing the ecosystem exergy theory combining theoretical simulations and thermal remote sensing observations , 2011 .

[9]  B. R. Christensen,et al.  Use of UAV or remotely piloted aircraft and forward-looking infrared in forest, rural and wildland fire management: evaluation using simple economic analysis , 2015, New Zealand Journal of Forestry Science.

[10]  J. Baluja,et al.  Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV) , 2012, Irrigation Science.

[11]  Arko Lucieer,et al.  Sensor Correction of a 6-Band Multispectral Imaging Sensor for UAV Remote Sensing , 2012, Remote. Sens..

[12]  Nasir M. Rajpoot,et al.  Automatic Detection of Regions in Spinach Canopies Responding to Soil Moisture Deficit Using Combined Visible and Thermal Imagery , 2014, PloS one.

[13]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[14]  Heikki Saari,et al.  Remote Sensing of 3-D Geometry and Surface Moisture of a Peat Production Area Using Hyperspectral Frame Cameras in Visible to Short-Wave Infrared Spectral Ranges Onboard a Small Unmanned Airborne Vehicle (UAV) , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Andrew M. Cunliffe,et al.  Ultra-fine grain landscape-scale quantification of dryland vegetation structure with drone-acquired structure-from-motion photogrammetry , 2016 .

[16]  Simon Bennertz,et al.  Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[17]  Sharon A. Robinson,et al.  Spatial Co-Registration of Ultra-High Resolution Visible, Multispectral and Thermal Images Acquired with a Micro-UAV over Antarctic Moss Beds , 2014, Remote. Sens..

[18]  Mark A. Fonstad,et al.  Topographic structure from motion: a new development in photogrammetric measurement , 2013 .

[19]  B. Muys,et al.  Biodiversity as insurance for sapling survival in experimental tree plantations , 2016 .

[20]  A. Kaiser,et al.  Erosion processes in calanchi in the Upper Orcia Valley, Southern Tuscany, Italy based on multitemporal high-resolution terrestrial LiDAR and UAV surveys , 2016 .

[21]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[22]  Pierre Karrasch,et al.  GENERATION OF MULTITEMPORAL THERMAL ORTHOPHOTOS FROM UAV DATA , 2013 .

[23]  Huadong Guo,et al.  Individual Tree Delineation in Windbreaks Using Airborne-Laser-Scanning Data and Unmanned Aerial Vehicle Stereo Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[24]  J. Monteith,et al.  Radiative surface temperature and energy balance of a wheat canopy , 1986 .

[25]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[26]  S. Chapman,et al.  A Direct Comparison of Remote Sensing Approaches for High-Throughput Phenotyping in Plant Breeding , 2016, Front. Plant Sci..

[27]  Pablo J. Zarco-Tejada,et al.  Mapping canopy conductance and CWSI in olive orchards using high resolution thermal remote sensing imagery , 2009 .

[28]  Michel Loreau,et al.  Contributions of a global network of tree diversity experiments to sustainable forest plantations , 2015, Ambio.

[29]  B. Muys,et al.  Assessment of the functional role of tree diversity: the multi-site FORBIO experiment , 2013 .

[30]  Matthew Bardeen,et al.  Selecting Canopy Zones and Thresholding Approaches to Assess Grapevine Water Status by Using Aerial and Ground-Based Thermal Imaging , 2016, Remote. Sens..

[31]  Jiancheng Fang,et al.  Design of orientation estimation system by inertial and magnetic sensors , 2014 .

[32]  Pablo J. Zarco-Tejada,et al.  Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Pablo J. Zarco-Tejada,et al.  Applicability and limitations of using the crop water stress index as an indicator of water deficits in citrus orchards , 2014 .

[34]  Bernhard Rinner,et al.  A fast and mobile system for registration of low-altitude visual and thermal aerial images using multiple small-scale UAVs , 2015 .

[35]  S. Tesfamichael,et al.  Unmanned Aerial Vehicle (UAV) Photogrammetry Produces Accurate High-resolution Orthophotos, Point Clouds and Surface Models for Mapping Wetlands , 2016 .

[36]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[37]  Arko Lucieer,et al.  Time Series Analysis of Landslide Dynamics Using an Unmanned Aerial Vehicle (UAV) , 2015, Remote. Sens..

[38]  W. Maes,et al.  Early detection of Psa infection in kiwifruit by means of infrared thermography at leaf and orchard scale. , 2014, Functional plant biology : FPB.

[39]  W. Maes,et al.  Estimating evapotranspiration and drought stress with ground-based thermal remote sensing in agriculture: a review. , 2012, Journal of experimental botany.

[40]  E. Fereres,et al.  Using high resolution UAV thermal imagery to assess the variability in the water status of five fruit tree species within a commercial orchard , 2013, Precision Agriculture.

[41]  Jérôme Théau,et al.  Visible and thermal infrared remote sensing for the detection of white‐tailed deer using an unmanned aerial system , 2016 .

[42]  L. Wallace,et al.  Assessment of Forest Structure Using Two UAV Techniques: A Comparison of Airborne Laser Scanning and Structure from Motion (SfM) Point Clouds , 2016 .

[43]  Sandra Johnson,et al.  Unmanned Aerial Vehicles (UAVs) and Artificial Intelligence Revolutionizing Wildlife Monitoring and Conservation , 2016, Sensors.

[44]  H. Jones,et al.  Plants and Microclimate. , 1985 .

[45]  H. Jones.  Plants and Microclimate: Other environmental factors: wind, altitude, climate change and atmospheric pollutants , 2013 .

[46]  Arko Lucieer,et al.  Obtaining biophysical measurements of woody vegetation from high resolution digital aerial photography in tropical and arid environments: Northern Territory, Australia , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[47]  W. Maes,et al.  Productivity, stand dynamics and the selection effect in a mixed willow clone short rotation coppice plantation , 2016 .

[48]  Pablo J. Zarco-Tejada,et al.  Estimating evaporation with thermal UAV data and two-source energy balance models , 2016 .

[49]  José A. Sobrino,et al.  A Comparative Study of Land Surface Emissivity Retrieval from NOAA Data , 2001 .

[50]  Samuel Ortega-Farías,et al.  Estimation of Energy Balance Components over a Drip-Irrigated Olive Orchard Using Thermal and Multispectral Cameras Placed on a Helicopter-Based Unmanned Aerial Vehicle (UAV) , 2016, Remote. Sens..