Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry

Traditional imagery—provided, for example, by RGB and/or NIR sensors—has proven to be useful in many agroforestry applications. However, it lacks the spectral range and precision to profile materials and organisms that only hyperspectral sensors can provide. This kind of high-resolution spectroscopy was firstly used in satellites and later in manned aircraft, which are significantly expensive platforms and extremely restrictive due to availability limitations and/or complex logistics. More recently, UAS have emerged as a very popular and cost-effective remote sensing technology, composed of aerial platforms capable of carrying small-sized and lightweight sensors. Meanwhile, hyperspectral technology developments have been consistently resulting in smaller and lighter sensors that can currently be integrated in UAS for either scientific or commercial purposes. The hyperspectral sensors’ ability for measuring hundreds of bands raises complexity when considering the sheer quantity of acquired data, whose usefulness depends on both calibration and corrective tasks occurring in pre- and post-flight stages. Further steps regarding hyperspectral data processing must be performed towards the retrieval of relevant information, which provides the true benefits for assertive interventions in agricultural crops and forested areas. Considering the aforementioned topics and the goal of providing a global view focused on hyperspectral-based remote sensing supported by UAV platforms, a survey including hyperspectral sensors, inherent data processing and applications focusing both on agriculture and forestry—wherein the combination of UAV and hyperspectral sensors plays a center role—is presented in this paper. Firstly, the advantages of hyperspectral data over RGB imagery and multispectral data are highlighted. Then, hyperspectral acquisition devices are addressed, including sensor types, acquisition modes and UAV-compatible sensors that can be used for both research and commercial purposes. Pre-flight operations and post-flight pre-processing are pointed out as necessary to ensure the usefulness of hyperspectral data for further processing towards the retrieval of conclusive information. With the goal of simplifying hyperspectral data processing—by isolating the common user from the processes’ mathematical complexity—several available toolboxes that allow a direct access to level-one hyperspectral data are presented. Moreover, research works focusing the symbiosis between UAV-hyperspectral for agriculture and forestry applications are reviewed, just before the paper’s conclusions.

[1]  Guangyi Chen,et al.  Enhancing Spatial Resolution of Hyperspectral Imagery Using Sensor's Intrinsic Keystone Distortion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[3]  Stephan Getzin,et al.  Assessing biodiversity in forests using very high‐resolution images and unmanned aerial vehicles , 2012 .

[4]  Tim R. McVicar,et al.  Preprocessing EO-1 Hyperion hyperspectral data to support the application of agricultural indexes , 2003, IEEE Trans. Geosci. Remote. Sens..

[5]  Rolando Herrero,et al.  Preprocessing and compression of Hyperspectral images captured onboard UAVs , 2015, SPIE Security + Defence.

[6]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Antonio Maria Garcia Tommaselli,et al.  EXTERIOR ORIENTATION OF HYPERSPECTRAL FRAME IMAGES COLLECTED WITH UAV FOR FOREST APPLICATIONS , 2016 .

[8]  Nasser M. Nasrabadi,et al.  A comparative study of linear and nonlinear anomaly detectors for hyperspectral imagery , 2007, SPIE Defense + Commercial Sensing.

[9]  Heesung Kwon,et al.  Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Heikki Saari,et al.  Unmanned Aerial Vehicle (UAV) operated spectral camera system for forest and agriculture applications , 2011, Remote Sensing.

[11]  Olga Sykioti,et al.  Monitoring canopy biophysical and biochemical parameters in ecosystem scale using satellite hyperspectral imagery: An application on a Phlomis fruticosa Mediterranean ecosystem using multiangular CHRIS/PROBA observations , 2010 .

[12]  Pablo J. Zarco-Tejada,et al.  High-resolution airborne hyperspectral and thermal imagery for early detection of Verticillium wilt of olive using fluorescence, temperature and narrow-band spectral indices , 2013 .

[13]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[14]  Guoping Wang,et al.  Learning with progressive transductive support vector machine , 2003, Pattern Recognit. Lett..

[15]  Simon Bennertz,et al.  Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[16]  Ben H.P. Maathuis,et al.  A review of satellite and airborne sensors for remote sensing based detection of minefields and landmines , 2004 .

[17]  L. Scharf,et al.  The CFAR adaptive subspace detector is a scale-invariant GLRT , 1998, Ninth IEEE Signal Processing Workshop on Statistical Signal and Array Processing (Cat. No.98TH8381).

[18]  James E. Fowler,et al.  Compressive pushbroom and whiskbroom sensing for hyperspectral remote-sensing imaging , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[19]  R. Sahoo,et al.  Hyperspectral Remote Sensing , 2013, Encyclopedia of Mathematical Geosciences.

[20]  Lorenzo Bruzzone,et al.  Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  G. Mercier,et al.  Support vector machines for hyperspectral image classification with spectral-based kernels , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[22]  Stuart Barr,et al.  UAV-BORNE THERMAL IMAGING FOR FOREST HEALTH MONITORING: DETECTION OF DISEASE-INDUCED CANOPY TEMPERATURE INCREASE , 2015 .

[23]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[24]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  H. Aasen,et al.  The acquisition of Hyperspectral Digital Surface Models of crops from UAV snapshot cameras , 2016 .

[26]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[27]  Yukio Kosugi,et al.  Development of a Low-Cost Hyperspectral Whiskbroom Imager Using an Optical Fiber Bundle, a Swing Mirror, and Compact Spectrometers , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Eija Honkavaara,et al.  Using UAV-Based Photogrammetry and Hyperspectral Imaging for Mapping Bark Beetle Damage at Tree-Level , 2015, Remote. Sens..

[29]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[30]  Richard Gloaguen,et al.  The Need for Accurate Geometric and Radiometric Corrections of Drone-Borne Hyperspectral Data for Mineral Exploration: MEPHySTo - A Toolbox for Pre-Processing Drone-Borne Hyperspectral Data , 2017, Remote. Sens..

[31]  Gary A. Shaw,et al.  Hyperspectral subpixel target detection using the linear mixing model , 2001, IEEE Trans. Geosci. Remote. Sens..

[32]  Arko Lucieer,et al.  HyperUAS—Imaging Spectroscopy from a Multirotor Unmanned Aircraft System , 2014, J. Field Robotics.

[33]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[34]  Alan Schaum,et al.  Continuum fusion: a theory of inference, with applications to hyperspectral detection. , 2010, Optics express.

[35]  Eric Truslow,et al.  Comparison of hyperspectral change detection algorithms , 2015, SPIE Optical Engineering + Applications.

[36]  H. S. Chen Remote Sensing Calibration Systems: An Introduction , 1997 .

[37]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[38]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[39]  Paul M. Mather TERRA- 1: Understanding The Terrestrial Environment : The Role of Earth Observations from Space , 2003 .

[40]  Enric Pastor,et al.  UAV Flight Experiments Applied to the Remote Sensing of Vegetated Areas , 2014, Remote. Sens..

[41]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Qiming Qin,et al.  Hyperspectral vegetation indices for crop chlorophyll estimation: Assessment, modeling and validation , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[43]  Mustafa Teke,et al.  A short survey of hyperspectral remote sensing applications in agriculture , 2013, 2013 6th International Conference on Recent Advances in Space Technologies (RAST).

[44]  Subashisa Dutta,et al.  Spatial variability of chlorophyll and nitrogen content of rice from hyperspectral imagery , 2016 .

[45]  S Matteoli,et al.  A tutorial overview of anomaly detection in hyperspectral images , 2010, IEEE Aerospace and Electronic Systems Magazine.

[46]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[47]  Diofantos G. Hadjimitsis,et al.  Evaluation of Broadband and Narrowband Vegetation Indices for the Identification of Archaeological Crop Marks , 2012, Remote. Sens..

[48]  Berrin A. Yanikoglu,et al.  Deep Learning With Attribute Profiles for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[49]  Louis L. Scharf,et al.  Matched subspace detectors , 1994, IEEE Trans. Signal Process..

[50]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[51]  John R. Miller,et al.  Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture , 2004 .

[52]  F. Roy,et al.  CMOS image sensor: Process impact on dark current , 2014, 2014 IEEE International Reliability Physics Symposium.

[53]  Yukio Kosugi,et al.  Development of a Low-Cost, Lightweight Hyperspectral Imaging System Based on a Polygon Mirror and Compact Spectrometers , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Clive H. Bock,et al.  Plant Disease Severity Estimated Visually, by Digital Photography and Image Analysis, and by Hyperspectral Imaging , 2010 .

[55]  J. G. Lyon,et al.  Hyperspectral Remote Sensing of Vegetation , 2011 .

[56]  Roi Méndez-Rial,et al.  Accurate Implementation of Anisotropic Diffusion in the Hypercube , 2010, IEEE Geoscience and Remote Sensing Letters.

[57]  Renfu Lu,et al.  Hyperspectral and multispectral imaging for evaluating food safety and quality , 2013 .

[58]  Donato Malerba,et al.  A novel spectral-spatial co-training algorithm for the transductive classification of hyperspectral imagery data , 2017, Pattern Recognit..

[59]  Dimitris G. Manolakis,et al.  Hyperspectral matched filter with false-alarm mitigation , 2012 .

[60]  Matthew L. Clark,et al.  Mapping of land cover in northern California with simulated hyperspectral satellite imagery , 2016 .

[61]  D. Mulla Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps , 2013 .

[62]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[63]  F. Sabins,et al.  Remote sensing for mineral exploration , 1999 .

[64]  Aoife A. Gowen,et al.  Data handling in hyperspectral image analysis , 2011 .

[65]  Andreas Burkart,et al.  Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance , 2015 .

[66]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[67]  Heikki Saari,et al.  Hyperspectral imaging based biomass and nitrogen content estimations from light-weight UAV , 2013, Remote Sensing.

[68]  Lingling Ma,et al.  Land Surface Reflectance Retrieval from Hyperspectral Data Collected by an Unmanned Aerial Vehicle over the Baotou Test Site , 2013, PloS one.

[69]  Melba M. Crawford,et al.  Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[70]  K. Nurminen,et al.  NEW LIGHT-WEIGHT STEREOSOPIC SPECTROMETRIC AIRBORNE IMAGING TECHNOLOGY FOR HIGH-RESOLUTION ENVIRONMENTAL REMOTE SENSING – CASE STUDIES IN WATER QUALITY MAPPING , 2013 .

[71]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Amit Banerjee,et al.  A support vector method for anomaly detection in hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[73]  Irshad A. Mohammed,et al.  Advances in Hyperspectral Remote Sensing of Vegetation and Agricultural Crops , 2014, Fundamentals, Sensor Systems, Spectral Libraries, and Data Mining for Vegetation.

[74]  Alessandro Matese,et al.  A flexible unmanned aerial vehicle for precision agriculture , 2012, Precision Agriculture.

[75]  S. Fujimura,et al.  Nondestructive measurement of chlorophyll pigment content in plant leaves from three-color reflectance and transmittance. , 1991, Applied optics.

[76]  Pramod K. Varshney,et al.  Super-resolution land cover mapping using a Markov random field based approach , 2005 .

[77]  Heikki Saari,et al.  Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture , 2013, Remote. Sens..

[78]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[79]  Pablo J. Zarco-Tejada,et al.  Early Detection and Quantification of Verticillium Wilt in Olive Using Hyperspectral and Thermal Imagery over Large Areas , 2015, Remote. Sens..

[80]  Hoam Chung,et al.  Estimation of crop water stress in a nectarine orchard using high-resolution imagery from unmanned aerial vehicle (UAV) , 2015 .

[81]  Pablo J. Zarco-Tejada,et al.  Estimating leaf carotenoid content in vineyards using high resolution hyperspectral imagery acquired from an unmanned aerial vehicle (UAV) , 2013 .

[82]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[83]  Di Wu,et al.  Advanced applications of hyperspectral imaging technology for food quality and safety analysis and assessment: A review — Part II: Applications , 2013 .

[84]  Eric Truslow,et al.  False alarm mitigation techniques for hyperspectral target detection , 2013, Defense, Security, and Sensing.

[85]  Coulter Airborne Hyperspectral Remote Sensing , 2007 .

[86]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[87]  Matthew O. Anderson,et al.  Radiometric and Geometric Analysis of Hyperspectral Imagery Acquired from an Unmanned Aerial Vehicle , 2012, Remote. Sens..

[88]  Louis L. Scharf,et al.  Adaptive subspace detectors , 2001, IEEE Trans. Signal Process..

[89]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[90]  P. Zarco-Tejada,et al.  Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera , 2012 .

[91]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[92]  Bernard Jusserand,et al.  Fabry-Pérot-multichannel spectrometer tandem for ultra-high resolution Raman spectroscopy. , 2014, Review of Scientific Instruments.

[93]  Michael E. Crenshaw The total energy--momentum tensor for electromagnetic fields in a dielectric , 2017 .

[94]  Bosoon Park,et al.  Hyperspectral Imaging Technology in Food and Agriculture , 2015 .

[95]  Saldju Tadjudin,et al.  CLASSIFICATION OF HIGH DIMENSIONAL DATA WITH LIMITED TRAINING SAMPLES , 1998 .

[96]  Zhihao Qin,et al.  Estimating crop chlorophyll content with hyperspectral vegetation indices and the hybrid inversion method , 2016 .

[97]  Mairaj Din,et al.  Evaluating Hyperspectral Vegetation Indices for Leaf Area Index Estimation of Oryza sativa L. at Diverse Phenological Stages , 2017, Front. Plant Sci..

[98]  Jeffrey M. Sullivan,et al.  Evolution or revolution? the rise of UAVs , 2006, IEEE Technology and Society Magazine.

[99]  Wei Li,et al.  Transferred Deep Learning for Anomaly Detection in Hyperspectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[100]  Christina Corbane,et al.  Multitemporal analysis of hydrological soil surface characteristics using aerial photos: A case study on a Mediterranean vineyard , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[101]  P. Zarco-Tejada,et al.  Relationships between net photosynthesis and steady-state chlorophyll fluorescence retrieved from airborne hyperspectral imagery , 2013 .

[102]  Daniel R. Fuhrmann,et al.  A CFAR adaptive matched filter detector , 1992 .

[103]  N. Keshava,et al.  Distance metrics and band selection in hyperspectral processing with applications to material identification and spectral libraries , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[104]  Daniel Schläpfer,et al.  Operational Atmospheric Correction for Imaging Spectrometers Accounting for the Smile Effect , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[105]  C. Proctor,et al.  WORKFLOW FOR BUILDING A HYPERSPECTRAL UAV: CHALLENGES AND OPPORTUNITIES , 2015 .

[106]  Tom Burr,et al.  Performance of Variable Selection Methods in Regression Using Variations of the Bayesian Information Criterion , 2008, Commun. Stat. Simul. Comput..

[107]  Christ D. Richmond,et al.  Derived PDF of maximum likelihood signal estimator which employs an estimated noise covariance , 1996, IEEE Trans. Signal Process..

[108]  Aníbal Ollero,et al.  Journal of Intelligent & Robotic Systems manuscript No. (will be inserted by the editor) An Unmanned Aircraft System for Automatic Forest Fire Monitoring and Measurement , 2022 .

[109]  Luís Pádua,et al.  UAS, sensors, and data processing in agroforestry: a review towards practical applications , 2017 .

[110]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[111]  Heikki Saari,et al.  Hyperspectral reflectance signatures and point clouds for precision agriculture by light weight UAV imaging system , 2012 .

[112]  Qian Du,et al.  Hyperspectral image analysis using noise-adjusted principal component transform , 2006, SPIE Defense + Commercial Sensing.

[113]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[114]  Yukio Kosugi,et al.  Characterization of Rice Paddies by a UAV-Mounted Miniature Hyperspectral Sensor System , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[115]  E. J. Kelly An Adaptive Detection Algorithm , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[116]  N. Zhang,et al.  Precision agriculture—a worldwide overview , 2002 .

[117]  Heesung Kwon,et al.  A Comparative Analysis of Kernel Subspace Target Detectors for Hyperspectral Imagery , 2007, EURASIP J. Adv. Signal Process..

[118]  Andy Horcher,et al.  Unmanned Aerial Vehicles: Applications for Natural Resource Management and Monitoring , 2010 .

[119]  R. Glenn Sellar,et al.  Classification of imaging spectrometers for remote sensing applications , 2005 .

[120]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[121]  Luis O. Jimenez-Rodriguez,et al.  An update on the MATLAB hyperspectral image analysis toolbox , 2005 .

[122]  Eric Truslow,et al.  Detection Algorithms in Hyperspectral Imaging Systems: An Overview of Practical Algorithms , 2014, IEEE Signal Processing Magazine.

[123]  Dimitris G. Manolakis,et al.  Detection algorithms for hyperspectral imaging applications , 2002, IEEE Signal Process. Mag..

[124]  Edward J Kelly Adaptive detection in non-stationary interference, part 3 , 1987 .

[125]  Luis Alonso,et al.  Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer , 2015, Remote. Sens..

[126]  John R. Miller,et al.  Assessing vineyard condition with hyperspectral indices: Leaf and canopy reflectance simulation in a row-structured discontinuous canopy , 2005 .

[127]  Heikki Saari,et al.  A case study of a precision fertilizer application task generation for wheat based on classified hyperspectral data from UAV combined with farm history data , 2013, Remote Sensing.

[128]  Matthew O. Anderson,et al.  Unmanned aerial vehicle (UAV) hyperspectral remote sensing for dryland vegetation monitoring , 2012, 2012 4th Workshop on Hyperspectral Image and Signal Processing (WHISPERS).