Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras

Low-cost unmanned airborne vehicles (UAVs) are emerging as a promising platform for remote-sensing data acquisition to satisfy the needs of wide range of applications. Utilizing UAVs, which are equipped with directly georeferenced RGB-frame cameras and hyperspectral push-broom scanners, for precision agriculture and high-throughput phenotyping is an important application that is gaining significant attention from researchers in the mapping and plant science fields. The advantages of UAVs as mobile-mapping platforms include low cost, ease of storage and deployment, ability to fly lower and collect high-resolution data, and filling an important gap between wheel-based and manned-airborne platforms. However, limited endurance and payload are the main disadvantages of consumer-grade UAVs. These limitations lead to the adoption of low-quality direct georeferencing and imaging systems, which in turn will impact the quality of the delivered products. Thanks to recent advances in sensor calibration and automated triangulation, accurate mapping using low-cost frame imaging systems equipped with consumer-grade georeferencing units is feasible. Unfortunately, the quality of derived geospatial information from push-broom scanners is quite sensitive to the performance of the implemented direct georeferencing unit. This paper presents an approach for improving the orthorectification of hyperspectral push-broom scanner imagery with the help of generated orthophotos from frame cameras using tie point and linear features, while modeling the impact of residual artifacts in the direct georeferencing information. The performance of the proposed approach has been verified through real datasets that have been collected by quadcopter and fixed-wing UAVs over an agricultural field.

[1]  A. Habib,et al.  Multi-sensor Aerial Triangulation , 1998 .

[2]  L. Rieseberg,et al.  Agriculture: Feeding the future , 2013, Nature.

[3]  M. Cannon,et al.  An integrated INS/GPS approach to the georeferencing of remotely sensed data , 1993 .

[4]  P. Reinartz,et al.  A program for direct georeferencing of airborne and spaceborne line scanner images , 2002 .

[5]  Changjae Kim,et al.  Comprehensive Analysis of Sensor Modeling Alternatives for High Resolution Imaging Satellites , 2007 .

[6]  A. Habib,et al.  TARGET-BASED AND FEATURE-BASED CALIBRATION OF LOW-COST DIGITAL CAMERAS WITH LARGE FIELD-OF-VIEW , 2015 .

[7]  Arko Lucieer,et al.  HyperUAS—Imaging Spectroscopy from a Multirotor Unmanned Aircraft System , 2014, J. Field Robotics.

[8]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[9]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[10]  W. R. Windham,et al.  CALIBRATION OF A PUSHBROOM HYPERSPECTRAL IMAGING SYSTEM FOR AGRICULTURAL INSPECTION , 2003 .

[11]  Ayman Habib,et al.  ALTERNATIVE PROCEDURES FOR THE INCORPORATION OF LIDAR-DERIVED LINEAR AND AREAL FEATURES FOR PHOTOGRAMMETRIC GEO-REFERENCING , 2008 .

[12]  F. Ackermann GEO-REFERENCING WITHOUT GROUND CONTROL , 1998 .

[13]  Jose A. Jiménez-Berni,et al.  Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping , 2014 .

[14]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[15]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[16]  Chulhee Lee,et al.  Rigorous Mathematical Modeling of Airborne Pushbroom Imaging Systems An accurate HYDICE rectification is obtained using a Gauss-Markov technique that exploits linear feature triangulation , 2000 .

[17]  A. Habib,et al.  Bundle Adjustment with Self–Calibration Using Straight Lines , 2002 .

[18]  Fabio Remondino,et al.  UAV PHOTOGRAMMETRY FOR MAPPING AND 3D MODELING - CURRENT STATUS AND FUTURE PERSPECTIVES - , 2012 .

[19]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[20]  Juha Suomalainen,et al.  A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles , 2014, Remote. Sens..

[21]  David A. Landgrebe,et al.  GEOMETRIC REGISTRATION AND CLASSIFICATION OF HYPERSPECTRAL AIRBORNE PUSHBROOM DATA , 2000 .

[22]  Nancy F. Glenn,et al.  Remote sensing of sagebrush canopy nitrogen , 2012 .

[23]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[24]  Arno Ruckelshausen,et al.  BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding , 2013, Sensors.

[25]  Ayman Habib,et al.  Line‐based modified iterated Hough transform for automatic registration of multi‐source imagery , 2004 .

[26]  C. Lee,et al.  Georegistration of airborne hyperspectral image data , 2001, IEEE Trans. Geosci. Remote. Sens..

[27]  Pablo J. Zarco-Tejada,et al.  Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Yoshio Inoue,et al.  Diagnostic mapping of canopy nitrogen content in rice based on hyperspectral measurements , 2012 .

[29]  Ayman Habib,et al.  Automated approach for rigorous light detection and ranging system calibration without preprocessing and strict terrain coverage requirements , 2012 .

[30]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[31]  Ayman Habib,et al.  STRAIGHT LINES IN LINEAR ARRAY SCANNER IMAGERY , 2010 .

[32]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[33]  Nicholas R. Gans,et al.  Low‐altitude Terrestrial Spectroscopy from a Pushbroom Sensor , 2016, J. Field Robotics.

[34]  Matthew O. Anderson,et al.  Radiometric and Geometric Analysis of Hyperspectral Imagery Acquired from an Unmanned Aerial Vehicle , 2012, Remote. Sens..

[35]  A. Habib,et al.  Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems , 2014 .

[36]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .