An Image-Based Approach for the Co-Registration of Multi-Temporal UAV Image Datasets

During the past years, UAVs (Unmanned Aerial Vehicles) became very popular as low-cost image acquisition platforms since they allow for high resolution and repetitive flights in a flexible way. One application is to monitor dynamic scenes. However, the fully automatic co-registration of the acquired multi-temporal data still remains an open issue. Most UAVs are not able to provide accurate direct image georeferencing and the co-registration process is mostly performed with the manual introduction of ground control points (GCPs), which is time consuming, costly and sometimes not possible at all. A new technique to automate the co-registration of multi-temporal high resolution image blocks without the use of GCPs is investigated in this paper. The image orientation is initially performed on a reference epoch and the registration of the following datasets is achieved including some anchor images from the reference data. The interior and exterior orientation parameters of the anchor images are then fixed in order to constrain the Bundle Block Adjustment of the slave epoch to be aligned with the reference one. The study involved the use of two different datasets acquired over a construction site and a post-earthquake damaged area. Different tests have been performed to assess the registration procedure using both a manual and an automatic approach for the selection of anchor images. The tests have shown that the procedure provides results comparable to the traditional GCP-based strategy and both the manual and automatic selection of the anchor images can provide reliable results.

[1]  Davide Marenchino,et al.  Performance Analysis of the SIFT Operator for Automatic Feature Extraction and Matching in Photogrammetric Applications , 2009, Sensors.

[2]  Laurent Durieux,et al.  A method for monitoring building construction in urban sprawl areas using object-based analysis of Spot 5 images and existing GIS data , 2008 .

[3]  Antonia Teresa Spano,et al.  UAV PHOTOGRAMMETRY WITH OBLIQUE IMAGES: FIRST ANALYSIS ON DATA ACQUISITION AND PROCESSING , 2016 .

[4]  Martin Rutzinger,et al.  CHANGE DETECTION OF BUILDING FOOTPRINTS FROM AIRBORNE LASER SCANNING ACQUIRED IN SHORT TIME INTERVALS , 2010 .

[5]  Marco Piras,et al.  Monitoring post-fire forest recovery using multi-temporal Digital Surface Models generated from different platforms. , 2016 .

[6]  C. Strecha,et al.  PHOTOGRAMMETRIC PERFORMANCE OF AN ULTRA LIGHT WEIGHT SWINGLET UAV , 2012 .

[7]  M. Gerke,et al.  Automatic Structural Seismic Damage Assessment with Airborne Oblique Pictometry© Imagery , 2011 .

[8]  Christian Heipke,et al.  UAV-based photogrammetry: monitoring of a building zone , 2014 .

[9]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[10]  Laurence C. Smith,et al.  Automated Image Registration for Hydrologic Change Detection in the Lake-Rich Arctic , 2008, IEEE Geoscience and Remote Sensing Letters.

[11]  Zubair Ahmed Memon Utilization of photogrammetry techniques to digitalize the construction site progress , 2004 .

[12]  Gerald Cook Remote Sensing via UAVS , 2011 .

[13]  Rosa Lasaponara,et al.  On the use of Multisensor and multitemporal data for monitoring risk degradation and looting in archaeological site , 2015 .

[14]  E. Gülch PHOTOGRAMMETRIC EVALUATION OF MULTI-TEMPORAL FIXED WING UAV IMAGERY , 2012 .

[15]  B. J. Adams,et al.  IMPROVED DISASTER MANAGEMENT THROUGH POST-EARTHQUAKE BUILDING DAMAGE ASSESSMENT USING MULTITEMPORAL SATELLITE IMAGERY , 2004 .

[16]  N. Champion 2D BUILDING CHANGE DETECTION FROM HIGH RESOLUTION AERIAL IMAGES AND CORRELATION DIGITAL SURFACE MODELS , 2007 .

[17]  A. Ardeshir Goshtasby,et al.  Registration of multitemporal aerial optical images using line features , 2016 .

[18]  Filiberto Chiabrando,et al.  DIRECT PHOTOGRAMMETRY USING UAV: TESTS AND FIRST RESULTS , 2013 .

[19]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[20]  Osama Moselhi,et al.  Integrating Automated Data Acquisition Technologies for Progress Reporting of Construction Projects , 2009 .

[21]  K. Nurminen,et al.  ON GEOMETRIC PROCESSING OF MULTI-TEMPORAL IMAGE DATA COLLECTED BY LIGHT UAV SYSTEMS , 2012 .

[22]  AUTOMATIC DETECTION OF CHANGES FROM LASER SCANNER AND AERIAL IMAGE DATA FOR UPDATING BUILDING MAPS , 2004 .

[23]  Andrea Maria Lingua,et al.  Co-registration of multitemporal uav image datasets for monitoring applications: A new approach , 2016 .

[24]  Frank Dellaert,et al.  Structure from motion without correspondence , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[25]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[26]  Pierre Grussenmeyer,et al.  Oblique Aerial Photography Tool for Building Inspection and Damage Assessment , 2014 .

[27]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  J. Everaerts,et al.  THE USE OF UNMANNED AERIAL VEHICLES ( UAVS ) FOR REMOTE SENSING , 2008 .

[29]  Yan Songa,et al.  A MULTI-TEMPORAL IMAGE REGISTRATION METHOD BASED ON EDGE MATCHING AND MAXIMUM LIKELIHOOD ESTIMATION SAMPLE CONSENSUS , 2008 .

[30]  Birgit Kleinschmit,et al.  Robust Automated Image Co-Registration of Optical Multi-Sensor Time Series Data: Database Generation for Multi-Temporal Landslide Detection , 2014, Remote. Sens..

[31]  F. Remondinob,et al.  ORIENTATION OF OBLIQUE AIRBORNE IMAGE SETS-EXPERIENCES FROM THE ISPRS / EUROSDR BENCHMARK ON MULTI-PLATFORM PHOTOGRAMMETRY , 2016 .

[32]  Filiberto Chiabrando,et al.  UAV and RPV systems for photogrammetric surveys in archaelogical areas : two tests in the Piedmont region (Italy) , 2011 .

[33]  Markus Gerke,et al.  Accuracy analysis of photogrammetric UAV image blocks: influence of onboard RTK-GNSS and cross flight patterns , 2016 .

[34]  Nikos Komodakis,et al.  Simultaneous registration and change detection in multitemporal, very high resolution remote sensing data , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Caterina Balletti,et al.  3D INTEGRATED METHODOLOGIES FOR THE DOCUMENTATION AND THE VIRTUAL RECONSTRUCTION OF AN ARCHAEOLOGICAL SITE , 2015 .

[36]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[37]  Michael Cramer,et al.  EVALUATION OF A METRIC CAMERA SYSTEM TAILORED FOR HIGH PRECISION UAV APPLICATIONS , 2016 .

[38]  Jan Skaloud,et al.  A micro-UAV with the capability of direct georeferencing , 2013 .