Error control in UAV image acquisitions for 3D reconstruction of extensive architectures

This work describes a simple, fast, and robust method for identifying, checking and managing the overlapping image keypoints for 3D reconstruction of large objects with numerous geometric singularities and multiple features at different lighting levels. In particular a precision 3D reconstruction of an extensive architecture captured by aerial digital photogrammetry using Unmanned Aerial Vehicles (UAV) is developed. The method was experimentally applied to survey and reconstruct the ‘Saraceni’ Bridge’ at Adrano (Sicily), a valuable example of Roman architecture in brick of historical/cultural interest. The variety of features and different lighting levels required robust self-correlation techniques which would recognise features sometimes even smaller than a pixel in the digital images so as to automatically identify the keypoints necessary for image overlapping and 3D reconstruction. Feature Based Matching (FBM) was used for the low lighting areas like the intrados and the inner arch surfaces, and Area Based Matching (ABM) was used in conjunction to capture the sides and upper surfaces of the bridge. Applying SIFT (Scale Invariant Feature Transform) algorithm during capture helped find distinct features invariant to position, scale and rotation as well as robust for the affinity transformations (changes in scale, rotation, size and position) and lighting variations which are particularly effective in image overlapping. Errors were compared with surveys by total station theodolites, GPS and laser systems. The method can facilitate reconstruction of the most difficult to access parts like the arch intrados and the bridge cavities with high correlation indices.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  J. Fernández-Lozano,et al.  Improving archaeological prospection using localized UAVs assisted photogrammetry: An example from the Roman Gold District of the Eria River Valley (NW Spain) , 2016 .

[3]  Piergiovanni Marzocca,et al.  A 3D User and Maintenance Manual for UAVs and Commercial Aircrafts Based on Augmented Reality , 2015 .

[4]  Nikolay Strigul,et al.  Embedded, real-time UAV control for improved, image-based 3D scene reconstruction , 2016 .

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Rick S. Blum,et al.  Matching of images with projective distortion using transform invariant low-rank textures , 2016, Journal of Visual Communication and Image Representation.

[7]  Seiichiro Kagei,et al.  3D reconstruction and multiple point cloud registration using a low precision RGB-D sensor , 2016 .

[8]  Salim Chikhi,et al.  An ear biometric system based on artificial bees and the scale invariant feature transform , 2016, Expert Syst. Appl..

[9]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[10]  Meng Li,et al.  3D human motion retrieval using graph kernels based on adaptive graph construction , 2016, Comput. Graph..

[11]  K. S. Venkatesh,et al.  Planar epipolar constraint for UAV navigation , 2015, 2015 International Conference on Signal Processing, Computing and Control (ISPCC).

[12]  Neil Smith,et al.  Reconstructing building mass models from UAV images , 2016, Comput. Graph..

[13]  Francesca De Crescenzio,et al.  A First Implementation of an Advanced 3D Interface to Control and Supervise UAV (Uninhabited Aerial Vehicles) Missions , 2009, PRESENCE: Teleoperators and Virtual Environments.

[14]  Piergiovanni Marzocca,et al.  An Integrated Software Environment for UAV Missions Support , 2013 .

[15]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[16]  Menna,et al.  ACCURACY AND BLOCK DEFORMATION ANALYSIS IN AUTOMATIC UAV AND TERRESTRIAL PHOTOGRAMMETRY – LESSON LEARNT – , 2013 .