Towards Generation of Effective 3D Surface Models from UAV Imagery Using Open Source Tools

There has been increasing popularity in large scale mapping for deriving 3D surface and elevation models of earth and building structures. The techniques of computer vision comprising feature detections and matching and photogrammetry play an important role in deriving near accurate 3D reconstruction of scenes from 2D images. Since the images captured by the unmanned aerial vehicle (UAVs) are of high resolution, there is need for more sophisticated processing and analysis of the imagery to generate 3D models and other useful imagery products. The open source softwares are excellent tools for research and can be modified or changed to suit our model, as specific or combinations of algorithms behave differently based on the nature of UAV image scene to be processed. Though many algorithms are available for performing feature extractions from images, few studies have been carried out to identify suitable detector algorithms to be used based on the nature of image or scene that the UAV captures. An attempt has been made to understand and analyse the suitability of feature detection and descriptor algorithms for different scene types. This article also describes the popular technique called structure from motion process pipeline for sequential processing of UAV images with high overlapping, which involves the estimation of 3D point clouds from the keypoint correspondences. The relative accuracy of the 3D point cloud derived from our approach is comparable with similar output from other state-of-the-art UAV processing systems and is found to match with high precision.

[1]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Mark A. Fonstad,et al.  Topographic structure from motion: a new development in photogrammetric measurement , 2013 .

[3]  Upendra Oli,et al.  Generation of High Resolution DSM Using UAV Images , 2015 .

[4]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dieter Fritsch,et al.  EXTRACTION AND REGISTRATION OF REAL WORLD SCENES , 2006 .

[6]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Jean Ponce,et al.  Modeling 3D Objects from Stereo Views and Recognizing Them in Photographs , 2006, ECCV.

[8]  Michael Goesele,et al.  Let There Be Color! Large-Scale Texturing of 3D Reconstructions , 2014, ECCV.

[9]  Tomás Pajdla,et al.  Multi-view reconstruction preserving weakly-supported surfaces , 2011, CVPR 2011.

[10]  Ali Ismail Awad,et al.  Image Feature Detectors and Descriptors , 2016 .

[11]  Leif Kobbelt,et al.  Iterative multi - view plane fitting , 2006 .

[12]  S. Robson,et al.  Straightforward reconstruction of 3D surfaces and topography with a camera: Accuracy and geoscience application , 2012 .

[13]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[14]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Nan Yang,et al.  A Multi-View Dense Point Cloud Generation Algorithm Based on Low-Altitude Remote Sensing Images , 2016, Remote. Sens..

[18]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[19]  Marco Dubbini,et al.  Using Unmanned Aerial Vehicles (UAV) for High-Resolution Reconstruction of Topography: The Structure from Motion Approach on Coastal Environments , 2013, Remote. Sens..

[20]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[21]  Carlos Hernandez,et al.  Multi-View Stereo: A Tutorial , 2015, Found. Trends Comput. Graph. Vis..

[22]  N. Maiellaro,et al.  LASER SCANNER AND CAMERA-EQUIPPED UAV ARCHITECTURAL SURVEYS , 2015 .