PHOTOGRAMMETRIC 3D RECONSTRUCTION IN MATLAB: DEVELOPMENT OF AFREE TOOL

Abstract. This paper presents the current state of development of a free Matlab tool for photogrammetric reconstruction developed at the University of Padova, Italy. The goal of this software is mostly educational, i.e. allowing students to have a close look to the specific steps which lead to the computation of a dense point cloud. As most of recently developed photogrammetric softwares, it is based on a Structure from Motion approach. Despite being mainly motivated by educational purposes, certain implementation details are clearly inspired by recent research works, e.g. limiting the computational burden of the feature matching by determining a suboptimal set of features to be considered, using information provided by external sensors to ease the matching process.

[1]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[2]  Marco Piras,et al.  Integration between TLS and UAV photogrammetry techniques for forestry applications , 2017 .

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  A. Scianna,et al.  MAIN FEATURES OF A 3D GIS FOR A MONUMENTAL COMPLEX WITH AN HISTORICAL-CULTURAL RELEVANCE , 2017 .

[7]  Giuseppe Salemi,et al.  Micrometer MultiResolution Laser Scanning of a Renaissance Medallion , 2012, EuroMed.

[8]  C. Fraser,et al.  Sensor modelling and camera calibration for close-range photogrammetry , 2016 .

[9]  Ayman Habib,et al.  Automatic calibration of low-cost digital cameras , 2003 .

[10]  Vassilis Gikas,et al.  Cooperative localization of unmanned aerial vehicles using GNSS, MEMS inertial, and UWB sensors , 2017 .

[11]  Ewelina Rupnik,et al.  Improving FOSS photogrammetric workflows for processing large image datasets , 2017, Open Geospatial Data, Software and Standards.

[12]  Caterina Balletti,et al.  Survey Methods for Seismic Vulnerability Assessment of Historical Masonry Buildings , 2017 .

[13]  Domenica Costantino,et al.  Process Modeling and Photogrammetric Production for Structural Investigations Concerning to the Collapse of Palazzo Edilizia in Salerno (Italy) , 2012, EuroMed.

[14]  Fabio Remondino,et al.  UAV PHOTOGRAMMETRY FOR MAPPING AND 3D MODELING - CURRENT STATUS AND FUTURE PERSPECTIVES - , 2012 .

[15]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[16]  Kai-Wei Chiang,et al.  The Development of an UAV Borne Direct Georeferenced Photogrammetric Platform for Ground Control Point Free Applications , 2012, Sensors.

[17]  F. Fissore,et al.  DIGITAL MODEL OF WALLS OF PADUA LOW RELIEF , 2017 .

[18]  Wilfried Linder,et al.  Digital Photogrammetry: A Practical Course , 2016 .

[19]  Alberto Guarnieri,et al.  3D modeling of close-range objects: photogrammetry or laser scanning? , 2005 .

[20]  M. Lindstaedt,et al.  3D ACQUISITION, MODELLING AND VISUALIZATION OF NORTH GERMAN CASTLES BY DIGITAL ARCHITECTURAL PHOTOGRAMMETRY , 2004 .

[21]  Andrea Masiero,et al.  A Low Cost UWB Based Solution for Direct Georeferencing UAV Photogrammetry , 2017, Remote. Sens..

[22]  Vassilis Gikas,et al.  Rigorous Performance Evaluation of Smartphone GNSS/IMU Sensors for ITS Applications , 2016, Sensors.

[23]  Christian Laugier,et al.  2-Point-based outlier rejection for camera-IMU systems with applications to micro aerial vehicles , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  C. Fraser,et al.  AUTOMATED TARGET-FREE CAMERA CALIBRATION , 2014 .

[25]  Andrea Masiero,et al.  Improved Feature Matching for Mobile Devices with IMU , 2016, Sensors.

[26]  Domenico Visintini,et al.  Geomatic 3d Modeling of a Statue (also) for Structural Analysis and Risk Evaluation: the Example of San Giovannino Martelli in Florence , 2017 .

[27]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[28]  Naser El-Sheimy,et al.  SMARTPHONES BASED MOBILE MAPPING SYSTEMS , 2014 .

[29]  Martin Byröd,et al.  Conjugate Gradient Bundle Adjustment , 2010, ECCV.

[30]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Ayman Habib,et al.  Automated Relative Orientation of UAV-Based Imagery in the Presence of Prior Information for the Flight Trajectory , 2016 .

[32]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Davide Marenchino,et al.  Performance Analysis of the SIFT Operator for Automatic Feature Extraction and Matching in Photogrammetric Applications , 2009, Sensors.

[34]  A. Masiero,et al.  UAV POSITIONING AND COLLISION AVOIDANCE BASED ON RSS MEASUREMENTS , 2015 .

[35]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[36]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[37]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[38]  Selim Benhimane,et al.  Gravity-aware handheld Augmented Reality , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[39]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .