Documentation of heritage buildings using close‐range UAV images: dense matching issues, comparison and case studies

Three‐dimensional (3D) documentation of heritage buildings has long employed both image‐based and range‐based techniques. Unmanned aerial vehicles (UAVs) provide a particular advantage for image‐based techniques in acquiring aerial views, which are difficult to attain using classical terrestrial‐based methods. The technological development of optical sensors and dense matching algorithms also complement existing photogrammetric workflows for the documentation of heritage objects. In this paper, fundamental concepts in photogrammetry and 3D reconstruction based on structure from motion (SfM) will be briefly reviewed. Two case studies were performed using two types of UAVs, one being a state‐of‐the‐art platform dedicated to obtaining close‐range images. Comparisons with laser scanning data were performed and several issues regarding the aerial triangulation and dense matching results were assessed. The results show that although the dense matching of these UAV images may generate centimetre‐level precision, a further increase in precision is often hampered by the quality of the onboard sensor.

[1]  P. Wolf,et al.  Elements of Photogrammetry(with Applications in GIS) , 2000 .

[2]  E. Gülch,et al.  Automatic Control Point Measurement , 2001 .

[3]  P. Grussenmeyer,et al.  SOLUTIONS FOR EXTERIOR ORIENTATION IN PHOTOGRAMMETRY: A REVIEW , 2002 .

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[6]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[7]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[8]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Livio De Luca,et al.  Automated Image-Based Procedures for Accurate Artifacts 3D Modeling and Orthoimage Generation , 2011 .

[10]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[11]  Heiko Hirschmüller,et al.  Semi-Global Matching-Motivation, Developments and Applications , 2011 .

[12]  Fabio Remondino,et al.  UAV PHOTOGRAMMETRY FOR MAPPING AND 3D MODELING - CURRENT STATUS AND FUTURE PERSPECTIVES - , 2012 .

[13]  Marc Pierrot Deseilligny,et al.  Protocols and Assisted Tools for Effective Image-Based Modeling of Architectural Elements , 2012, EuroMed.

[14]  Thomas P. Kersten,et al.  Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview , 2012, EuroMed.

[15]  Daniel Muhle,et al.  Filling the holes – Potential of UAV-based photogrammetric façade modelling , 2012 .

[16]  Dieter Fritsch,et al.  IMAGE ACQUISITION AND MODEL SELECTION FOR MULTI-VIEW STEREO , 2013 .

[17]  Dieter Fritsch,et al.  Modeling Façade Structures Using Point Clouds From Dense Image Matching , 2013 .

[18]  Dieter Fritsch,et al.  Image based 3D Reconstruction in Cultural Heritage Preservation , 2013, ICINCO.

[19]  Valerio Baiocchi,et al.  UAV APPLICATION IN POST – SEISMIC ENVIRONMENT , 2013 .

[20]  C. Fraser.  AUTOMATIC CAMERA CALIBRATION IN CLOSE-RANGE PHOTOGRAMMETRY , 2013 .

[21]  Pedro Arias,et al.  Low-cost aerial unit for outdoor inspection of building façades , 2013 .

[22]  Erica Nocerino,et al.  Dense image matching: Comparisons and analyses , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[23]  Jan Boehm,et al.  Close-Range Photogrammetry and 3D Imaging , 2013 .

[24]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[25]  Pierre Grussenmeyer,et al.  Oblique Aerial Photography Tool for Building Inspection and Damage Assessment , 2014 .

[26]  Fabio Remondino,et al.  Critical factors and guidelines for 3D surveying and modelling in Cultural Heritage , 2014 .

[27]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[28]  F. Nex,et al.  OBLIQUE MULTI-CAMERA SYSTEMS - ORIENTATION AND DENSE MATCHING ISSUES , 2014 .

[29]  Andrea Adami,et al.  UAV-Based Photogrammetry and Integrated Technologies for Architectural Applications—Methodological Strategies for the After-Quake Survey of Vertical Structures in Mantua (Italy) , 2015, Sensors.

[30]  Fabio Menna,et al.  Digital 3D Borobudur – Integration of 3D surveying and modeling techniques , 2015 .

[31]  G. Caroti,et al.  Accuracy Assessment in Structure from Motion 3d Reconstruction from Uav-Born Images: the Influence of the Data Processing Methods , 2015 .

[32]  Diego González-Aguilera,et al.  Image-Based Modelling from Unmanned Aerial Vehicle (UAV) Photogrammetry: An Effective, Low-Cost Tool for Archaeological Applications , 2015 .

[33]  A. Habib,et al.  TARGET-BASED AND FEATURE-BASED CALIBRATION OF LOW-COST DIGITAL CAMERAS WITH LARGE FIELD-OF-VIEW , 2015 .

[34]  A. Azizi,et al.  ACCURACY IMPROVEMENT BY THE LEAST SQUARES IMAGE MATCHING EVALUATED ON THE CARTOSAT-1 , 2015 .

[35]  T. Luhmann,et al.  INVESTIGATIONS ON THE QUALITY OF THE INTERIOR ORIENTATION AND ITS IMPACT IN OBJECT SPACE FOR UAV PHOTOGRAMMETRY , 2015 .

[36]  H. Arefi,et al.  AN IMAGE-BASED TECHNIQUE FOR 3D BUILDING RECONSTRUCTION USING MULTI-VIEW UAV IMAGES , 2015 .

[37]  F. Chiabrando,et al.  SfM FOR ORTHOPHOTO GENERATION: A WINNING APPROACH FOR CULTURAL HERITAGE KNOWLEDGE , 2015 .

[38]  G. Grenzdörffer,et al.  SYMBIOSIS OF UAS PHOTOGRAMMETRY AND TLS FOR SURVEYING AND 3D MODELING OF CULTURAL HERITAGE MONUMENTS - A CASE STUDY ABOUT THE CATHEDRAL OF ST. NICHOLAS IN THE CITY OF GREIFSWALD , 2015 .

[39]  A. C. Morales,et al.  MULTI-CRITERIA ANALYSIS OF UAVS REGULATIONS IN 6 COUNTRIES USING THE ANALYTICAL HIERARCHICAL PROCESS AND EXPERT KNOWLEDGE , 2015 .

[40]  Pierre Grussenmeyer,et al.  Acquisition and Processing Experiences of Close Range UAV Images for the 3D Modeling of Heritage Buildings , 2016, EuroMed.

[41]  Stuart I. Granshaw,et al.  Photogrammetric Terminology: Third Edition , 2016 .

[42]  Pierre Grussenmeyer,et al.  CLOSE RANGE UAV ACCURATE RECORDING AND MODELING OFST-PIERRE-LE-JEUNE NEO-ROMANESQUE CHURCH IN STRASBOURG (FRANCE) , 2017 .

[43]  T. Schenk,et al.  Introduction to Photogrammetry , 2022 .