Precise multi-image pointing (MIP) applied on convergence close-range photogrammetry images

Displacement measurement in large-scale structures (such as excavation walls) is one of the most important applications of close-range photogrammetry, in which achieving high precision requires extracting and accurately matching local features from convergent images. The purpose of this study is to introduce a new multi-image pointing (MIP) algorithm is introduced based on the characteristics of the geometric model generated from the initial matching. This self-adaptive algorithm is used to correct and improve the accuracy of the extracted positions from local features in the convergent images.,In this paper, the new MIP algorithm based on the geometric characteristics of the model generated from the initial matching was introduced, which in a self-adaptive way corrected the extracted image coordinates. The unique characteristics of this proposed algorithm were that the position correction was accomplished with the help of continuous interaction between the 3D model coordinates and the image coordinates and that it had the least dependency on the geometric and radiometric nature of the images. After the initial feature extraction and implementation of the MIP algorithm, the image coordinates were ready for use in the displacement measurement process. The combined photogrammetry displacement adjustment (CPDA) algorithm was used for displacement measurement between two epochs. Micro-geodesy, target-based photogrammetry and the proposed MIP methods were used in a displacement measurement project for an excavation wall in the Velenjak area in Tehran, Iran, to evaluate the proposed algorithm performance. According to the results, the measurement accuracy of the point geo-coordinates of 8 mm and the displacement accuracy of 13 mm could be achieved using the MIP algorithm. In addition to the micro-geodesy method, the accuracy of the results was matched by the cracks created behind the project’s wall. Given the maximum allowable displacement limit of 4 cm in this project, the use of the MIP algorithm produced the required accuracy to determine the critical displacement in the project.,Evaluation of the results demonstrated that the accuracy of 8 mm in determining the position of the points on the feature and the accuracy of 13 mm in the displacement measurement of the excavation walls could be achieved using precise positioning of local features on images using the MIP algorithm.The proposed algorithm can be used in all applications that need to achieve high accuracy in determining the 3D coordinates of local features in close-range photogrammetry.,Some advantages of the proposed MIP photogrammetry algorithm, including the ease of obtaining observations and using local features on the structure in the images rather than installing the artificial targets, make it possible to effectively replace micro-geodesy and instrumentation methods. In addition, the proposed MIP method is superior to the target-based photogrammetric method because it does not need artificial target installation and protection. Moreover, in each photogrammetric application that needs to determine the exact point coordinates on the feature, the proposed algorithm can be very effective in providing the possibility to achieve the required accuracy according to the desired objectives.

[1]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[2]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[3]  Luc Van Gool,et al.  Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions , 2000, BMVC.

[4]  Igor Shardakov,et al.  Deformation monitoring of load-bearing reinforced concrete beams , 2017 .

[5]  Ruinian Jiang.  Development of a digital photogrammetric system for bridge deflection measurement , 2005 .

[6]  Zhenzhong Xiao,et al.  Rapid three-dimension optical deformation measurement for transmission tower with different loads , 2010 .

[7]  Riadh Al-Mahaidi,et al.  An experimental investigation on shear behaviour of RC T-beams strengthened with CFRP using photogrammetry , 2008 .

[8]  Xiaohua Tong,et al.  Measurement of Surface Changes in a Scaled-Down Landslide Model Using High-Speed Stereo Image Sequences , 2016 .

[9]  Li Yan,et al.  Geometric-constrained multi-view image matching method based on semi-global optimization , 2018, Geo spatial Inf. Sci..

[10]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[11]  Masood Varshosaz,et al.  Displacement measurement of the soil nail walls by using close range photogrammetry and introduction of CPDA method , 2013 .

[12]  Daniel J Cerminaro,et al.  IMPLEMENTATION OF PHOTOGRAMMETRY TO IMPROVE PROACTIVE ASSESSMENT OF RETAINING WALLS ALONG TRANSPORTATION CORRIDORS , 2014 .

[13]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[14]  C. Heipke,et al.  Multi-view dense matching supported by triangular meshes , 2011 .

[15]  Daniel Rixen,et al.  Feasibility of monitoring large wind turbines using photogrammetry , 2010 .

[16]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[17]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[19]  Luigi Barazzetti,et al.  Photogrammetric techniques for monitoring tunnel deformation , 2014, Earth Science Informatics.

[20]  Ruinian Jiang,et al.  Development of a digital close-range photogrammetric bridge deflection measurement system , 2010 .

[21]  F. Bethmann,et al.  Object-based Multi-Image Semi-Global Matching - Concept and first results , 2014 .

[23]  Luigi Barazzetti,et al.  Image-based deformation measurement , 2015 .

[24]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[25]  M. Saadatseresht,et al.  Evaluation of Close-Range Photogrammetric Technique for Deformation Monitoring of Large-Scale Structures: A review , 2019 .

[26]  P. Miller.  Applications of 3D Measurement from Images , 2009 .

[27]  C. Fraser,et al.  Monitoring the thermal deformation of steel beams via vision metrology , 2000 .

[28]  R. Wepf,et al.  The ultrastructure of fibronectin fibers pulled from a protein monolayer at the air-liquid interface and the mechanism of the sheet-to-fiber transition , 2015, Biomaterials.

[29]  Clive S. Fraser,et al.  Hyper Redundancy for Accuracy Enhancement in Automated Close Range Photogrammetry , 2005 .

[30]  Thomas Luhmann,et al.  Close Range Photogrammetry , 2007 .

[31]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[32]  Thomas Oommen,et al.  A Novel Application of Photogrammetry for Retaining Wall Assessment , 2017 .

[33]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[34]  Clive S. Fraser,et al.  VISION-BASED, MULTI-EPOCH DEFORMATION MONITORING OF THE ATRIUM OF FEDERATION SQUARE , 2003 .

[35]  Mohammad Saadatseresht,et al.  Application of UAV Photogrammetry in Displacement Measurement of the Soil Nail Walls Using Local Features and CPDA Method , 2019, ISPRS Int. J. Geo Inf..

[36]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[37]  Clive S. Fraser.  Automated Vision Metrology:A Mature Technology for Industrial Inspection and Engineering Surveys , 2001 .

[38]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[39]  Robert L. Lytton,et al.  Measuring unsaturated soil deformations during triaxial testing using a photogrammetry-based method , 2016 .

[40]  Eduardo Júlio,et al.  Vision-SHM method for structural monitoring based on photogrammetric computer vision , 2017 .

[41]  X. Luo,et al.  Strain Field Measurements Using Digital Photogrammetry for Large Inflatable Structures , 2017, Experimental Techniques.

[42]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[43]  Luigi Barazzetti,et al.  Development and Implementation of Image-based Algorithms for Measurement of Deformations in Material Testing , 2010, Sensors.