Robust In-Plane Structures Oscillation Monitoring by Terrestrial Photogrammetry

Oscillation monitoring commonly requires complex setups integrating various types of sensors associated with intensive computations to achieve an adequate rate of observations and accuracy. This research presents a simple, cost-effective approach that allows two-dimensional oscillation monitoring by terrestrial photogrammetry using non-metric cameras. Tedious camera calibration procedures are eliminated by using a grid target that allows geometric correction to be performed to the frame’s region of interest at which oscillations are monitored. Region-based convolutional neural networks (Faster R-CNN) techniques are adopted to minimize the light exposure limitations, commonly constraining applications of terrestrial photogrammetry. The proposed monitoring procedure is tested at outdoor conditions to check its reliability and accuracy and examining the effect of using Faster R-CNN on monitoring results. The proposed artificial intelligence (AI) aided oscillation monitoring allowed sub-millimeter accuracy monitoring with observation rates up to 60 frames per second and gained the benefit of high optical zoom offered by market available bridge cameras to monitor oscillation of targets 100 m apart with high accuracy.

[1]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[2]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jong Wan Hu,et al.  Recent Advances of Structures Monitoring and Evaluation Using GPS-Time Series Monitoring Systems: A Review , 2017, ISPRS Int. J. Geo Inf..

[4]  Ivan Detchev,et al.  Deformation monitoring with off-the-shelf digital cameras for civil engineering fatigue testing , 2014 .

[5]  Bihter Erol Evaluation of High-Precision Sensors in Structural Monitoring , 2010, Sensors.

[6]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[7]  Arcangelo Distante,et al.  Camera Calibration and 3D Reconstruction , 2020 .

[8]  Brian E. Granger,et al.  IPython: A System for Interactive Scientific Computing , 2007, Computing in Science & Engineering.

[9]  Pascal Monasse,et al.  A Precision Analysis of Camera Distortion Models , 2017, IEEE Trans. Image Process..

[10]  K. Jarrod Millman,et al.  Python for Scientists and Engineers , 2011, Comput. Sci. Eng..

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[14]  Eija Honkavaara,et al.  Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera , 2012, Sensors.

[15]  T. Pock,et al.  Point Clouds: Lidar versus 3D Vision , 2010 .

[16]  Kenneth R. White,et al.  Close-range photogrammetry applications in bridge measurement: Literature review , 2008 .

[17]  Luis Gómez,et al.  Zoom Dependent Lens Distortion Mathematical Models , 2012, Journal of Mathematical Imaging and Vision.

[18]  Faming Shao,et al.  Improved Faster R-CNN Traffic Sign Detection Based on a Second Region of Interest and Highly Possible Regions Proposal Network , 2019, Sensors.

[19]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Li Zhou,et al.  DEFORMATION MONITORING AND ANALYSIS OF LSP LANDSLIDE BASED ON GBINSAR , 2018 .

[21]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[22]  Wu Zhengyi,et al.  Deep Learning-based Defect Detection and Assessment for Engineering Structures , 2019 .

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Ivan Detchev,et al.  CASE STUDY OF BEAM DEFORMATION MONITORING USING CONVENTIONAL CLOSE RANGE PHOTOGRAMMETRY , 2011 .

[25]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Devrim Akca,et al.  PHOTOGRAMMETRIC DEFORMATION MONITORING OF THE SECOND BOSPHORUS BRIDGE IN ISTANBUL , 2014 .

[27]  V. Sathiesh Kumar,et al.  Efficient inception V2 based deep convolutional neural network for real-time hand action recognition , 2020, IET Image Process..

[28]  Zheng Yi Wu,et al.  Crack Detection and Segmentation Using Deep Learning with 3D Reality Mesh Model for Quantitative Assessment and Integrated Visualization , 2020, J. Comput. Civ. Eng..

[29]  Yan Xu,et al.  Vision-Based Bridge Deformation Monitoring , 2017, Front. Built Environ..

[30]  O R Kolbl METRIC OR NON-METRIC CAMERAS , 1976 .

[31]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[32]  John Olusegun Ogundare Precision Surveying: Principles and Geomatics Practice, The , 2015 .