Robust vision sensor for multi-point displacement monitoring of bridges in the field

Abstract Computer vision sensors have great potential for accurate remote displacement monitoring in the field. This paper presents InnoVision, a video image processing technique developed by the authors to address a number of difficulties associated with the application of the vision sensors to monitoring structural displacement responses in the outdoor condition that are rarely comprehensively studied in literatures. First, limited lighting condition in the field presents a challenge to tracking low contrast features on the structural surface using intensity-based template matching algorithms. For tackling this challenge, a gradient based template matching algorithm is formulated. Second, to cost-effectively monitor structural displacements at multiple points using one camera, widely used interpolation subpixel methods are investigated and incorporated into InnoVision. Third, camera vibration in the field causes displacement measurement errors. A practical solution is proposed by applying the multi-point monitoring to track both the structure and a stationary reference point. The effect of the camera vibration can be canceled by subtracting the reference displacement from the structural displacements. Several laboratory and field tests are conducted to evaluate the InnoVision’s performance. One of the field tests is conducted in a challenging low lighting condition at night on a steel girder bridge to validate the robustness of InnoVision in comparison with two other vision sensing methods. Another field test is carried out on the Manhattan Bridge to demonstrate the efficacy of the proposed technique for canceling camera vibration and the capability of InnoVision to simultaneously monitor multiple points under the effect of camera vibration.

[1]  Frédo Durand,et al.  Video Camera–Based Vibration Measurement for Civil Infrastructure Applications , 2017 .

[2]  Rui Calçada,et al.  Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system , 2014 .

[3]  M. Figurski,et al.  A Bridge Deflection Monitoring with GPS , 2007 .

[4]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[5]  Hugh A. Bruck,et al.  Theoretical development for pointwise digital image correlation , 2005 .

[6]  Peng Cheng,et al.  In-plane displacements measurement by gradient-based digital image correlation , 2005, International Conference on Experimental Mechanics.

[7]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[8]  Sami F. Masri,et al.  A vision-based approach for the direct measurement of displacements in vibrating systems , 2003 .

[9]  Andrew W. Smyth,et al.  Bayesian model updating of a full‐scale finite element model with sensitivity‐based clustering , 2017 .

[10]  Maria Q. Feng,et al.  Vision Based Displacement Sensor with Heat Haze Filtering Capability , 2017 .

[11]  M. Feng,et al.  Micro Displacement and Strain Detection for Crack Prediction on Concrete Surface Using Optical Nondestructive Evaluation Methods , 2020 .

[12]  L Mayer,et al.  Monitoring of the Manhattan Bridge and interferometric radar systems , 2010 .

[13]  Kyle T. Wieghaus,et al.  Target-less computer vision for traffic signal structure vibration studies , 2015 .

[14]  M Pitter,et al.  Subpixel microscopic deformation analysis using correlation and artificial neural networks. , 2001, Optics express.

[15]  Tadeusz Uhl,et al.  Monitoring of a civil structure’s state based on noncontact measurements , 2013 .

[16]  Mehmet Çelebi,et al.  GPS in Dynamic Monitoring of Long-Period Structures , 2000 .

[17]  Ajay Mahajan,et al.  Measurement of Whole-Field Surface Displacements and Strain Using a Genetic Algorithm Based Intelligent Image Correlation Method , 2004 .

[18]  Shun-ichi Nakamura,et al.  GPS MEASUREMENT OF WIND-INDUCED SUSPENSION BRIDGE GIRDER DISPLACEMENTS , 2000 .

[19]  Hyo Seon Park,et al.  Vision-based system identification technique for building structures using a motion capture system , 2015 .

[20]  Maria Q. Feng,et al.  Vision-Based Displacement Sensor for Monitoring Dynamic Response Using Robust Object Search Algorithm , 2013 .

[21]  Manuel Guizar-Sicairos,et al.  Efficient subpixel image registration algorithms. , 2008, Optics letters.

[22]  Emanuele Zappa,et al.  Vision-based estimation of vertical dynamic loading induced by jumping and bobbing crowds on civil structures , 2012 .

[23]  Oral Büyüköztürk,et al.  Output-only computer vision based damage detection using phase-based optical flow and unscented Kalman filters , 2017 .

[24]  Jorge Batista,et al.  A vision-based system for measuring the displacements of large structures: Simultaneous adaptive calibration and full motion estimation , 2016 .

[25]  Nam-Sik Kim,et al.  Vision-based monitoring system for evaluating cable tensile forces on a cable-stayed bridge , 2013 .

[26]  Jong-Jae Lee,et al.  A vision-based system for remote sensing of bridge displacement , 2006 .

[27]  Xie Huimin,et al.  Performance of sub-pixel registration algorithms in digital image correlation , 2006 .

[28]  Hisao Kikuta,et al.  Bridge deflection measurement using digital image correlation , 2007 .

[29]  Hani Nassif,et al.  Comparison of laser Doppler vibrometer with contact sensors for monitoring bridge deflection and vibration , 2005 .

[30]  Emanuele Zappa,et al.  Vibration Monitoring of Multiple Bridge Points by Means of a Unique Vision-Based Measuring System , 2014 .

[31]  Neil A. Hoult,et al.  Monitoring of Rail Bridge Displacements Using Digital Image Correlation , 2015 .

[32]  Tadeusz Uhl,et al.  Vision‐based algorithms for damage detection and localization in structural health monitoring , 2016 .

[33]  A. Kääb,et al.  Sub-pixel precision image matching for measuring surface displacements on mass movements using normalized cross-correlation , 2011 .