An Improved Vision Method for Robust Monitoring of Multi-Point Dynamic Displacements with Smartphones in an Interference Environment

Current research on dynamic displacement measurement based on computer vision mostly requires professional high-speed cameras and an ideal shooting environment to ensure the performance and accuracy of the analysis. However, the high cost of the camera and strict requirements of sharp image contrast and stable environment during the shooting process limit the broad application of the technology. This paper proposes an improved vision method to implement multi-point dynamic displacement measurements with smartphones in an interference environment. A motion-enhanced spatio-temporal context (MSTC) algorithm is developed and applied together with the optical flow (OF) algorithm to realize a simultaneous tracking and dynamic displacement extraction of multiple points on a vibrating structure in the interference environment. Finally, a sine-sweep vibration experiment on a cantilever sphere model is presented to validate the feasibility of the proposed method in a wide-band frequency range. In the test, a smartphone was used to shoot the vibration process of the sine-sweep-excited sphere, and illumination change, fog interference, and camera jitter were artificially simulated to represent the interference environment. The results of the proposed method are compared to conventional displacement sensor data and current vision method results. It is demonstrated that, in an interference environment, (1) the OF method is prone to mismatch the feature points and leads to data deviated or lost; (2) the conventional STC method is sensitive to target selection and can effectively track those targets having a large proportion of pixels in the context with motion tendency similar to the target center; (3) the proposed MSTC method, however, can ease the sensitivity to target selection through in-depth processing of the information in the context and finally enhance the robustness of the target tracking. In addition, the MSTC method takes less than one second to track each target between adjacent frame images, implying a potential for online measurement.

[1]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[2]  Yao Lu,et al.  Robust tracking via weighted spatio-temporal context learning , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  F. Necati Catbas,et al.  Completely contactless structural health monitoring of real‐life structures using cameras and computer vision , 2017 .

[4]  Hongjin Kim,et al.  Reliability verification of a vision-based dynamic displacement measurement for system identification , 2019, Journal of Wind Engineering and Industrial Aerodynamics.

[5]  Thomas Schumacher,et al.  Eulerian‐based virtual visual sensors to measure dynamic displacements of structures , 2017 .

[6]  Sung-Han Sim,et al.  Computer Vision-Based Structural Displacement Measurement Robust to Light-Induced Image Degradation for In-Service Bridges , 2017, Sensors.

[7]  Chuan-Zhi Dong,et al.  A Robust Vision-Based Method for Displacement Measurement under Adverse Environmental Factors Using Spatio-Temporal Context Learning and Taylor Approximation , 2019, Sensors.

[8]  Maria Q. Feng,et al.  Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection – A review , 2018 .

[9]  Ting-Hua Yi,et al.  Vision-based structural displacement measurement: System performance evaluation and influence factor analysis , 2016 .

[10]  Tadeusz Uhl,et al.  Vision‐based algorithms for damage detection and localization in structural health monitoring , 2016 .

[11]  David J. Fleet,et al.  Optical Flow Estimation , 2006, Handbook of Mathematical Models in Computer Vision.

[12]  Kyoung-Chan Lee,et al.  Long-term displacement measurement of full-scale bridges using camera ego-motion compensation , 2020 .

[13]  Mani Golparvar-Fard,et al.  Target‐free approach for vision‐based structural system identification using consumer‐grade cameras , 2016 .

[14]  Maria Q. Feng,et al.  Robust vision sensor for multi-point displacement monitoring of bridges in the field , 2018 .

[15]  Billie F. Spencer,et al.  Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring , 2019, Engineering.

[16]  Truong Q. Nguyen,et al.  Subpixel motion estimation without interpolation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[19]  Billie F. Spencer,et al.  Sensor Attitude Correction of Wireless Sensor Network for Acceleration-Based Monitoring of Civil Structures , 2015, Comput. Aided Civ. Infrastructure Eng..

[20]  Chuan-Zhi Dong,et al.  Marker-free monitoring of the grandstand structures and modal identification using computer vision methods , 2018, Structural Health Monitoring.

[21]  Mai Hanh Hong,et al.  Testing edible oil authenticity by using smartphone based spectrometer , 2020, Computer Optics.

[22]  Frédo Durand,et al.  Video Camera–Based Vibration Measurement for Civil Infrastructure Applications , 2017 .

[23]  Chuan-Zhi Dong,et al.  Structural displacement monitoring using deep learning-based full field optical flow methods , 2020, Structure and Infrastructure Engineering.

[24]  Maria Q. Feng,et al.  Nontarget Vision Sensor for Remote Measurement of Bridge Dynamic Response , 2015 .

[25]  Jie Tan,et al.  Non-Contact Measurement of the Surface Displacement of a Slope Based on a Smart Binocular Vision System , 2018, Sensors.

[26]  Chuan-Zhi Dong,et al.  A non-target structural displacement measurement method using advanced feature matching strategy , 2019, Advances in Structural Engineering.