Measurement of full-field displacement time history of a vibrating continuous edge from video

Abstract Video of a vibrating structural component provides dense continuous spatial information of motion compared to contact based sensors which are more localized. In order to harness such quantitative information, various Computer Vision based methods have been studied in the past few years. Computer vision algorithms that implement sparse optical flow, tracks the displacement of few selected texture rich patches of pixels corresponding to salient points of the structure, in subsequent frames of the video starting from the initial frame. The obtained displacement response of individual, spatially discrete, points of the structure denotes the Lagrangian representation of motion. Such vision based measurement already proved its potential in replacing the need for a contact based vibration measuring sensors. However, full-field vibration response of a structural component, in its operating condition, is vital for identifying heterogeneous mechanical properties as well as localize damages. In order to obtain full-field, spatially dense, vibration response, a large number of sensors are needed to be attached throughout the specimen’s surface, making it impractical. In such scenarios, the technique of Digital Image Correlation (DIC) is used to measure Lagrangian representation of motion using Computer Vision algorithms which implements dense optical flow. In DIC, the presence of much required rich optical textures is ensured by adding speckle paint on the surface of the specimen which can be easily tracked over subsequent frames of the video. But its application is limited to laboratory setups that cannot be implemented for full-scale real-world structural components that vibrate in its operating condition. Continuous edge of a moving object is a rich optical feature whose motion perpendicular to its orientation can be tracked in Lagrangian coordinates using optical flow. In this paper, a novel method of measuring full-field displacement response of a vibrating continuous edge of a structural component is proposed from its video. The proposed method computes both horizontal and vertical components of the Lagrangian displacement of each pixel of the edge for every frame in the video with sub-pixel accuracy. The method consists of applying d’Alembertian of Gaussian filter on the spatiotemporal video signal to convert the edge information into zero crossing signal which is tracked over time using the optical flow of edge. Intermittent and sparse noise in the obtained full-field displacement signal is removed using Robust Principal Component Analysis. Further, experimental validation of the proposed method is presented for two kinds of structures, one a cantilever beam, another a two-story steel frame, both undergoing harmonic as well as random base excitation. The results obtained using the proposed method is validated with the displacement measured using Laser Doppler Vibrometer at a particular point of the edge. Further, the analytical derivations of the proposed method along with the effect of the filter parameters on the edge signal are presented in the Appendix. In order to validate the efficacy of the method on real-world structures, part of the vibrating cable of Tacoma Narrows bridge is tracked from its video, moments before its collapse. The results show high correspondence between the actual motion of the cable and traced motion of its edge, over time. The proposed method reveals the absolute as well as relative displacement response of the cable along with the dominating frequencies of the cable’s vibration.

[1]  E. W. Ng,et al.  A table of integrals of the error functions. , 1969 .

[2]  R. Bruce Weisman,et al.  Full-field, high-spatial-resolution detection of local structural damage from low-resolution random strain field measurements , 2017 .

[3]  Zhilu Lai,et al.  Semi‐supervised structural linear/nonlinear damage detection and characterization using sparse identification , 2018, Structural Control and Health Monitoring.

[4]  Yu Fu,et al.  Digital image correlation for whole field out-of-plane displacement measurement using a single camera , 2005 .

[5]  Satish Nagarajaiah,et al.  Sparse structural system identification method for nonlinear dynamic systems with hysteresis/inelastic behavior , 2019, Mechanical Systems and Signal Processing.

[6]  Sami F. Masri,et al.  A vision-based approach for the direct measurement of displacements in vibrating systems , 2003 .

[7]  Elsa Caetano,et al.  A vision system for vibration monitoring of civil engineering structures , 2011 .

[8]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  Marc M. Van Hulle,et al.  A phase-based approach to the estimation of the optical flow field using spatial filtering , 2002, IEEE Trans. Neural Networks.

[10]  Charles R. Farrar,et al.  Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements , 2017 .

[11]  Charles R. Farrar,et al.  Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification , 2017 .

[12]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  B. Buxton,et al.  Monocular depth perception from optical flow by space time signal processing , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[15]  Pablo A. Parrilo,et al.  Rank-Sparsity Incoherence for Matrix Decomposition , 2009, SIAM J. Optim..

[16]  Peter Avitabile,et al.  3D digital image correlation methods for full-field vibration measurement , 2011 .

[17]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[18]  François Hild,et al.  Damage law identification from full field displacement measurement: Application to four-point bending test for plasterboard , 2015 .

[19]  Hilary Buxton,et al.  Computation of optic flow from the motion of edge features in image sequences , 1984, Image Vis. Comput..

[20]  Anand Asundi,et al.  Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review , 2009 .

[21]  Yongchao Yang,et al.  Modeling and harnessing sparse and low‐rank data structure: a new paradigm for structural dynamics, identification, damage detection, and health monitoring , 2017 .

[22]  Carlo Tomasi,et al.  Dense Lagrangian motion estimation with occlusions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Maria Q. Feng,et al.  Vision-Based Displacement Sensor for Monitoring Dynamic Response Using Robust Object Search Algorithm , 2013 .

[24]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[25]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[26]  M. Bonnet,et al.  Overview of Identification Methods of Mechanical Parameters Based on Full-field Measurements , 2008 .

[27]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[28]  Franccois Hild,et al.  Digital Image Correlation: from Displacement Measurement to Identification of Elastic Properties – a Review , 2006 .