Identification of full-field dynamic modes using continuous displacement response estimated from vibrating edge video

Abstract The video of vibrating structure provides dense quantitative continuous spatial information that is harnessed using various computer vision algorithms in the past decade. Computer vision algorithms that implement sparse optical flow, have been successful in acquiring the Lagrangian representation of motion. Such vision-based measurement already proved its potential in replacing the need for a contact based vibration measurement sensors. In order to obtain full-field, spatially dense, vibrational modes, a large number of discrete sensors would be necessary throughout the specimen’s length, making it impractical. The phase-based video processing method is found to be successful in visualizing full-field operational mode shapes of a vibrating structure. However, the phase-based optical flow provides an Eulerian representation of the motion at every pixel of the image space, which does not acquire the full-field spatiotemporal Lagrangian displacement trajectory of the structure. Hence, there is a need to design a target-free, noncontact vision-based framework that can directly extract and quantify full-field dynamic modes of a real-life vibrating structural member from its video, by acquiring the trajectory of every particle on the structure at each frame of the video using optical flow. The continuous edge of a moving object is a rich optical feature whose motion perpendicular to its orientation can be tracked in Lagrangian coordinates using optical flow. In a recent paper by authors, the method of measuring full-field displacement response of a vibrating continuous edge of a structural member has been reported. In this paper, the full-field displacement response is acquired using the recently presented method and subsequently, its spatially dense dynamic modes are extracted from its video using the acquired full-field spatiotemporal displacement response of the vibrating structure. The full-field dynamic modes and modal parameters are extracted using the Hankel dynamic mode decomposition method, which is applicable both for linear, as well as nonlinear dynamical systems. Further, experimental validation of the proposed method is presented for two kinds of structures (1) a three-story steel frame, and (2) an aluminum cantilever beam, both undergoing free vibration. The results obtained using the proposed method is validated with the displacement measured using Laser Doppler Vibrometer at a particular point of the edge. The extracted modal properties using the proposed methodology compares satisfactorily with the results of the eigensystem realization algorithm applied to the discrete point accelerometer measurements attached at all three floors of the frame. Also, the numerically obtained mode shapes from the analytical model of the cantilever beam validate the estimated modal parameters and the full-field mode shapes. To validate the efficacy of the proposed method in real-world structures, part of the vibrating cable of Tacoma Narrows bridge is tracked from its video, moments before its collapse. The proposed method does successfully extract the dominating vibrational modes of the cables of the Tacoma Narrows bridge.

[1]  Steven L. Brunton,et al.  Chaos as an intermittently forced linear system , 2016, Nature Communications.

[2]  Maria Q. Feng,et al.  Experimental validation of cost-effective vision-based structural health monitoring , 2017 .

[3]  Marc M. Van Hulle,et al.  A phase-based approach to the estimation of the optical flow field using spatial filtering , 2002, IEEE Trans. Neural Networks.

[4]  R. Clough,et al.  Dynamics Of Structures , 1975 .

[5]  John E. Mottershead,et al.  Finite Element Model Updating in Structural Dynamics , 1995 .

[6]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[7]  Z. Bažant,et al.  Stability of Structures: Elastic, Inelastic, Fracture and Damage Theories , 2010 .

[8]  Peter Avitabile,et al.  Feasibility of extracting operating shapes using phase-based motion magnification technique and stereo-photogrammetry , 2017 .

[9]  Maria Q. Feng,et al.  Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection – A review , 2018 .

[10]  Hilary Buxton,et al.  Computation of optic flow from the motion of edge features in image sequences , 1984, Image Vis. Comput..

[11]  B. Buxton,et al.  Monocular depth perception from optical flow by space time signal processing , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  Anand Asundi,et al.  Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review , 2009 .

[13]  Yongchao Yang,et al.  Modeling and harnessing sparse and low‐rank data structure: a new paradigm for structural dynamics, identification, damage detection, and health monitoring , 2017 .

[14]  Carlo Tomasi,et al.  Dense Lagrangian motion estimation with occlusions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[16]  Satish Nagarajaiah,et al.  Measurement of full-field displacement time history of a vibrating continuous edge from video , 2020 .

[17]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[18]  Maria Q. Feng,et al.  Vision-Based Displacement Sensor for Monitoring Dynamic Response Using Robust Object Search Algorithm , 2013 .

[19]  B. F. Spencer,et al.  STATE OF THE ART OF STRUCTURAL CONTROL , 2003 .

[20]  Yu Fu,et al.  Digital image correlation for whole field out-of-plane displacement measurement using a single camera , 2005 .

[21]  Zhilu Lai,et al.  Semi‐supervised structural linear/nonlinear damage detection and characterization using sparse identification , 2018, Structural Control and Health Monitoring.

[22]  Satish Nagarajaiah,et al.  Sparse structural system identification method for nonlinear dynamic systems with hysteresis/inelastic behavior , 2019, Mechanical Systems and Signal Processing.

[23]  Sami F. Masri,et al.  A vision-based approach for the direct measurement of displacements in vibrating systems , 2003 .

[24]  François Hild,et al.  Damage law identification from full field displacement measurement: Application to four-point bending test for plasterboard , 2015 .

[25]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[26]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[27]  Jer-Nan Juang,et al.  An eigensystem realization algorithm for modal parameter identification and model reduction. [control systems design for large space structures] , 1985 .

[28]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[29]  M. Bonnet,et al.  Overview of Identification Methods of Mechanical Parameters Based on Full-field Measurements , 2008 .

[30]  James M. W. Brownjohn,et al.  Review of machine-vision based methodologies for displacement measurement in civil structures , 2018 .

[31]  Charles R. Farrar,et al.  Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification , 2017 .

[32]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  R. Bruce Weisman,et al.  Full-field, high-spatial-resolution detection of local structural damage from low-resolution random strain field measurements , 2017 .

[34]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  Steven L. Brunton,et al.  Dynamic Mode Decomposition with Control , 2014, SIAM J. Appl. Dyn. Syst..

[36]  Franccois Hild,et al.  Digital Image Correlation: from Displacement Measurement to Identification of Elastic Properties – a Review , 2006 .

[37]  Bing Pan,et al.  Single-camera high-speed stereo-digital image correlation for full-field vibration measurement , 2017 .

[38]  Elsa Caetano,et al.  A vision system for vibration monitoring of civil engineering structures , 2011 .

[39]  Charles R. Farrar,et al.  Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements , 2017 .

[40]  Igor Mezic,et al.  Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator , 2016, SIAM J. Appl. Dyn. Syst..

[41]  Peter Avitabile,et al.  3D digital image correlation methods for full-field vibration measurement , 2011 .

[42]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[43]  I. Mezić,et al.  Analysis of Fluid Flows via Spectral Properties of the Koopman Operator , 2013 .