Blind, simultaneous identification of full-field vibration modes and large rigid-body motion of output-only structures from digital video measurements

Abstract Many operating structures undergo vibration associated with significant rigid-body motion, such as earthquake-excited structures which vibrate while moving (and/or rocking) along with the shaking ground, rotating structures such as the blades of helicopter, aircraft, wind turbine, and in UAV’s measurements (images/videos) of infrastructure response which is coupled with the motion of the UAV itself. In many such cases, the rigid motion is very dominant; measurement and identification of the relatively subtle deformation (flexible) motion of the structure in their operations is very challenging, especially when high-resolution vibration measurement and high-fidelity dynamics modeling are required to capture and characterize spatially local and temporally transient dynamics behaviors and features of the structure. Traditional contact-type wired or wireless sensors, such as accelerometers, strain gauges, and LVDT’s, are discrete point-wise sensors that only allow instrumentations at a limited number of places, providing very low spatial resolution vibration measurements. Non-contact interferometry-based optical measurement techniques using laser beams such as laser Doppler vibrometers, electronic speckle pattern interferometry (ESPI) and holographic interferometry, can provide high spatial resolution vibration measurement without the need to install sensors on the structure. However, they are very vulnerable to ambient vibration and rigid-body motion. As an alternative non-contact optical measurement method, photogrammetry uses white-light imaging of digital video cameras that are relatively low-cost, agile, and provides simultaneous measurements with very high spatial resolution where every pixel effectively becomes a sensing unit. Furthermore, it is robust to rigid-body motion. Using image processing algorithms such as optical flow and image correlation, photogrammetry has been successfully used for vibration measurements and experimental modal analysis of structures (including rotating-type) where full-field (or as many points as the pixel number of the image frame on the structure) modal parameters (mode shapes) can be obtained. However, existing such methods typically rely on installing and tracking the optical markers or speckle paints on the structure’s surface, which becomes less applicable for large measurement area or in harsh environment (high temperature and corrosion). In addition, they are computationally extensive. Aiming to alleviate these challenges, this study presents the development of adapting a recently-proposed video-based method for output-only, simultaneous identification of both the subtle, full-field deformation modes and the dominant rigid-body motion from only the video of the vibrating while moving structure. Full-field dynamic parameters (deformation modes) of structure, as well as its rigid-body motion can be efficiently estimated, respectively. Laboratory experiments were conducted on a bench-scale building structure with “free-free” boundary condition. Comparisons were made with an analytical finite element model. Results demonstrate that the method can efficiently and accurately extract the full-field, (total) motion of the structure and further identify or separate the subtle deformation modes and large rigid-body motion, respectively. Furthermore, videos reconstructed by the method (provided in the supplementary materials) show that it enables realistic visualization of the subtle deformation modes of the structure in presence of large rigid-body motion. Several practical limitations for implementing the method are also discussed.

[1]  Charles R. Farrar,et al.  Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements , 2017 .

[2]  Mani Golparvar-Fard,et al.  Target‐free approach for vision‐based structural system identification using consumer‐grade cameras , 2016 .

[3]  Charles R. Farrar,et al.  Identification of Full-Field Dynamic Loads on Structures Using Computer Vision and Unsupervised Machine Learning , 2017 .

[4]  J. Sirohi,et al.  Measurement of the deformation of an extremely flexible rotor blade using digital image correlation , 2013 .

[5]  Janko Slavič,et al.  The subpixel resolution of optical-flow-based modal analysis , 2017 .

[6]  Charles R. Farrar,et al.  Reference-free detection of minute, non-visible, damage using full-field, high-resolution mode shapes output-only identified from digital videos of structures , 2018 .

[7]  Hui Li,et al.  Computer vision and deep learning–based data anomaly detection method for structural health monitoring , 2019 .

[8]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[9]  Wolfgang Osten,et al.  High-speed digital holographic interferometry for vibration measurement. , 2006, Applied optics.

[10]  Piotr Olaszek,et al.  Investigation of the dynamic characteristic of bridge structures using a computer vision method , 1999 .

[11]  Hubert W. Schreier,et al.  Image Correlation for Shape, Motion and Deformation Measurements: Basic Concepts,Theory and Applications , 2009 .

[12]  Charles R. Farrar,et al.  A summary review of vibration-based damage identification methods , 1998 .

[13]  John E. Mottershead,et al.  Finite Element Model Updating in Structural Dynamics , 1995 .

[14]  Dario Di Maio,et al.  Continuous Scan, a method for performing modal testing using meaningful measurement parameters; Part I , 2011 .

[15]  John Tyson,et al.  Pull-field dynamic displacement and strain measurement using advanced 3D image correlation photogrammetry: Part 1 , 2003 .

[16]  F. Necati Catbas,et al.  Completely contactless structural health monitoring of real‐life structures using cameras and computer vision , 2017 .

[17]  Hui Li,et al.  Strain features and condition assessment of orthotropic steel deck cable-supported bridges subjected to vehicle loads by using dense FBG strain sensors , 2017 .

[18]  Sami F. Masri,et al.  A vision-based approach for the direct measurement of displacements in vibrating systems , 2003 .

[19]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[20]  Peter Avitabile,et al.  A Noncontacting Approach for Full-Field Strain Monitoring of Rotating Structures , 2016 .

[21]  Charles R. Farrar,et al.  Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification , 2017 .

[22]  Charles Dorn,et al.  Efficient Full-Field Operational Modal Analysis Using Neuromorphic Event-Based Imaging , 2017 .

[23]  Hui Li,et al.  Condition assessment of cables by pattern recognition of vehicle-induced cable tension ratio , 2018 .

[24]  Enrico Primo Tomasini,et al.  Laser Doppler Vibrometry: Development of advanced solutions answering to technology's needs , 2006 .

[25]  Christopher Niezrecki,et al.  Vibration-Based Damage Detection in Wind Turbine Blades using Phase-Based Motion Estimation and Motion Magnification , 2018, ArXiv.

[26]  Boleslaw Stasicki,et al.  Application of high-speed videography for in-flight deformation measurements of aircraft propellers , 2009, International Congress on High-Speed Imaging and Photonics.

[27]  Yongchao Yang,et al.  Blind modal identification of output‐only structures in time‐domain based on complexity pursuit , 2013 .

[28]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[29]  David J. Ewins,et al.  MODAL TESTING USING A SCANNING LASER DOPPLER VIBROMETER , 1999 .

[30]  Peter Avitabile,et al.  Photogrammetry and optical methods in structural dynamics – A review , 2017 .

[31]  Chih-Chen Chang,et al.  Flexible Videogrammetric Technique for Three-Dimensional Structural Vibration Measurement , 2007 .

[32]  Charles R. Farrar,et al.  Full-Field Structural Dynamics by Video Motion Manipulations , 2017 .

[33]  Maria Q. Feng,et al.  Vision‐based multipoint displacement measurement for structural health monitoring , 2016 .

[34]  Daniel Rixen,et al.  Feasibility of monitoring large wind turbines using photogrammetry , 2010 .

[35]  B. Feeny,et al.  On the physical interpretation of proper orthogonal modes in vibrations , 1998 .

[36]  Alpheus W. Burner,et al.  Blade Displacement Measurement Technique Applied to a Full-Scale Rotor Test , 2012 .

[37]  Eleni Chatzi,et al.  Structural health monitoring through video recording , 2016 .

[38]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[39]  Peter Avitabile,et al.  Optical Non-contacting Vibration Measurement of Rotating Turbine Blades II , 2011 .

[40]  Peter Avitabile,et al.  3D digital image correlation methods for full-field vibration measurement , 2011 .

[41]  Charles R. Farrar,et al.  Establishment of Full-Field, Full-Order Dynamic Model of Cable Vibration by Video Motion Manipulations , 2017 .

[42]  Jong-Jae Lee,et al.  A vision-based system for remote sensing of bridge displacement , 2006 .

[43]  Thorsten Siebert,et al.  High speed image correlation for vibration analysis , 2009 .

[44]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[45]  Carlos E. Ventura,et al.  Introduction to Operational Modal Analysis: Brincker/Introduction to Operational Modal Analysis , 2015 .

[46]  John E. Mottershead,et al.  Finite element model updating from full-field vibration measurement using digital image correlation , 2011 .

[47]  Marc M. Van Hulle,et al.  A phase-based approach to the estimation of the optical flow field using spatial filtering , 2002, IEEE Trans. Neural Networks.

[48]  Yuequan Bao,et al.  Video‐based multiscale identification approach for tower vibration of a cable‐stayed bridge model under earthquake ground motions , 2019, Structural Control and Health Monitoring.

[49]  Peter Avitabile,et al.  Appropriate rigid body correction of stereophotogrammetry measurements made on rotating systems , 2015, Experimental Techniques.