Non-contact structural displacement measurement using Unmanned Aerial Vehicles and video-based systems

Abstract This article describes an innovative methodology for estimating in-plane horizontal displacements of Civil Engineering structures based on video systems integrated on Unmanned Aerial Vehicles (UAVs). As the structure and the UAV are both in motion, estimating absolute structural displacements involves, first, assessing the relative displacements of the UAV-structure based on target tracking, and second, subtracting movement of the UAV based on the data derived from an embedded Inertial Measuring Unit (IMU). Computer-vision processing tools based on heuristic features were developed for target tracking, while an efficient numerical integration strategy was implemented for processing IMU data. A successful integration process requires a baseline correction of the records through the application of high-pass filters and a rigorous control of distortion errors. The validation of the proposed methodology was based on exploratory dynamic tests performed in the laboratory and in the field. The laboratory test involved measuring the displacements of a moving target, positioned over a seismic table using a Linear Variable Differential Transformer (LVDT), a DC accelerometer and the UAV video system in a stationary position. An excellent agreement was achieved for the three estimated displacements, both in the time and frequency domains. In particular, the comparison between the video and the LVDT displacement records showed a peak value error of 0.096 mm and a Root Mean Square (RMS) error of 3.1%. The field test consisted of measuring the displacements of a target fixed to a massive Reinforced Concrete (RC) wall based on the UAV video system in motion. Under these circumstances, the target does not experience any movement, and therefore, the virtual displacement of the target estimated by the video is due exclusively to the self-movements of the UAV. The comparison between the video and the IMU displacement records shows a good agreement, with a peak value error of 1.47 mm (15.5% relative error) and a RMS error of 9.3%. The results of this study are a step forward in estimating the absolute displacements of a vibrating structure based on camera-based measurement from UAVs, specifically with the support of IMU systems for the elimination of measurement inaccuracies as a result of the UAV motion.

[1]  Dinesh Rajan,et al.  Measurement of Three-Dimensional Structural Displacement Using a Hybrid Inertial Vision-Based System , 2019, Sensors.

[2]  Mani Golparvar-Fard,et al.  Target‐free approach for vision‐based structural system identification using consumer‐grade cameras , 2016 .

[3]  Yanli Yang,et al.  Integration on acceleration signals by adjusting with envelopes , 2016 .

[4]  Chuan-Zhi Dong,et al.  Structural displacement monitoring using deep learning-based full field optical flow methods , 2020, Structure and Infrastructure Engineering.

[5]  Yue Wu,et al.  Experimental investigation of vortex-induced vibration of a thousand-meter-scale mega-tall building , 2019, Journal of Fluids and Structures.

[6]  Chuan-Zhi Dong,et al.  A non-target structural displacement measurement method using advanced feature matching strategy , 2019, Advances in Structural Engineering.

[7]  B. F. Spencer,et al.  Structural Displacement Measurement Using an Unmanned Aerial System , 2018, Comput. Aided Civ. Infrastructure Eng..

[8]  Lingling Sun,et al.  A fuzzy complementary Kalman filter based on visual and IMU data for UAV landing , 2018 .

[9]  Guido Luzi,et al.  A radar-based monitoring of the Collserola tower (Barcelona) , 2014 .

[10]  Raimundo Delgado,et al.  Updating and validation of the dynamic model of a railway viaduct with precast deck , 2014 .

[11]  Rui Calçada,et al.  Continuous monitoring of the dynamic behavior of a high‐rise telecommunications tower , 2019, The Structural Design of Tall and Special Buildings.

[12]  Hani Nassif,et al.  Comparison of laser Doppler vibrometer with contact sensors for monitoring bridge deflection and vibration , 2005 .

[13]  B. F. Spencer,et al.  Cross-Correlation-Based Structural System Identification Using Unmanned Aerial Vehicles , 2017, Sensors.

[14]  Kenneth R. White,et al.  Close-range photogrammetry applications in bridge measurement: Literature review , 2008 .

[15]  Rui Calçada,et al.  Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system , 2014 .

[16]  Kyoung-Chan Lee,et al.  Long-term displacement measurement of full-scale bridges using camera ego-motion compensation , 2020 .

[17]  Jaime De-la-Colina,et al.  Assessment of methodologies to estimate displacements from measured acceleration records , 2018 .

[18]  Chongshi Gu,et al.  Observed displacement data-based identification method of structural damage in concrete dam , 2016 .

[19]  Fernando Moreu,et al.  Noncontact Dynamic Displacement Measurement of Structures Using a Moving Laser Doppler Vibrometer , 2019, Journal of Bridge Engineering.

[20]  Chitoshi Miki,et al.  Technique for Determining Bridge Displacement Response Using MEMS Accelerometers , 2016, Sensors.

[21]  Meng-Han Tsai,et al.  A review of rotorcraft Unmanned Aerial Vehicle (UAV) developments and applications in civil engineering , 2014 .

[22]  Satish Nagarajaiah,et al.  Measurement of full-field displacement time history of a vibrating continuous edge from video , 2020 .

[23]  Liqun Tang,et al.  Systematic errors in two-dimensional digital image correlation due to lens distortion , 2013 .

[24]  Rui Calçada,et al.  Remote inspection of RC structures using unmanned aerial vehicles and heuristic image processing , 2020 .

[25]  James M. W. Brownjohn,et al.  Measurements of static and dynamic displacement from visual monitoring of the Humber Bridge , 1993 .

[26]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[27]  Carlos Ricolfe-Viala,et al.  Lens distortion models evaluation. , 2010, Applied optics.

[28]  Hojjat Adeli,et al.  A New Approach for Health Monitoring of Structures: Terrestrial Laser Scanning , 2007, Comput. Aided Civ. Infrastructure Eng..

[29]  Billie F. Spencer,et al.  Vision-Based Modal Survey of Civil Infrastructure Using Unmanned Aerial Vehicles , 2019, Journal of Structural Engineering.

[30]  Myra Lydon,et al.  Development and field testing of a vision-based displacement system using a low cost wireless action camera , 2019, Mechanical Systems and Signal Processing.

[31]  Jian Li,et al.  Reference-Free Displacements for Condition Assessment of Timber Railroad Bridges , 2016 .

[32]  Raimundo Delgado,et al.  Finite element model updating of a bowstring-arch railway bridge based on experimental modal parameters , 2012 .

[33]  Dan M. Frangopol,et al.  Optimization of bridge maintenance strategies based on multiple limit states and monitoring , 2010 .

[34]  José Flávio Silveira Feiteira,et al.  Method to Measure Displacement and Velocityfrom Acceleration Signals , 2016 .

[35]  Ivan Bartoli,et al.  Use of Unmanned Aerial Vehicle for Quantitative Infrastructure Evaluation , 2015 .