Visual–inertial displacement sensing using data fusion of vision‐based displacement with acceleration

Summary In recognition of the importance of the displacement associated with assessing structural condition, many displacement measurement methods have been proposed to date. With advances in optics and electronics, displacement measurement relying on computer-vision techniques to convert pixel movement into structural displacement has drawn much attention recently, thanks to its simplicity in installation and relatively inexpensive cost. Despite numerous advantages, 2 major obstacles that prohibit the use of vision-based method are (a) resolution, which is a function of distance between the camera and the structure, and (b) limited frame rate, which both lower dynamic displacement-capturing capability. In this paper, to enhance the quality of vision-based displacement measurement, data fusion with acceleration measurement is proposed to improve the dynamic range of displacements while lowering signal noise. To achieve fusion between vision-based displacement and acceleration, complementary filters and a time synchronization method between 2 different sources were proposed. The proposed methods were verified through numerical analysis and an experimental test, the results of which showed the validity of proposed data fusion.

[1]  Carmelo Gentile,et al.  Fusion of wireless and non-contact technologies for the dynamic testing of a historic RC bridge , 2016 .

[2]  Gul Agha,et al.  Flexible smart sensor framework for autonomous structural health monitoring , 2010 .

[3]  Hoon Sohn,et al.  Autonomous dynamic displacement estimation from data fusion of acceleration and intermittent displacement measurements , 2014 .

[4]  H. Lee,et al.  Design of the FEM-FIR filter for displacement reconstruction using accelerations and displacements measured at different sampling rates , 2013 .

[5]  Ki-Tae Park,et al.  The determination of bridge displacement using measured acceleration , 2005 .

[6]  Stathis C. Stiros,et al.  Measuring Deflections of a Short-Span Railway Bridge Using a Robotic Total Station , 2013 .

[7]  Maria Q. Feng,et al.  Vision‐based multipoint displacement measurement for structural health monitoring , 2016 .

[8]  Lijun Wu,et al.  Dynamic testing of a laboratory model via vision-based sensing , 2014 .

[9]  Mani Golparvar-Fard,et al.  Target‐free approach for vision‐based structural system identification using consumer‐grade cameras , 2016 .

[10]  Chih-Chen Chang,et al.  An integrated visual-inertial technique for structural displacement and velocity measurement , 2010 .

[11]  A. Smyth,et al.  Multi-rate Kalman filtering for the data fusion of displacement and acceleration response measurement in dynamic system monitoring , 2007 .

[12]  Alan Dodson,et al.  Integrating a Global Positioning System and Accelerometers to Monitor the Deflection of Bridges , 2004 .

[13]  Hani Nassif,et al.  Comparison of laser Doppler vibrometer with contact sensors for monitoring bridge deflection and vibration , 2005 .

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Charles R. Farrar,et al.  Automated Extraction of Mode Shapes Using Motion Magnified Video and Blind Source Separation , 2016 .

[16]  Jong-Jae Lee,et al.  A vision-based system for remote sensing of bridge displacement , 2006 .

[17]  H. Lee,et al.  Design of an FIR filter for the displacement reconstruction using measured acceleration in low‐frequency dominant structures , 2010 .

[18]  Wujiao Dai,et al.  An integrated GPS–accelerometer data processing technique for structural deformation monitoring , 2006 .

[19]  Sara Casciati,et al.  Real-time monitoring system for local storage and data transmission by remote control , 2017, Adv. Eng. Softw..

[20]  Hani Nassif,et al.  Bridge Displacement Estimates from Measured Acceleration Records , 2007 .

[21]  Hyun Myung,et al.  High‐speed 6‐DOF structural displacement monitoring by fusing ViSP (Visually Servoed Paired structured light system) and IMU with extended Kalman filter , 2017 .

[22]  Rui Calçada,et al.  Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system , 2014 .

[23]  Sung-Han Sim,et al.  Development of a Wireless Displacement Measurement System Using Acceleration Responses , 2013, Sensors.

[24]  Sung-Han Sim,et al.  Displacement Estimation Using Multimetric Data Fusion , 2013, IEEE/ASME Transactions on Mechatronics.

[25]  F. Necati Catbas,et al.  Completely contactless structural health monitoring of real‐life structures using cameras and computer vision , 2017 .