Dynamic displacement measurement of large-scale structures based on the Lucas–Kanade template tracking algorithm

Abstract The development of optics and computer technologies enables the application of the vision-based technique that uses digital cameras to the displacement measurement of large-scale structures. Compared with traditional contact measurements, vision-based technique allows for remote measurement, has a non-intrusive characteristic, and does not necessitate mass introduction. In this study, a high-speed camera system is developed to complete the displacement measurement in real time. The system consists of a high-speed camera and a notebook computer. The high-speed camera can capture images at a speed of hundreds of frames per second. To process the captured images in computer, the Lucas–Kanade template tracking algorithm in the field of computer vision is introduced. Additionally, a modified inverse compositional algorithm is proposed to reduce the computing time of the original algorithm and improve the efficiency further. The modified algorithm can rapidly accomplish one displacement extraction within 1 ms without having to install any pre-designed target panel onto the structures in advance. The accuracy and the efficiency of the system in the remote measurement of dynamic displacement are demonstrated in the experiments on motion platform and sound barrier on suspension viaduct. Experimental results show that the proposed algorithm can extract accurate displacement signal and accomplish the vibration measurement of large-scale structures.

[1]  Chih-Chen Chang,et al.  Nontarget Image-Based Technique for Small Cable Vibration Measurement , 2008 .

[2]  Jong-Jae Lee,et al.  Real-Time Displacement Measurement of a Flexible Bridge Using Digital Image Processing Techniques , 2006 .

[3]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  Daniel Leonardo B.R. Jurjo,et al.  Experimental methodology for the dynamic analysis of slender structures based on digital image processing techniques , 2010 .

[6]  W T McKeel,et al.  DETERMINATION OF BRIDGE RESPONSE USING ACCELERATION DATA , 1996 .

[7]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Cila Herman,et al.  Motion tracking in infrared imaging for quantitative medical diagnostic applications. , 2014, Infrared physics & technology.

[9]  Christopher E. Hann,et al.  Fast normalized cross correlation for motion tracking using basis functions , 2006, Comput. Methods Programs Biomed..

[10]  Ricardo M. L. Barros,et al.  Tracking soccer players aiming their kinematical motion analysis , 2006, Comput. Vis. Image Underst..

[11]  MatthewsIain,et al.  Lucas-Kanade 20 Years On , 2004 .

[12]  Justin M. Ocel,et al.  Quantitative evaluation of digital image correlation as applied to large-scale gusset plate experiments , 2012 .

[13]  Peter Avitabile,et al.  Comparison of Image Based, Laser, and Accelerometer Measurements , 2011 .

[14]  Sami F. Masri,et al.  A vision-based approach for the direct measurement of displacements in vibrating systems , 2003 .

[15]  Erin Santini Bell,et al.  Bridge condition assessment using digital image correlation and structural modeling , 2012 .

[16]  Tonghai Wu,et al.  Full-life dynamic identification of wear state based on on-line wear debris image features , 2014 .

[17]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[18]  Agenor de Toledo Fleury,et al.  Identification of a scaled-model riser dynamics through a combined computer vision and adaptive Kalman filter approach , 2014 .

[19]  Yücel Altunbasak,et al.  A fast parametric motion estimation algorithm with illumination and lens distortion correction , 2003, IEEE Trans. Image Process..

[20]  Rachid Deriche,et al.  Region tracking through image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  L. Xu,et al.  TIME–FREQUENCY ANALYSIS OF A SUSPENSION BRIDGE BASED ON GPS , 2002 .

[22]  Alan Dodson,et al.  Measurements of dynamic properties of a medium span suspension bridge by using the wavelet transforms , 2006 .

[23]  Thorsten Siebert,et al.  High speed image correlation for vibration analysis , 2009 .

[24]  Ki-Tae Park,et al.  The determination of bridge displacement using measured acceleration , 2005 .

[25]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[26]  Deyong You,et al.  Monitoring of high-power laser welding using high-speed photographing and image processing , 2014 .

[27]  Emanuele Zappa,et al.  Vision-based measuring system for rider's pose estimation during motorcycle riding , 2013 .

[28]  Cila Herman,et al.  Involuntary motion tracking for medical dynamic infrared thermography using a template-based algorithm , 2013, Medical Imaging.

[29]  Petros Maragos,et al.  Motion displacement estimation using an affine model for image matching , 1991 .

[30]  Maria Q. Feng,et al.  Vision-Based Displacement Sensor for Monitoring Dynamic Response Using Robust Object Search Algorithm , 2013 .

[31]  Hani Nassif,et al.  Comparison of laser Doppler vibrometer with contact sensors for monitoring bridge deflection and vibration , 2005 .

[32]  Liu Hefei,et al.  Application of the Fourier transform in electronic speckle photography , 2002 .

[33]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Wei Tong,et al.  Formulation of Lucas–Kanade Digital Image Correlation Algorithms for Non‐contact Deformation Measurements: A Review , 2013 .

[35]  S Kim,et al.  Application of vision-based monitoring system to stay cables , 2012 .