Non-Contact Measurement of the Surface Displacement of a Slope Based on a Smart Binocular Vision System

The paper presents an intelligent real-time slope surface deformation monitoring system based on binocular stereo-vision. To adapt the system to field slope monitoring, a design scheme of concentric marking point is proposed. Techniques including Zernike moment edge extraction, the least squares method, and k-means clustering are used to design a sub-pixel precision localization method for marker images. This study is mostly focused on the tracking accuracy of objects in multi-frame images obtained from a binocular camera. For this purpose, the Upsampled Cross Correlation (UCC) sub-pixel template matching technique is employed to improve the spatial-temporal contextual (STC) target-tracking algorithm. As a result, the tracking accuracy is improved to the sub-pixel level while keeping the STC tracking algorithm at high speed. The performance of the proposed vision monitoring system has been well verified through laboratory tests.

[1]  Jin-Hee Ahn,et al.  Structural dynamic displacement vision system using digital image processing , 2011 .

[2]  Chih-Chen Chang,et al.  Flexible Videogrammetric Technique for Three-Dimensional Structural Vibration Measurement , 2007 .

[3]  Jin Ho Park,et al.  Measurement of 3-D Vibrational Motion by Dynamic Photogrammetry Using Least-Square Image Matching for Sub-Pixel Targeting to Improve Accuracy , 2016, Sensors.

[4]  Mani Golparvar-Fard,et al.  Target‐free approach for vision‐based structural system identification using consumer‐grade cameras , 2016 .

[5]  Mingchu Li,et al.  Bridge Displacement Monitoring Method Based on Laser Projection-Sensing Technology , 2015, Sensors.

[6]  Fubin Wang,et al.  A High-Speed Target-Free Vision-Based Sensor for Bus Rapid Transit Viaduct Vibration Measurements Using CMT and ORB Algorithms , 2017, Sensors.

[7]  W. Gander,et al.  Least-squares fitting of circles and ellipses , 1994 .

[8]  David Zhang,et al.  Fast Tracking via Spatio-Temporal Context Learning , 2013, ArXiv.

[9]  Gao Shi,et al.  Improved Algorithm about Subpixel Edge Detection of Image Based on Zernike Orthogonal Moments , 2008 .

[10]  Donghyun Kim,et al.  A Target-Less Vision-Based Displacement Sensor Based on Image Convex Hull Optimization for Measuring the Dynamic Response of Building Structures , 2016, Sensors.

[11]  Xiaoli Ding,et al.  Slope deformation prior to Zhouqu, China landslide from InSAR time series analysis , 2015 .

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[14]  James M. W. Brownjohn,et al.  A non‐contact vision‐based system for multipoint displacement monitoring in a cable‐stayed footbridge , 2018 .

[15]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Janko Slavič,et al.  High frequency modal identification on noisy high-speed camera data , 2018 .

[17]  Maria Q. Feng,et al.  Vision‐based multipoint displacement measurement for structural health monitoring , 2016 .

[18]  Manuel Guizar-Sicairos,et al.  Efficient subpixel image registration algorithms. , 2008, Optics letters.

[19]  Janko Slavič,et al.  The subpixel resolution of optical-flow-based modal analysis , 2017 .

[20]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[21]  ZhangZhengyou.  A Flexible New Technique for Camera Calibration , 2000 .

[22]  Hyun Myung,et al.  Vision-based remote 6-DOF structural displacement monitoring system using a unique marker , 2014 .

[23]  M. Jaboyedoff,et al.  Terrestrial laser scanning of rock slope instabilities , 2014 .

[24]  Julian Padget,et al.  Virtual visual sensors and their application in structural health monitoring , 2014 .

[25]  Lei Zhang,et al.  Real-Time Object Tracking Via Online Discriminative Feature Selection , 2013, IEEE Transactions on Image Processing.

[26]  Maria Q. Feng,et al.  Experimental validation of cost-effective vision-based structural health monitoring , 2017 .

[27]  Pavel Tuček,et al.  Monitoring of the Shallow Landslide Using UAV Photogrammetry and Geodetic Measurements , 2015 .

[28]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[29]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[30]  Qi Li,et al.  A novel star image thresholding method for effective segmentation and centroid statistics , 2013 .

[31]  Ying Li,et al.  Improved K-means Algorithm Based on the Clustering Reliability Analysis , 2015 .

[32]  Ting-Hua Yi,et al.  Vision-based structural displacement measurement: System performance evaluation and influence factor analysis , 2016 .

[33]  Juan Zhao,et al.  The Application of Improved GM (1, 1) Model in Deformation Prediction of Slope , 2017 .

[34]  Elías López-Alba,et al.  High frequency mode shapes characterisation using Digital Image Correlation and phase-based motion magnification , 2018 .

[35]  Thomas Schumacher,et al.  Eulerian‐based virtual visual sensors to measure dynamic displacements of structures , 2017 .

[36]  Lionel Benoit,et al.  Monitoring landslide displacements with the Geocube wireless network of low-cost GPS , 2015 .

[37]  Christopher Hollitt,et al.  A convolution approach to the circle Hough transform for arbitrary radius , 2012, Machine Vision and Applications.

[38]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  F. Necati Catbas,et al.  Completely contactless structural health monitoring of real‐life structures using cameras and computer vision , 2017 .

[40]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.