Vision-Based Building Seismic Displacement Measurement by Stratification of Projective Rectification Using Lines

We propose a new flexible technique for accurate vision-based seismic displacement measurement of building structures via a single non-stationary camera with any perspective view. No a priori information about the camera’s parameters or only partial knowledge of the internal camera parameters is required, and geometric constraints in the world coordinate system are employed for projective rectification in this research. Whereas most projective rectifications are conducted by specifying the positions of four or more fixed reference points, our method adopts a stratified approach to partially determine the projective transformation from line-based geometric relationships on the world plane. Since line features are natural and plentiful in a man-made architectural building environment, robust estimation techniques for automatic projective/affine distortion removal can be applied in a more practical way. Both simulations and real-recorded data were used to verify the effectiveness and robustness of the proposed method. We hope that the proposed method could advance the consumer-grade camera system for vision-based structural measurement one more step, from laboratory environments to real-world structural health monitoring systems.

[1]  Kohei Fujita,et al.  Uncertainties in long-period ground motion and its impact on building structural design: Case study of the 2011 Tohoku (Japan) earthquake , 2013 .

[2]  Beatriz Marcotegui,et al.  Morphological segmentation of building façade images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Tadeusz Uhl,et al.  Vision‐based algorithms for damage detection and localization in structural health monitoring , 2016 .

[4]  Hui Zeng,et al.  A new normalized method on line-based homography estimation , 2008, Pattern Recognit. Lett..

[5]  Cuneyt Akinlar,et al.  Edge Drawing: A combined real-time edge and segment detector , 2012, J. Vis. Commun. Image Represent..

[6]  Jan Kautz,et al.  PlaneRCNN: 3D Plane Detection and Reconstruction From a Single Image , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  Oral Büyüköztürk,et al.  GPS Measured Response of a Tall Building due to a Distant Mw 7.3 Earthquake , 2018, Seismological Research Letters.

[11]  Chun Cheng,et al.  A preliminary study on the response of steel structures using surveillance camera image with vision-based method during the Great East Japan Earthquake , 2015 .

[12]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[13]  Hiroyuki Fujiwara,et al.  STRONG-MOTION SEISMOGRAPH NETWORK OPERATED BY NIED: K-NET AND KiK-net , 2004 .

[14]  Horst Bischof,et al.  Unsupervised Facade Segmentation Using Repetitive Patterns , 2010, DAGM-Symposium.

[15]  Antonio J. Plaza,et al.  Image Segmentation Using Deep Learning: A Survey , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[17]  Mani Golparvar-Fard,et al.  Target‐free approach for vision‐based structural system identification using consumer‐grade cameras , 2016 .

[18]  Andrew Zisserman,et al.  Planar grouping for automatic detection of vanishing lines and points , 2000, Image Vis. Comput..

[19]  Akira WADA,et al.  RESPONSES OF CONTROLLED TALL BUILDINGS IN TOKYO SUBJECTED TO THE GREAT EAST JAPAN EARTHQUAKE , 2012 .

[20]  Nam-Sik Kim,et al.  Dynamic characteristics of suspension bridge hanger cables using digital image processing , 2013 .

[21]  Frédo Durand,et al.  Video Camera–Based Vibration Measurement for Civil Infrastructure Applications , 2017 .

[22]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[24]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[25]  Eungsoo Kim,et al.  Evaluation of building period formulas for seismic design , 2010 .

[26]  Agnès Desolneux,et al.  Vanishing Point Detection without Any A Priori Information , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  B. F. Spencer,et al.  Structural Displacement Measurement Using an Unmanned Aerial System , 2018, Comput. Aided Civ. Infrastructure Eng..

[28]  Satoru Yoneyama,et al.  Bridge Deflection Measurement Using Digital Image Correlation with Camera Movement Correction , 2012 .

[29]  Rafael Grompone von Gioi,et al.  Finding Vanishing Points via Point Alignments in Image Primal and Dual Domains , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Donghyun Kim,et al.  A Target-Less Vision-Based Displacement Sensor Based on Image Convex Hull Optimization for Measuring the Dynamic Response of Building Structures , 2016, Sensors.

[31]  Yukio Tamura,et al.  Damping Evaluation Using Full-Scale Data of Buildings in Japan , 2003 .

[32]  Reinhard Koch,et al.  Pose Estimation from Line Correspondences: A Complete Analysis and a Series of Solutions , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[34]  Anthony Hoogs,et al.  A Minimum Error Vanishing Point Detection Approach for Uncalibrated Monocular Images of Man-Made Environments , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Allan Hanbury,et al.  Robust camera self-calibration from monocular images of Manhattan worlds , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[37]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[38]  Stathis C. Stiros,et al.  Monitoring dynamic and quasi-static deformations of large flexible engineering structures with GPS: Accuracy, limitations and promises , 2006 .

[39]  Stathis C. Stiros,et al.  Errors in velocities and displacements deduced from accelerographs: An approach based on the theory of error propagation , 2008 .

[40]  Yambem Jina Chanu,et al.  Image Segmentation Using K -means Clustering Algorithm and Subtractive Clustering Algorithm , 2015 .

[41]  Dashan Zhang,et al.  A High-Speed Vision-Based Sensor for Dynamic Vibration Analysis Using Fast Motion Extraction Algorithms , 2016, Sensors.

[42]  Kohei Fujita,et al.  Damage identification for frame structures using vision-based measurement , 2019 .

[43]  Lijun Wu,et al.  Dynamic testing of a laboratory model via vision-based sensing , 2014 .

[44]  Baoxin Li,et al.  Homography-based ground detection for a mobile robot platform using a single camera , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[45]  Robert Tremblay,et al.  Fundamental Periods of Vibration of Braced Steel Frames for Seismic Design , 2005 .

[46]  Xosé R. Fernández-Vidal,et al.  Two-view line matching algorithm based on context and appearance in low-textured images , 2015, Pattern Recognit..

[47]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[48]  Adrien Bartoli,et al.  Structure-from-motion using lines: Representation, triangulation, and bundle adjustment , 2005, Comput. Vis. Image Underst..

[49]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[50]  David J. Ewins,et al.  MODAL TESTING USING A SCANNING LASER DOPPLER VIBROMETER , 1999 .