Experimental image and range scanner datasets fusion in SHM for displacement detection

Summary Optical images and signals can be used to detect displacement in civil engineering structures. This paper presents a technical experimentation of a vision-based technology and artificial intelligence algorithms methodology for structural health monitoring of new and aging structures, by a noncontact and nondestructive system. The experimental study emphasis is on the outdoor urban environment, by the detection of spatial coordinate displacement on the structures, in order to perform a damage assessment. Also, the experimental study contains both theoretical and experimental aspects of the fusion of image and range scanner datasets created using intelligent algorithms. A camera and an optical scanning system were used to generate high resolution and quality images for 2D imaging, and 3D accuracy range data from optoelectronic sensor signals. Scans at a specific area of an engineering structure were performed to measure spatial coordinates displacements, successfully verifying the effectiveness and the robustness of the proposed non-contact and non-destructive monitoring approach.

[1]  Ricardo Perera,et al.  Damage detection in structures using a transmissibility‐based Mahalanobis distance , 2015 .

[2]  Wendy Flores-Fuentes,et al.  Combined application of Power Spectrum Centroid and Support Vector Machines for measurement improvement in Optical Scanning Systems , 2014, Signal Process..

[3]  O. Yu. Sergiyenko,et al.  Optoelectronic Method for Structural Health Monitoring , 2010 .

[4]  Wendy Flores-Fuentes,et al.  Improve laser detection in CCD for integrated photogrammetry - Laser scanner , 2014, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE).

[5]  Yi-Qing Ni,et al.  Technology developments in structural health monitoring of large-scale bridges , 2005 .

[6]  Bin Fang,et al.  A comparison of 3D shape retrieval methods based on a large-scale benchmark supporting multimodal queries , 2015, Comput. Vis. Image Underst..

[7]  Arman Savran,et al.  Comparative evaluation of 3D vs. 2D modality for automatic detection of facial action units , 2012, Pattern Recognit..

[8]  Wendy Flores-Fuentes,et al.  Accuracy improvement of vision system for mobile robot navigation by finding the energetic center of laser signal , 2014, IECON 2014 - 40th Annual Conference of the IEEE Industrial Electronics Society.

[9]  Vic Grout,et al.  Taking Computer Science and Programming into Schools: The Glyndŵr/BCS Turing Project , 2014 .

[10]  Jinwu Xu,et al.  An Implementation of a Remote Diagnostic System on Rotational Machines , 2006 .

[11]  Tadeusz Uhl,et al.  Monitoring of a civil structure’s state based on noncontact measurements , 2013 .

[12]  Tadeusz Uhl,et al.  Vision‐based algorithms for damage detection and localization in structural health monitoring , 2016 .

[13]  Wenyi Liu,et al.  Status and problems of wind turbine structural health monitoring techniques in China , 2010 .

[14]  Gyuhae Park,et al.  Structural Health Monitoring With Autoregressive Support Vector Machines , 2009 .

[15]  Wendy Flores-Fuentes,et al.  Mobile robot vision system using continuous laser scanning for industrial application , 2016, Ind. Robot.

[16]  Weijie Li,et al.  Application of support vector machine for pattern classification of active thermometry‐based pipeline scour monitoring , 2015 .

[17]  Philippe Grosso,et al.  Charge-coupled devices combined with centroid algorithm for laser beam deviation measurements compared to a position-sensitive device , 2011 .

[18]  Amy L. Murphy,et al.  Wireless sensor networks for permanent health monitoring of historic buildings , 2010 .

[19]  Wendy Flores-Fuentes,et al.  Multivariate outlier mining and regression feedback for 3D measurement improvement in opto-mechanical system , 2016 .

[20]  Subhas Chandra Mukhopadhyay,et al.  New developments in sensing technology for structural health monitoring , 2011 .

[21]  Maria Q. Feng,et al.  Vision‐based multipoint displacement measurement for structural health monitoring , 2016 .

[22]  Alessandro Mecocci,et al.  Health monitoring of architectural heritage: the case study of San Gimignano , 2010, 2010 IEEE Workshop on Environmental Energy and Structural Monitoring Systems.

[23]  Lijun Wu,et al.  Dynamic testing of a laboratory model via vision-based sensing , 2014 .

[24]  Wendy Flores-Fuentes,et al.  Scanning for light detection and Energy Centre Localization Methods assesment in vision systems for SHM , 2014, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE).

[25]  Swagatam Das,et al.  Multi-sensor data fusion using support vector machine for motor fault detection , 2012, Inf. Sci..

[26]  Oleg Starostenko,et al.  Optical 3D laser measurement system for navigation of autonomous mobile robot , 2014 .

[27]  K. Worden,et al.  The application of machine learning to structural health monitoring , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[28]  Alessandro Mecocci,et al.  Monitoring Architectural Heritage by Wireless Sensors Networks: San Gimignano — A Case Study , 2014, Sensors.

[29]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[30]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Combining Intelligent Techniques for Sensor Fusion , 2004, Applied Intelligence.

[31]  Xi Zhao,et al.  An efficient multimodal 2D + 3D feature-based approach to automatic facial expression recognition , 2015, Comput. Vis. Image Underst..

[32]  Maria Q. Feng,et al.  A Vision-Based Sensor for Noncontact Structural Displacement Measurement , 2015, Sensors.

[33]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[34]  Oleg Sergiyenko,et al.  Surface recognition improvement in 3D medical laser scanner using Levenberg-Marquardt method , 2013, Signal Process..

[35]  Pedro Galvín,et al.  Monitoring the Mechanical Behavior of the Weathervane Sculpture Mounted Atop Seville Cathedral’s Giralda Tower , 2010 .

[36]  Paulo B. Lourenço,et al.  Monitoring historical masonry structures with operational modal analysis: Two case studies , 2007 .

[37]  I. Lombillo,et al.  Structural health monitoring of a damaged church: design of an integrated platform of electronic instrumentation, data acquisition and client/server software , 2016 .

[38]  R. Betti,et al.  Data‐based structural health monitoring using small training data sets , 2015 .

[39]  Wendy Flores-Fuentes,et al.  Energy Center Detection in Light Scanning Sensors for Structural Health Monitoring Accuracy Enhancement , 2014, IEEE Sensors Journal.

[40]  Hong Hao,et al.  Development and application of a relative displacement sensor for structural health monitoring of composite bridges , 2015 .

[41]  Piotr Górski,et al.  Monitoring horizontal displacements in a vertical profile of a tall industrial chimney using Global Positioning System technology for detecting dynamic characteristics , 2015 .