Machine Learning Algorithms in Civil Structural Health Monitoring: A Systematic Review

Applications of Machine Learning (ML) algorithms in Structural Health Monitoring (SHM) have become of great interest in recent years owing to their superior ability to detect damage and deficiencies in civil engineering structures. With the advent of the Internet of Things, big data and the colossal and complex backlog of aging civil infrastructure assets, such applications will increase very rapidly. ML can efficiently perform several analyses of clustering, regression and classification of damage in diverse structures, including bridges, buildings, dams, tunnels, wind turbines, etc. In this systematic review, the diverse ML algorithms used in this domain have been classified into two major subfields: vibration-based SHM and image-based SHM. The efficacy of deploying ML algorithms in SHM has been discussed and detailed critical analysis of ML applications in SHM has been provided. Accordingly, practical recommendations have been made and current knowledge gaps and future research needs have been outlined.

[1]  Junjie Li,et al.  Prediction of long-term temperature effect in structural health monitoring of concrete dams using support vector machines with Jaya optimizer and salp swarm algorithms , 2019, Adv. Eng. Softw..

[2]  Tienfuan Kerh,et al.  Neural network estimation of ground peak acceleration at stations along Taiwan high-speed rail system , 2005, Eng. Appl. Artif. Intell..

[3]  Amir Hossein Alavi,et al.  Detection of fatigue cracking in steel bridge girders: A support vector machine approach , 2017 .

[4]  J. Mata,et al.  Interpretation of concrete dam behaviour with artificial neural network and multiple linear regression models , 2011 .

[5]  A. Todoroki,et al.  Wireless detection of internal delamination cracks in CFRP laminates using oscillating frequency changes , 2006 .

[6]  Xuefeng Zhao,et al.  Automatic pixel‐level multiple damage detection of concrete structure using fully convolutional network , 2019, Comput. Aided Civ. Infrastructure Eng..

[7]  Jiafan Peng,et al.  Application of machine learning method in bridge health monitoring , 2017, 2017 Second International Conference on Reliability Systems Engineering (ICRSE).

[8]  Yoshihiko Hamamoto,et al.  A robust automatic crack detection method from noisy concrete surfaces , 2011, Machine Vision and Applications.

[9]  I. Jolliffe Principal Component Analysis , 2005 .

[10]  Keith Worden,et al.  On switching response surface models, with applications to the structural health monitoring of bridges , 2018 .

[11]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[12]  Donghan Lee,et al.  Robust Concrete Crack Detection Using Deep Learning-Based Semantic Segmentation , 2019, International Journal of Aeronautical and Space Sciences.

[13]  Jian Zhang,et al.  Zernike‐moment measurement of thin‐crack width in images enabled by dual‐scale deep learning , 2018, Comput. Aided Civ. Infrastructure Eng..

[14]  Soojin Cho,et al.  Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique , 2018, Sensors.

[15]  Curtis A. Brown,et al.  Assessing the Threat to Life from DAM Failure , 1988 .

[16]  Sung-Han Sim,et al.  Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing , 2017, Sensors.

[17]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[18]  Z. Bažant,et al.  Fracture and Size Effect in Concrete and Other Quasibrittle Materials , 1997 .

[19]  Wang Fan,et al.  A Study on the Application of GA-BP Neural Network in the Bridge Reliability Assessment , 2008, 2008 International Conference on Computational Intelligence and Security.

[20]  Ao Zhang,et al.  Structural Health Monitoring of Offshore Wind Turbine based on Online Data-driven Support Vector Machine , 2018, 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS).

[21]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Cigb Icold,et al.  Dam Surveillance Guide , 2018 .

[23]  H. J. Sutherland,et al.  The application of non-destructive techniques to the testing of a wind turbine blade , 1994 .

[24]  Sahibsingh A. Dudani The Distance-Weighted k-Nearest-Neighbor Rule , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Hitoshi Furuta,et al.  Concrete Crack Detection Using UAV and Deep Learning , 2019 .

[26]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[27]  Dan M. Frangopol,et al.  Life-cycle of structural systems: recent achievements and future directions† , 2016 .

[28]  Jia Liu,et al.  Concrete dam deformation prediction model for health monitoring based on extreme learning machine , 2017 .

[29]  Weijie Li,et al.  Application of support vector machine for pattern classification of active thermometry‐based pipeline scour monitoring , 2015 .

[30]  Hojjat Adeli,et al.  Signal Processing Techniques for Vibration-Based Health Monitoring of Smart Structures , 2016 .

[31]  Ardeshir Bahreininejad,et al.  Damage detection of truss bridge joints using Artificial Neural Networks , 2008, Expert Syst. Appl..

[32]  Eugenio Oñate,et al.  An empirical comparison of machine learning techniques for dam behaviour modelling , 2015 .

[33]  Benoit Fournier,et al.  Overall assessment of Alkali-Aggregate Reaction (AAR) in concretes presenting different strengths and incorporating a wide range of reactive aggregate types and natures , 2017 .

[34]  Joshua Zhexue Huang,et al.  Exploring and cleaning big data with random sample data blocks , 2019, Journal of Big Data.

[35]  Lin Cheng,et al.  Two online dam safety monitoring models based on the process of extracting environmental effect , 2013, Adv. Eng. Softw..

[36]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[37]  Xiao Liang,et al.  Image‐based post‐disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization , 2018, Comput. Aided Civ. Infrastructure Eng..

[38]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[39]  Dimos Polyzois,et al.  Deep learning-based automatic volumetric damage quantification using depth camera , 2019, Automation in Construction.

[40]  Flávio de Souza Barbosa,et al.  Automated real-time damage detection strategy using raw dynamic measurements , 2019, Engineering Structures.

[41]  Wensheng Su,et al.  Autonomous bolt loosening detection using deep learning , 2019, Structural Health Monitoring.

[42]  Fausto Pedro García Márquez,et al.  Linear and nonlinear features and machine learning for wind turbine blade ice detection and diagnosis , 2019, Renewable Energy.

[43]  Andreas Poullikkas,et al.  Overview of current and future energy storage technologies for electric power applications , 2009 .

[44]  Anton van den Hengel,et al.  Wider or Deeper: Revisiting the ResNet Model for Visual Recognition , 2016, Pattern Recognit..

[45]  Benoit Fournier,et al.  Comprehensive damage assessment in concrete affected by different internal swelling reaction (ISR) mechanisms , 2018 .

[46]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[47]  Xijun Ye,et al.  An Integrated Machine Learning Algorithm for Separating the Long-Term Deflection Data of Prestressed Concrete Bridges , 2018, Sensors.

[48]  Mannur J. Sundaresan,et al.  A Study of Machine Learning Techniques for Detecting and Classifying Structural Damage , 2015 .

[49]  Nenad Grujovic,et al.  Development of support vector regression identification model for prediction of dam structural behaviour , 2014 .

[50]  Christopher Niezrecki,et al.  Wind Turbine Blade Damage Detection Using Various Machine Learning Algorithms , 2016 .

[51]  Robert J. Thomas,et al.  Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete , 2018, Construction and Building Materials.

[52]  Gian Marco Revel,et al.  AUTOMATED MODAL ANALYSIS BY SCANNING LASER VIBROMETRY: PROBLEMS AND UNCERTAINTIES ASSOCIATED WITH THE SCANNING SYSTEM CALIBRATION , 2001 .

[53]  Nizar Smaoui,et al.  Evaluation of the expansion attained to date by concrete affected by alkali–silica reaction. Part III: Application to existing structures , 2005 .

[54]  Hong Hao,et al.  Bridge condition assessment under moving loads using multi-sensor measurements and vibration phase technology , 2018 .

[55]  Vijayan K. Asari,et al.  The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches , 2018, ArXiv.

[56]  Nobuo Takeda,et al.  Characterization of microscopic damage in composite laminates and real-time monitoring by embedded optical fiber sensors , 2002 .

[57]  David Santillán,et al.  Predicción de lecturas de aforos de filtraciones de presas bóveda mediante redes neuronales artificiales , 2014 .

[58]  Oral Büyüköztürk,et al.  Modal Strain Energy Based Damage Detection Using Multi-Objective Optimization , 2014 .

[59]  Vineet R. Kamat,et al.  Remote proximity monitoring between mobile construction resources using camera-mounted UAVs , 2019, Automation in Construction.

[60]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[61]  Yozo Fujino,et al.  Experimental study of laser Doppler vibrometer and ambient vibration for vibration-based damage detection , 2006 .

[62]  J M W Brownjohn,et al.  Structural health monitoring of civil infrastructure , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[63]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[64]  Sung-Han Sim,et al.  Crack and Noncrack Classification from Concrete Surface Images Using Machine Learning , 2019 .

[65]  Takayuki Okatani,et al.  A vision-based method for crack detection in gusset plate welded joints of steel bridges using deep convolutional neural networks , 2019, Automation in Construction.

[66]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[67]  Moncef L. Nehdi,et al.  Infrared thermography model for automated detection of delamination in RC bridge decks , 2018 .

[68]  Tania Stathaki,et al.  Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing , 2018, Applied Intelligence.

[69]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[70]  Jung-Ryul Lee,et al.  A Fully Non-Contact Ultrasonic Propagation Imaging System for Closed Surface Crack Evaluation , 2012 .

[71]  Ambuj K. Singh,et al.  Real-time nondestructive structural health monitoring using support vector machines and wavelets , 2005, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[72]  Vahid Nourani,et al.  Integration of Artificial Neural Networks with Radial Basis Function Interpolation in Earthfill Dam Seepage Modeling , 2013, J. Comput. Civ. Eng..

[73]  Leandro F.M. Sanchez,et al.  Using Machine Learning for Condition Assessment of Concrete Infrastructure , 2019 .

[74]  Yoshihide Sekimoto,et al.  Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images , 2018, Comput. Aided Civ. Infrastructure Eng..

[75]  Tu Xuyan,et al.  A bridge structural health data analysis model based on semi-supervised learning , 2011, 2011 IEEE International Conference on Automation and Logistics (ICAL).

[76]  V. Verijenko,et al.  A new structural health monitoring system for composite laminates , 2005 .

[77]  A. Hillerborg,et al.  Analysis of crack formation and crack growth in concrete by means of fracture mechanics and finite elements , 1976 .

[78]  Koji Unno DAMAGE DETECTION OF TRUSS STRUCTURES BY APPLYING MACHINE LEARNING ALGORITHMS , 2019 .

[79]  Xiaochun Luo,et al.  Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network , 2018, Comput. Aided Civ. Infrastructure Eng..

[80]  Li Xinping,et al.  The prediction method of long-span cable-stayed bridge construction control based on BP neural network , 2007 .

[81]  Moncef L. Nehdi,et al.  MAT-713: EVALUATION OF NDT TECHNIQUES FOR CONCRETE BRIDGE DECKS USING FUZZY ANALYTICAL HIERARCHY PROCESS , 2016 .

[82]  Pascal Frossard,et al.  Adaptive data augmentation for image classification , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[83]  Tianyu Gao,et al.  Damage Degree Identification of Crane Girder Based on the Support Vector Machine , 2018, 2018 Prognostics and System Health Management Conference (PHM-Chongqing).

[84]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[85]  Nenad Grujovic,et al.  Predicting piezometric water level in dams via artificial neural networks , 2012, Neural Computing and Applications.

[86]  Meng Yang,et al.  Time-varying identification model for dam behavior considering structural reinforcement , 2015 .

[87]  Hojjat Adeli,et al.  A novel machine learning‐based algorithm to detect damage in high‐rise building structures , 2017 .

[88]  Li Li,et al.  DeepCrack: A deep hierarchical feature learning architecture for crack segmentation , 2019, Neurocomputing.

[89]  Takumi Ito,et al.  Timber Health Monitoring using piezoelectric sensor and machine learning , 2017, 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[90]  Xindong Wu,et al.  Data mining: artificial intelligence in data analysis , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..

[91]  Benoit Fournier,et al.  Use of Damage Rating Index to Quantify Alkali-Silica Reaction Damage in Concrete: Fine versus Coarse Aggregate , 2016 .

[92]  Won-Hwa Hong,et al.  Application of Crack Identification Techniques for an Aging Concrete Bridge Inspection Using an Unmanned Aerial Vehicle , 2018, Sensors.

[93]  Richard Malm,et al.  Proceedings of the 14th ICOLD International Benchmark Workshop on Numerical Analysis of Dams , 2017 .

[94]  Yi-Qing Ni,et al.  Structural Health Monitoring of Large Civil Engineering Structures , 2018 .

[95]  Qian-shu Li,et al.  Quantitative structure–activity relationship model for amino acids as corrosion inhibitors based on the support vector machine and molecular design , 2014 .

[96]  Yang Wang,et al.  A clustering approach for structural health monitoring on bridges , 2016 .

[97]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[98]  Mir M. Ali,et al.  Tall Buildings and Urban Habitat of the 21st Century: A Global Perspective , 2012 .

[99]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[100]  A. Carpinteri,et al.  AE monitoring of a concrete arch road tunnel: Damage evolution and localization , 2019, Engineering Fracture Mechanics.

[101]  Duzgun Agdas,et al.  Comparison of visual inspection and structural-health monitoring as bridge condition assessment methods , 2016 .

[102]  Eugenio Oñate,et al.  Early detection of anomalies in dam performance: A methodology based on boosted regression trees , 2017 .

[103]  Maria Q. Feng,et al.  Long-Term Monitoring and Identification of Bridge Structural Parameters , 2009 .

[104]  Eleni Chatzi,et al.  Applying design knowledge and machine learning to scada data for classification of wind turbine operating regimes , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[105]  Charles R. Farrar,et al.  Structural Health Monitoring: A Machine Learning Perspective , 2012 .

[106]  Jung-Ryul Lee,et al.  Structural health monitoring for a wind turbine system: a review of damage detection methods , 2008 .

[107]  Hojjat Adeli,et al.  A novel unsupervised deep learning model for global and local health condition assessment of structures , 2018 .

[108]  Gangbing Song,et al.  Damage Detection of a Concrete Column Subject to Blast Loads Using Embedded Piezoceramic Transducers , 2018, Sensors.

[109]  Liang Yang,et al.  Wall-climbing robot for non-destructive evaluation using impact-echo and metric learning SVM , 2017, International Journal of Intelligent Robotics and Applications.

[110]  Gethin Wyn Roberts,et al.  Novel Non-contact Deformation Health Monitoring of Towers and Rotating Composite Based Wind Turbine Blades Using Interferometric Ground Based Radar , 2018 .

[111]  Fausto Pedro García Márquez,et al.  Dirt and mud detection and diagnosis on a wind turbine blade employing guided waves and supervised learning classifiers , 2018, Reliab. Eng. Syst. Saf..

[112]  Ioannis Brilakis,et al.  Multi-classifier for reinforced concrete bridge defects , 2019, Automation in Construction.

[113]  Xavier E. Gros,et al.  An eddy current approach to the detection of damage caused by low-energy impacts on carbon fibre reinforced materials , 1995 .

[114]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[115]  Chin-Hsiung Loh,et al.  Monitoring of long‐term static deformation data of Fei‐Tsui arch dam using artificial neural network‐based approaches , 2013 .

[116]  F. Necati Catbas,et al.  A machine learning-based algorithm for processing massive data collected from the mechanical components of movable bridges , 2016 .

[117]  Giorgio Busca,et al.  Statistical pattern recognition approach for long-time monitoring of the G.Meazza stadium by means of AR models and PCA , 2017 .

[118]  Tzu-Kang Lin,et al.  Applications of neural network models for structural health monitoring based on derived modal properties , 2018, Measurement.

[119]  José L. Zapico,et al.  Seismic damage identification in buildings using neural networks and modal data , 2008 .

[120]  Niannian Wang,et al.  Automatic damage detection of historic masonry buildings based on mobile deep learning , 2019, Automation in Construction.

[121]  Jinping Ou,et al.  A stereovision-based crack width detection approach for concrete surface assessment , 2016 .

[122]  Amir Mosavi,et al.  Prediction of remaining service life of pavement using an optimized support vector machine (case study of Semnan–Firuzkuh road) , 2019, Engineering Applications of Computational Fluid Mechanics.

[123]  Valeria V. Krzhizhanovskaya,et al.  Anomaly detection in earth dam and levee passive seismic data using support vector machines and automatic feature selection , 2017, J. Comput. Sci..

[124]  Kelvin C. P. Wang,et al.  Deep Learning for Asphalt Pavement Cracking Recognition Using Convolutional Neural Network , 2017 .

[125]  Guang-Bin Huang,et al.  Convex Incremental Extreme Learning Machine , 2007 .

[126]  Maria Giuseppina Limongelli,et al.  Seismic Structural Health Monitoring From Theory to Successful Applications , 2019 .

[127]  Ranjith Liyanapathirana,et al.  Machine Learning Techniques for Structural Health Monitoring , 2020 .

[128]  Gunner Chr. Larsen,et al.  Fundamentals for remote structural health monitoring of wind turbine blades - a preproject , 2002 .

[129]  S. Lenart,et al.  Corrosion Monitoring of Steel Structure Coating Degradation , 2018, Tehnicki vjesnik - Technical Gazette.

[130]  Khalid M. Mosalam,et al.  Deep Transfer Learning for Image‐Based Structural Damage Recognition , 2018, Comput. Aided Civ. Infrastructure Eng..