Bridge weigh-in-motion through bidirectional Recurrent Neural Network with long short-term memory and attention mechanism

In bridge weigh-in-motion (BWIM), dynamic bridge response is measured during traffic and used to identify overloaded vehicles. Most past studies of BWIM use mechanics-based algorithms to estimate axle weights. This research instead investigates deep learning, specifically the recurrent neural network (RNN), toward BWIM. In order to acquire the large data volume to train a RNN network that uses bridge response to estimate axle weights, a finite element bridge model is built through the commercial software package LS-DYNA. To mimic everyday traffic scenarios, tens of thousands of randomized vehicle formations are simulated, with different combinations of vehicle types, spacings, speeds, axle weights, axle distances, etc. Dynamic response from each of the randomized traffic scenarios is recorded for training the RNN. In this paper we propose a 3-stage Bidirectional RNN toward BWIM. Long short-term memory (LSTM) and attention mechanism are embedded in the BRNN to further improve the network performance. Additional test data indicates that the BRNN network achieves high accuracy in estimating axle weights, in comparison with a conventional moving force identification (MFI) method.

[1]  Atsuhiro Takasu,et al.  Deep Sensing Approach to Single-Sensor Vehicle Weighing System on Bridges , 2019, IEEE Sensors Journal.

[2]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[3]  Siu-Seong Law,et al.  Structural Health Monitoring Based on Vehicle-Bridge Interaction: Accomplishments and Challenges , 2015 .

[4]  Rui Zhang,et al.  A Vehicle Weigh-in-Motion System Based on Hopfield Neural Network Adaptive Filter , 2010, 2010 International Conference on Communications and Mobile Computing.

[5]  C. S. Cai,et al.  State-of-the-art review on bridge weigh-in-motion technology , 2016 .

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  S. S. Law,et al.  MOVING FORCE IDENTIFICATION: OPTIMAL STATE ESTIMATION APPROACH , 2001 .

[9]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[10]  Fred Moses,et al.  Weigh-In-Motion System Using Instrumented Bridges , 1979 .

[11]  Shi Zhi-yu Identification of vehicle axle loads based on FEM-Wavelet-Galerkin method , 2006 .

[12]  Byung-Wan Jo,et al.  Vehicle Signal Analysis Using Artificial Neural Networks for a Bridge Weigh-in-Motion System , 2009, Sensors.

[13]  Tommy H.T. Chan,et al.  Dynamic wheel loads from bridge strains , 1988 .

[14]  Tommy H.T. Chan,et al.  Moving force identification - A frequency and time domains analysis , 1999 .

[15]  Aleš Žnidarič,et al.  Application of Bridge Weigh-in-Motion measurements in assessment of existing road bridges , 2017 .

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[17]  Siu-Seong Law,et al.  Recent developments in inverse problems of vehicle–bridge interaction dynamics , 2016 .

[18]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ganesh Chandra Deka,et al.  History and Evolution of GPU Architecture , 2016 .

[20]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[21]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[22]  S. S. Law,et al.  An interpretive method for moving force identification , 1999 .

[23]  Tommy H.T. Chan,et al.  Moving force identification: A time domain method , 1997 .

[24]  Yoshua Bengio,et al.  End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results , 2014, ArXiv.

[25]  Gongkang Fu,et al.  Vehicular Overloads: Load Model, Bridge Safety, and Permit Checking , 2000 .

[26]  Xinqun Zhu,et al.  A State Space Formulation for Moving Loads Identification , 2006 .

[27]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[28]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[29]  Myra Lydon,et al.  Recent developments in bridge weigh in motion (B-WIM) , 2016 .

[30]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[31]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[32]  Eugene J. O'Brien,et al.  A general solution to the identification of moving vehicle forces on a bridge , 2008 .

[33]  Michael Quilligan,et al.  Bridge weigh-in motion : development of a 2-D multi-vehicle algorithm , 2003 .

[34]  Meng Zhang,et al.  Recent Advances in Convolutional Neural Network Acceleration , 2018, Neurocomputing.

[35]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[36]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..