Multi-Point Displacement Monitoring Based on Full Convolutional Neural Network and Smartphone

Displacement monitoring has always been an important branch of structural health monitoring. Among them, multi-point displacement monitoring can not only reduce the monitoring costs, but also improve the monitoring efficiency. Therefore, this paper proposes a multi-point displacement monitoring technology based on full convolutional neural network (FCN) and smartphone. It combines machine vision and deep learning to extract the object information for displacement monitoring. First, a dataset with 400 images was collected, and this dataset contains only one category: mark. Second, the dataset was trained by FCN to obtain a detection model, which can perform pixel-level segmentation on multiple masks in the image, and the average mean intersection over union (MIoU) is 0.9774. Third, in order to verify the feasibility of the proposed method to monitor multi-point displacement, a validation experiment was completed, and the information of four masks in the image can be extracted simultaneously. Fourth, sensitivity analysis was completed. The test results showed that this method can achieve 0.5 mm monitoring for the mark at a distance of 2.5 m. Finally, error analysis was completed. The test results showed that the monitoring errors of mark at 2.5 m and 5 m are less than 1%. The monitoring errors of mark at 7.5 m and 10 m are 1.696% and 1.997% respectively. Although the monitoring error increases with the increase of distance, it can still meet the needs of engineering practice. In addition, this paper uses smartphone to collect the images of mark, it further reduces the monitoring costs, and improves the convenience of monitoring.

[1]  Maria Q. Feng,et al.  Vision‐based multipoint displacement measurement for structural health monitoring , 2016 .

[2]  Wensheng Su,et al.  Autonomous bolt loosening detection using deep learning , 2019, Structural Health Monitoring.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Gokhan Pekcan,et al.  Vibration‐based structural condition assessment using convolution neural networks , 2018, Structural Control and Health Monitoring.

[5]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[6]  Peng Liu,et al.  Horizontal displacement monitoring method of deep foundation pit based on laser image recognition technology. , 2018, The Review of scientific instruments.

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Ki-Tae Park,et al.  The determination of bridge displacement using measured acceleration , 2005 .

[9]  Edy Tonnizam Mohamad,et al.  A combination of artificial bee colony and neural network for approximating the safety factor of retaining walls , 2018, Eng. Comput..

[10]  Ramesh Govindan,et al.  Understanding packet delivery performance in dense wireless sensor networks , 2003, SenSys '03.

[11]  Daniel J. Inman,et al.  Impedance-Based Structural Health Monitoring with Artificial Neural Networks , 2000 .

[12]  Jin-Hee Ahn,et al.  Structural dynamic displacement vision system using digital image processing , 2011 .

[13]  A. Smyth,et al.  Multi-rate Kalman filtering for the data fusion of displacement and acceleration response measurement in dynamic system monitoring , 2007 .

[14]  Niannian Wang,et al.  Bolt loosening angle detection technology using deep learning , 2018, Structural Control and Health Monitoring.

[15]  Chung Bang Yun,et al.  Impedance-based structural health monitoring incorporating neural network technique for identification of damage type and severity , 2012 .

[16]  Deborah Estrin,et al.  A wireless sensor network For structural monitoring , 2004, SenSys '04.

[17]  Hyun Myung,et al.  Vision-based displacement measurement method for high-rise building structures using partitioning approach , 2010 .

[18]  Adnan M. Abu-Mahfouz,et al.  Fragmentation-Based Distributed Control System for Software-Defined Wireless Sensor Networks , 2019, IEEE Transactions on Industrial Informatics.

[19]  Zhan Gao,et al.  A new laser displacement sensor based on triangulation for gauge real-time measurement , 2008 .

[20]  Sung-Han Sim,et al.  Development of a Wireless Displacement Measurement System Using Acceleration Responses , 2013, Sensors.

[21]  X. W. Ye,et al.  Image-based structural dynamic displacement measurement using different multi-object tracking algorithms , 2016 .

[22]  Kuang Cuifang Present Status of High Precision Laser Displacement Sensor Based on Triangulation , 2004 .

[23]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).