Intelligent Detection for Tunnel Shotcrete Spray Using Deep Learning and LiDAR

Shotcrete spray is an indispensable process in tunnel construction. At present, the construction of tunnels in China is mainly depend on labor or mobile concrete sprayer, which has lots problems like time-consuming, low precision, and labor intensive. An intelligent detection method for tunnel shotcrete spraying is proposed in this article. There are two main issues need to be solved, one is the modeling of tunnel in real-time to monitor the thickness of shotcrete and other is the detection of spraying area in the tunnel. The LiDAR can obtain a 3D model of tunnel after performing necessary preprocess on it in real-time. On the other hand, the spraying areas are usually divided by arches in the tunnel, so we can detect the position of arches to determine the spraying areas. Inspired by the YOLO algorithm, we proposed a novel neural network structure to detect the approximate bounding boxes of the arches and a line-detection algorithm is used to determine the final positions of the spraying area in the image. The size of the weight file of our neural network is only 2.57 MB after the use of some deep compression tricks, which means our model is device friendly. After that, the object detection results in the image will be projected to the point cloud data. The experimental results suggest that our method performed well in the detection for tunnel shotcrete spraying, and the mAP for spraying area detection was found to be 91.4%.

[1]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Marc Jolin,et al.  Investigation of spray pattern in shotcrete applications , 2015 .

[3]  Paulo Peixoto,et al.  3D Lidar-based static and moving obstacle detection in driving environments: An approach based on voxels and multi-region ground planes , 2016, Robotics Auton. Syst..

[4]  Hui-Ping Tserng,et al.  Automated construction of the Paghuashan tunnel for Taiwan High Speed Rail (THSR) project , 2006 .

[5]  Peter E. D. Love,et al.  Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach , 2018, Adv. Eng. Informatics.

[6]  Ki-Il Song,et al.  Bonding state evaluation of tunnel shotcrete applied onto hard rocks using the impact-echo method , 2009 .

[7]  Shinpei Kato,et al.  An Open Approach to Autonomous Vehicles , 2015, IEEE Micro.

[8]  Yulu Wu,et al.  Study of Huizhou architecture component point cloud in surface reconstruction , 2017 .

[9]  Paulo Peixoto,et al.  Multimodal vehicle detection: fusing 3D-LIDAR and color camera data , 2017, Pattern Recognit. Lett..

[10]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ling Shao,et al.  3D object detection: Learning 3D bounding boxes from scaled down 2D bounding boxes in RGB-D images , 2019, Inf. Sci..

[13]  Benoît Bissonnette,et al.  Effect of equipment on spray velocity distribution in shotcrete applications , 2014 .

[14]  Liang Xiao,et al.  Hybrid conditional random field based camera-LIDAR fusion for road detection , 2017, Inf. Sci..

[15]  Pengyi Zhang,et al.  SlimYOLOv3: Narrower, Faster and Better for Real-Time UAV Applications , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[16]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[17]  W. Marsden.  I and J , 2012 .

[18]  Junsong Yuan,et al.  Fusion of 3D-LIDAR and camera data for scene parsing , 2014, J. Vis. Commun. Image Represent..

[19]  Yu Liu,et al.  3D object understanding with 3D Convolutional Neural Networks , 2016, Inf. Sci..

[20]  Jie Gong,et al.  Automated residential building detection from airborne LiDAR data with deep neural networks , 2018, Adv. Eng. Informatics.

[21]  Lennart Svensson,et al.  LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks , 2018, Robotics Auton. Syst..

[22]  Jen-Yu Han,et al.  Monitoring tunnel deformations by means of multi-epoch dispersed 3D LiDAR point clouds: An improved approach , 2013 .

[23]  Ingo Neumann,et al.  An automatic and intelligent optimal surface modeling method for composite tunnel structures , 2019, Composite Structures.

[24]  Edwin Valarezo,et al.  Simultaneous Detection and Classification of Breast Masses in Digital Mammograms via a Deep Learning YOLO-based CAD System , 2018, Comput. Methods Programs Biomed..

[25]  Qian Wang,et al.  Applications of 3D point cloud data in the construction industry: A fifteen-year review from 2004 to 2018 , 2019, Adv. Eng. Informatics.

[26]  Min-Yuan Cheng,et al.  Technological enhancement and creation of a computer-aided construction system for the shotcreting robot , 2001 .

[27]  Swati R. Maurya,et al.  Performance of Greedy Triangulation Algorithm on Reconstruction of Coastal Dune Surface , 2018, 2018 3rd International Conference for Convergence in Technology (I2CT).

[28]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[29]  Weimin Li,et al.  A modified ICP algorithm based on dynamic adjustment factor for registration of point cloud and CAD model , 2015, Pattern Recognit. Lett..

[30]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[31]  Bin Xie,et al.  Automatic Tunnel Steel Arches Extraction Algorithm Based on 3D LiDAR Point Cloud , 2019, Sensors.

[32]  En Li,et al.  Apple detection during different growth stages in orchards using the improved YOLO-V3 model , 2019, Comput. Electron. Agric..

[33]  Xibing Li,et al.  Mechanical behavior of rock-shotcrete interface under static and dynamic tensile loads , 2017 .

[34]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  A. W. Moore.  An Intoductory Tutorial on Kd-trees Extract from Andrew Moore's Phd Thesis: Eecient Memory-based L Earning for Robot Control , 1991 .

[36]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[37]  Jian Wang,et al.  Deep learning and its application in geochemical mapping , 2019, Earth-Science Reviews.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[39]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Jen-Yu Han,et al.  Monitoring tunnel profile by means of multi-epoch dispersed 3-D LiDAR point clouds , 2013 .

[41]  Claire Samson,et al.  Wire mesh filtering in 3D image data of rock faces , 2016 .

[42]  C. Samson,et al.  Applications of mesh parameterization and deformation for unwrapping 3D images of rock tunnels , 2016 .

[43]  Liu Hongchen.  An object extraction method based on HSI color model , 2006 .

[44]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.