Customized Mobile LiDAR System for Manhole Cover Detection and Identification

Manhole covers, which are a key element of urban infrastructure management, have a direct impact on travel safety. At present, there is no automatic, safe, and efficient system specially used for the intelligent detection, identification, and assessment of manhole covers. In this work, we developed an automatic detection, identification, and assessment system for manhole covers. First, we developed a sequential exposure system via the addition of multiple cameras in a symmetrical arrangement to realize the joint acquisition of high-precision laser data and ultra-high-resolution ground images. Second, we proposed an improved histogram of an oriented gradient with symmetry features and a support vector machine method to detect manhole covers effectively and accurately, by using the intensity images and ground orthophotos that are derived from the laser points and images, respectively, and apply the graph segmentation and statistical analysis to achieve the detection, identification, and assessment of manhole covers. Qualitative and quantitative analyses are performed using large experimental datasets that were acquired with the modified manhole-cover detection system. The detected results yield an average accuracy of 96.18%, completeness of 94.27%, and F-measure value of 95.22% in manhole cover detection. Defective manhole-cover monitoring and manhole-cover ownership information are achieved from these detection results. The results not only provide strong support for road administration works, such as data acquisition, manhole cover inquiry and inspection, and statistical analysis of resources, but also demonstrate the feasibility and effectiveness of the proposed method, which reduces the risk involved in performing manual inspections, improves the manhole-cover detection accuracy, and serves as a powerful tool in intelligent road administration.

[1]  Joaquín Martínez-Sánchez,et al.  Automatic detection of zebra crossings from mobile LiDAR data , 2015 .

[2]  Jen-Yu Han,et al.  Automatic reconstruction of road surface features by using terrestrial mobile lidar , 2015 .

[3]  Li Lin,et al.  Manhole detection and location for urban pavement , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[4]  Ahmed Shaker,et al.  Automatic extraction of highway light poles and towers from mobile LiDAR data , 2016 .

[5]  Wendy Flores-Fuentes,et al.  Combined application of Power Spectrum Centroid and Support Vector Machines for measurement improvement in Optical Scanning Systems , 2014, Signal Process..

[6]  Haiyan Guan,et al.  Automated Detection of Urban Road Manhole Covers Using Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  Pengfei Liu,et al.  Automated extraction of manhole covers using mobile LiDAR data , 2014 .

[8]  Chen Maolin,et al.  Laser data based automatic recognition and maintenance of road markings from MLS system , 2018, Optics & Laser Technology.

[9]  Rached Tourki,et al.  Human detection based on integral Histograms of Oriented Gradients and SVM , 2011, 2011 International Conference on Communications, Computing and Control Applications (CCCA).

[10]  Kazuhiko Murasaki,et al.  写真撮影によるマンホール鉄蓋摩耗度推定;写真撮影によるマンホール鉄蓋摩耗度推定;Manhole Cover Wearing Detection by Photo-taking , 2015 .

[11]  Lena Gorelick,et al.  GrabCut in One Cut , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  Liu Jianhua Research on algorithm of automatically recognizing and positioning road manhole covers based on vehicle-mounted sensors , 2011 .

[13]  Allen Y. Chang,et al.  Search, Identification and Positioning of the Underground Manhole with RFID Ground Tag , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[14]  Manhole Cover Intelligent Detection and Management System , 2016 .

[15]  Paul H. Lewis,et al.  An automated algorithm for extracting road edges from terrestrial mobile LiDAR data , 2013 .

[16]  Ruofei Zhong,et al.  Automatic Extraction of Road Markings from Mobile Laser Scanning Data , 2017 .

[17]  Yun Shi,et al.  MANHOLE COVER DETECTION USING VEHICLE-BASED MULTI-SENSOR DATA , 2012 .

[18]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[19]  Luc Van Gool,et al.  Multi-view manhole detection, recognition, and 3D localisation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[20]  Bisheng Yang,et al.  Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds , 2013 .

[21]  Andrew Beng Jin Teoh,et al.  A new sparse model for traffic sign classification using soft histogram of oriented gradients , 2017, Appl. Soft Comput..

[22]  Li Hong Zhang Human Detection Based on SVM and Improved Histogram of Oriented Gradients , 2013 .

[23]  Lin Li,et al.  A dual growing method for the automatic extraction of individual trees from mobile laser scanning data , 2016 .

[24]  J. Li,et al.  Automated Detection of Road Manhole Covers from Mobile LiDAR Point-Clouds Based on a Marked Point Process , 2013, 2013 Fifth International Conference on Geo-Information Technologies for Natural Disaster Management.

[25]  Wendy Flores-Fuentes,et al.  Mobile robot vision system using continuous laser scanning for industrial application , 2016, Ind. Robot.

[26]  马国成,et al.  Robust lane recognition for structured road based on monocular vision , 2014 .

[27]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .