Estimating Pavement Roughness by Fusing Color and Depth Data Obtained from an Inexpensive RGB-D Sensor

Measuring pavement roughness and detecting pavement surface defects are two of the most important tasks in pavement management. While existing pavement roughness measurement approaches are expensive, the primary aim of this paper is to use a cost-effective and sufficiently accurate RGB-D sensor to estimate the pavement roughness in the outdoor environment. An algorithm is proposed to process the RGB-D data and autonomously quantify the road roughness. To this end, the RGB-D sensor is calibrated and primary data for estimating the pavement roughness are collected. The collected depth frames and RGB images are registered to create the 3D road surfaces. We found that there is a significant correlation between the estimated International Roughness Index (IRI) using the RGB-D sensor and the manual measured IRI using rod and level. By considering the Power Spectral Density (PSD) analysis and the repeatability of measurement, the results show that the proposed solution can accurately estimate the different pavement roughness.

[1]  Amir Golroo,et al.  KINECT, A NOVEL CUTTING EDGE TOOL IN PAVEMENT DATA COLLECTION , 2015 .

[2]  Burcin Becerik-Gerber,et al.  Unsupervised Approach for Autonomous Pavement-Defect Detection and Quantification Using an Inexpensive Depth Sensor , 2013, J. Comput. Civ. Eng..

[3]  S D Kohn,et al.  Quantification of smoothness index differences related to long-term pavement performance equipment type , 2005 .

[4]  Li Ningyuan,et al.  Evaluation of Semiautomated and Automated Pavement Distress Collection for Network-Level Pavement Management , 2008 .

[5]  Ralph Haas,et al.  Pavement Asset Management , 2015 .

[6]  Khurram Kamal,et al.  Metrology and visualization of potholes using the microsoft kinect sensor , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[7]  Giuseppe Cantisani,et al.  Road Roughness and Whole Body Vibration: Evaluation Tools and Comfort Limits , 2010 .

[8]  Achim J. Lilienthal,et al.  Comparative evaluation of range sensor accuracy for indoor mobile robotics and automated logistics applications , 2013, Robotics Auton. Syst..

[9]  Simone Zennaro.  Evaluation of Microsoft Kinect 360 and Microsoft Kinect One for robotics and computer vision applications , 2014 .

[10]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[11]  Yubo Zhao.  Road condition and road roughness assessment by tire/road interaction using microphone, dynamic tire pressure sensor with an axle accelerometer , 2016 .

[12]  Hiroyuki Oneyama,et al.  A study on the use of smartphones under realistic settings to estimate road roughness condition , 2014, EURASIP J. Wirel. Commun. Netw..

[13]  Guohui Zhang,et al.  A Kinect-Based Approach for 3D Pavement Surface Reconstruction and Cracking Recognition , 2018, IEEE Transactions on Intelligent Transportation Systems.

[14]  Yongqiang Bai,et al.  Research on Low Altitude Aerial Image Stitching , 2018, 2018 37th Chinese Control Conference (CCC).

[15]  William R Vavrik,et al.  Use of Cellphone Application to Measure Pavement Roughness , 2014 .

[16]  Zong Tao Zhang,et al.  Pavement Roughness Indices Related to Riding Comfort , 2014 .

[17]  Lu Sun,et al.  Simulation of pavement roughness and IRI based on power spectral density , 2003, Math. Comput. Simul..

[18]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[19]  G. Wessel,et al.  The oxidative burst at fertilization is dependent upon activation of the dual oxidase Udx1. , 2004, Developmental cell.

[20]  Mrcrmsr W. Savnns.  I On the Calculation of International Roughness Index from Longitudinal Road Profile , 2022 .

[21]  Roger S Walker,et al.  Comparative Testing of Lasers for Ride Quality Measurement on Hot-Mix Asphalt Pavements , 2014 .

[22]  K. D. Mankoff,et al.  The Kinect: a low‐cost, high‐resolution, short‐range 3D camera , 2013 .

[23]  Wen-Chih Peng,et al.  Stitching Aerial Images for Vehicle Positioning and Tracking , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[24]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[25]  Hiroyuki Oneyama,et al.  Estimation of road roughness condition from smartphones under realistic settings , 2013, 2013 13th International Conference on ITS Telecommunications (ITST).

[26]  Roland Siegwart,et al.  Kinect v2 for mobile robot navigation: Evaluation and modeling , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[27]  Chiu Liu,et al.  ROAD PROFILES, VEHICLE DYNAMICS, AND HUMAN JUDGMENT OF SERVICEABILITY OF ROADS: SPECTRAL FREQUENCY DOMAIN ANALYSIS , 1998 .

[28]  Ahmad Alhasan,et al.  Spatial pavement roughness from stationary laser scanning , 2017 .

[29]  Raj Bridgelall,et al.  Road roughness evaluation using in-pavement strain sensors , 2015 .

[30]  Christina Plati,et al.  EVOLUTIONAL PROCESS OF PAVEMENT ROUGHNESS EVALUATION BENEFITING FROM SENSOR TECHNOLOGY , 2008 .

[31]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[32]  Steven M. Karamihas,et al.  Development of cross correlation for objective comparison of profiles , 2004 .

[33]  Chiu Liu,et al.  Road Profile, Vehicle Dynamics, and Ride Quality Rating , 1999 .

[34]  William Whittaker,et al.  Epipolar time-of-flight imaging , 2017, ACM Trans. Graph..

[35]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[36]  Michael Arens,et al.  Low-cost commodity depth sensor comparison and accuracy analysis , 2014, Security and Defence.

[37]  Zhang Yi,et al.  A study of pavement roughness measurement system based on laser ranger finder , 2009, 2009 International Conference on Image Analysis and Signal Processing.

[38]  Ahsan Ali,et al.  Performance assessment of Kinect as a sensor for pothole imaging and metrology* , 2018 .

[39]  Roland Siegwart,et al.  Combined visual odometry and visual compass for off-road mobile robots localization , 2012, Robotica.

[40]  Kourosh Khoshelham,et al.  Accuracy analysis of kinect depth data , 2012 .

[41]  Kerry J. McManus,et al.  Signal processing approach to road roughness analysis and measurement , 2009, TENCON 2009 - 2009 IEEE Region 10 Conference.

[42]  Bandit Suksawat.  Development of multifunction international roughness index and profile measuring device , 2011, 2011 11th International Conference on Control, Automation and Systems.

[43]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[44]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[45]  N. Dong,et al.  Fast Stereo Aerial Image Construction and Measurement for Emergency Rescue , 2013, 2013 Fifth International Conference on Geo-Information Technologies for Natural Disaster Management.

[46]  Kerry J. McManus,et al.  A comparative study of roughness indices for monitoring the performance of thin seal flexible pavements subjected to low traffic volumes in Australia , 2009 .

[47]  Derek D. Lichti,et al.  PERFORMANCE ANALYSIS OF A LOW-COST TRIANGULATION-BASED 3D CAMERA: MICROSOFT KINECT SYSTEM , 2012 .

[48]  Kjella Ahlin,et al.  Relating Road Roughness and Vehicle Speeds to Human Whole Body Vibration and Exposure Limits , 2002 .

[49]  Burcin Becerik-Gerber,et al.  Inexpensive Multimodal Sensor Fusion System for Autonomous Data Acquisition of Road Surface Conditions , 2016, IEEE Sensors Journal.

[50]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[51]  Amir Golroo,et al.  Validation of smartphone based pavement roughness measures , 2019, ArXiv.

[52]  Thomas Butkiewicz.  Low-cost coastal mapping using Kinect v2 time-of-flight cameras , 2014, 2014 Oceans - St. John's.

[53]  Jia-Ruey Chang,et al.  Measurement of the International Roughness Index (IRI) Using an Autonomous Robot (P3-AT) , 2009 .