Convolutional Neural Network for Asphalt Pavement Surface Texture Analysis

Several data processing techniques (DPTs) have been implemented for evaluating pavement surface texture to partially replace onsite inspections by humans. However, the extensively varying real‐world situations have resulted in challenges in the widespread adoption of DPTs. To overcome these challenges, we propose the use of a convolutional neural network (CNN) to calculate the mean texture depth (MTD) without computing the surface texture feature statistics. Because a CNN is capable of automatically learning data features, the proposed method does not require the conjugation of DPTs for extracting features. The proposed CNN was trained and tested using 8,000 and 1,000 3D scan data samples, respectively, and achieved an average error of 0.0024 cm. The stability of the CNN was analyzed based on various test results. Comparative studies were conducted to verify the superiority of the CNN over conventional MTD algorithms. The results demonstrated that the CNN‐based method is significantly more stable in various real‐world situations. Additionally, the CNN‐based method achieved higher accuracy of automatic feature extraction than traditional MTD methods. Finally, the CNN‐based method was applied to evaluate the surface texture statistics of four highways in Shanxi, China, which were different from the training and testing samples; the results establish the transferability of this method to different highways.

[1]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[2]  Jie Gao,et al.  Recognition of asphalt pavement crack length using deep convolutional neural networks , 2018 .

[3]  Tsai-Yun Liao,et al.  On‐Line Vehicle Routing Problems for Carbon Emissions Reduction , 2017, Comput. Aided Civ. Infrastructure Eng..

[4]  Yi-Zhou Lin,et al.  Structural Damage Detection with Automatic Feature‐Extraction through Deep Learning , 2017, Comput. Aided Civ. Infrastructure Eng..

[5]  Jie Gao,et al.  Recognition, location, measurement, and 3D reconstruction of concealed cracks using convolutional neural networks , 2017 .

[6]  Hojjat Adeli,et al.  A novel machine learning‐based algorithm to detect damage in high‐rise building structures , 2017 .

[7]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[8]  Hojjat Adeli,et al.  Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete , 2017 .

[9]  Kris De Brabanter,et al.  Wavelet Filter Design for Pavement Roughness Analysis , 2016, Comput. Aided Civ. Infrastructure Eng..

[10]  Wenyu Liu,et al.  Traffic sign detection and recognition using fully convolutional network guided proposals , 2016, Neurocomputing.

[11]  Liqun Hu,et al.  Effect of three-dimensional macrotexture characteristics on dynamic frictional coefficient of asphalt pavement surface , 2016 .

[12]  Chalavadi Krishna Mohan,et al.  Human action recognition using genetic algorithms and convolutional neural networks , 2016, Pattern Recognit..

[13]  Edward K. Wong,et al.  Dual many-to-one-encoder-based transfer learning for cross-dataset human action recognition , 2016, Image Vis. Comput..

[14]  Martin Valtierra-Rodriguez,et al.  Neurocomputing in Civil Infrastructure , 2016 .

[15]  Daniel Dajun Zeng,et al.  Mining opinion summarizations using convolutional neural networks in Chinese microblogging systems , 2016, Knowl. Based Syst..

[16]  Cécile Barat,et al.  String representations and distances in deep Convolutional Neural Networks for image classification , 2016, Pattern Recognit..

[17]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[18]  Ligang Liu,et al.  Upright orientation of 3D shapes with Convolutional Networks , 2016, Graph. Model..

[19]  Xiang Bai,et al.  Script identification in the wild via discriminative convolutional neural network , 2016, Pattern Recognit..

[20]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[21]  Filippo Giammaria Praticò,et al.  A study on the relationship between mean texture depth and mean profile depth of asphalt pavements , 2015 .

[22]  Xiaodong Gu,et al.  Towards dropout training for convolutional neural networks , 2015, Neural Networks.

[23]  Mao Ye,et al.  Fast crowd density estimation with convolutional neural networks , 2015, Eng. Appl. Artif. Intell..

[24]  Zhang Xiong,et al.  3D object retrieval with stacked local convolutional autoencoder , 2015, Signal Process..

[25]  Burkhard Wies,et al.  Characterization of Pavement Texture by Means of Height Difference Correlation and Relation to Wet Skid Resistance , 2015 .

[26]  Terhi K Pellinen,et al.  Macro- and micro-texture evolution of road pavements and correlation with friction , 2015 .

[27]  Robert Otto Rasmussen,et al.  Pavement Texture Evaluation and Relationships to Rolling Resistance at MnROAD , 2013 .

[28]  Amiruddin Ismail,et al.  Expert System to Control Construction Problems in Flexible Pavements , 2013, Comput. Aided Civ. Infrastructure Eng..

[29]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Zhang Xiong,et al.  ModelSeek: an effective 3D model retrieval system , 2011, Multimedia Tools and Applications.

[31]  Mohamed Saleh,et al.  Stereo-vision applications to reconstruct the 3D texture of pavement surface , 2011 .

[32]  Yihong Gong,et al.  Human Tracking Using Convolutional Neural Networks , 2010, IEEE Transactions on Neural Networks.

[33]  Zhang Xiong,et al.  A 3D shape retrieval framework for 3D smart cities , 2010, Frontiers of Computer Science in China.

[34]  Elisabete F. Freitas,et al.  3D surface profile equipment for the characterization of the pavement texture - TexScan , 2010 .

[35]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[36]  Giuseppe Patanè,et al.  A Minimal Contouring Approach to the Computation of the Reeb Graph , 2009, IEEE Transactions on Visualization and Computer Graphics.

[37]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[38]  Joseph F. Murray,et al.  Supervised Learning of Image Restoration with Convolutional Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[39]  Ioannis A. Kakadiaris,et al.  PTK: A novel depth buffer-based shape descriptor for three-dimensional object retrieval , 2006, The Visual Computer.

[40]  Gary C. Hart,et al.  The structural design of tall and special buildings , 2005 .

[41]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[42]  Hojjat Adeli,et al.  Neural Networks in Civil Engineering: 1989–2000 , 2001 .

[43]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[44]  John P. Zaniewski,et al.  VEHICLE OPERATING COSTS, FUEL CONSUMPTION, AND PAVEMENT TYPE AND CONDITION FACTORS , 1982 .

[45]  Leonardo Franco,et al.  Layer multiplexing FPGA implementation for deep back-propagation learning , 2017, Integr. Comput. Aided Eng..

[46]  Boguslaw Cyganek,et al.  Image recognition with deep neural networks in presence of noise - Dealing with and taking advantage of distortions , 2017, Integr. Comput. Aided Eng..

[47]  Yasha Zeinali,et al.  Competitive probabilistic neural network , 2017, Integr. Comput. Aided Eng..

[48]  Tomasz Gajewski,et al.  Semi-automatic Inspection Tool of Pavement Condition from Three-dimensional Profile Scans , 2017 .

[49]  Peter Kotek,et al.  Analysis of the Pavement Surface Texture by 3D Scanner , 2016 .

[50]  Zhou Xing-li,et al.  Measurement Method for Mean Texture Depth of Asphalt Pavement Based on Laser Vision , 2014 .

[51]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[52]  Martin Slabej,et al.  Using of 3D Road Surface Model for Monitoring of Transverse Unevenness and Skid Resistance , 2014 .

[53]  Liu Qing-quan,et al.  Relationship Between Surface Macrotexture and Skid Resistance of Asphalt Pavement , 2011 .

[54]  Huang Qun-xian,et al.  Statistical Simulation Method for the Response of Stochastic Systems Contained Fractional Derivatives , 2010 .

[55]  Lai An-xing Pavement Surface Texture Measurement with Fractal Theory and Digital Image , 2010 .

[56]  Wang Wei-feng Feature description and its solution of asphalt road pavement micro-topography based on fractal theory , 2010 .

[57]  Kristen Grauman,et al.  Image Recognition , 2009, Encyclopedia of Biometrics.

[58]  I. Iervolino,et al.  Computer Aided Civil and Infrastructure Engineering , 2009 .

[59]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[60]  Brian D Prowell,et al.  Evaluation of Circular Texture Meter for Measuring Surface Texture of Pavements , 2005 .

[61]  H Bendtsen,et al.  Rolling resistance, fuel consumption - a literature review , 2004 .

[62]  F Oijer,et al.  IDENTIFICATION OF TRANSIENT ROAD OBSTACLE DISTRIBUTIONS AND THEIR IMPACT ON VEHICLE DURABILITY AND DRIVER COMFORT , 2004 .

[63]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[64]  Characterization of pavement texture by use of surface profiles , 2022 .