Block-based automatic road defect recognition approach

Abstract. Efficient maintenance of road networks is an important factor for the smooth flow of traffic and is highly dependent on the timely assessment of road conditions. Road defects such as cracks and potholes cause significant safety and economic problems. Automation of these activities is vital for efficient and cost-effective maintenance of road networks. Image analysis techniques have widely been used and proven to be effective in fields such as medical image processing, face recognition, pattern recognition, and computer vision. We propose a two-stage modular approach for road defect recognition. The first module deals with image segmentation using a variant of random walk algorithm, which employs boost C-means clustering for selection of initial seeds. The second module conducts block-based image classification using an enhanced artificial neural network, which utilizes genetic algorithm for weight optimization. Experimental results show that the proposed approach is effective for the automatic recognition of pavement defects. The accuracy is not <73  %  , even when multiple defect categories are considered.

[1]  Edward Jones,et al.  Automatic crop detection under field conditions using the HSV colour space and morphological operations , 2017, Comput. Electron. Agric..

[2]  K. L. Mak,et al.  An automated inspection system for textile fabrics based on Gabor filters , 2008 .

[3]  Anne-Sophie Capelle-Laizé,et al.  Blind image steganalysis based on evidential K-Nearest Neighbors , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[4]  Xiaofeng Wang,et al.  A Novel Density-Based Clustering Framework by Using Level Set Method , 2009, IEEE Transactions on Knowledge and Data Engineering.

[5]  Jessica J. Fridrich,et al.  Ensemble Classifiers for Steganalysis of Digital Media , 2012, IEEE Transactions on Information Forensics and Security.

[6]  Farid García,et al.  Segmentation of images by color features: A survey , 2018, Neurocomputing.

[7]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[9]  Gyogwon Koo,et al.  End-to-end recognition of slab identification numbers using a deep convolutional neural network , 2017, Knowl. Based Syst..

[10]  Raja Bala,et al.  Computer vision in roadway transportation systems: a survey , 2013, J. Electronic Imaging.

[11]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[12]  P. Cano Marchal,et al.  Expert system based on computer vision to estimate the content of impurities in olive oil samples , 2013 .

[13]  Gareth Funka-Lea,et al.  Multi-label Image Segmentation for Medical Applications Based on Graph-Theoretic Electrical Potentials , 2004, ECCV Workshops CVAMIA and MMBIA.

[14]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[15]  Ye Feng,et al.  Detection of surface defection of solder on flexible printed circuit , 2010 .

[16]  William M. Wells,et al.  Medical Image Analysis - past, present, and future , 2016, Medical Image Anal..

[17]  S Deepa,et al.  Steganalysis on Images using SVM with Selected Hybrid Features of Gini Index Feature Selection Algorithm , 2017 .

[18]  Ling Shao,et al.  Sub-Markov Random Walk for Image Segmentation , 2016, IEEE Transactions on Image Processing.

[19]  Bowen Li,et al.  Antimode collapse generative adversarial networks , 2019, J. Electronic Imaging.

[20]  Soumik Mondal,et al.  A study on continuous authentication using a combination of keystroke and mouse biometrics , 2017, Neurocomputing.

[21]  Kamlesh Mistry,et al.  Intelligent facial emotion recognition using moth-firefly optimization , 2016, Knowl. Based Syst..

[22]  Jayme Garcia Arnal Barbedo,et al.  Factors influencing the use of deep learning for plant disease recognition , 2018, Biosystems Engineering.

[23]  Vural Gökmen,et al.  A Non-Contact Computer Vision Based Analysis of Color in Foods , 2007 .

[24]  Xiao Ping Hu,et al.  Algorithm Research of Two-Dimensional Size Measurement on Parts Based on Machine Vision , 2013 .

[25]  Maximo Cobos,et al.  Computer-based detection and classification of flaws in citrus fruits , 2010, Neural Computing and Applications.

[26]  Xiangrong Zhou,et al.  Classification of teeth in cone-beam CT using deep convolutional neural network , 2017, Comput. Biol. Medicine.

[27]  Fei Zhu,et al.  Spectral-Spatial Feature Extraction and Classification by ANN Supervised With Center Loss in Hyperspectral Imagery , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Michal Krumnikl,et al.  Image Segmentation Based on k-Means Clustering and Energy-Transfer Proximity , 2011, ISVC.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Leo Grady,et al.  Multilabel random walker image segmentation using prior models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  David A. Clausi,et al.  Gaussian MRF rotation-invariant features for image classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Adel El-Shahat,et al.  Smart Distributed Generation Systems Using Artificial Neural Network-Based Event Classification , 2018, IEEE Power and Energy Technology Systems Journal.

[33]  Pushpendu Kar,et al.  Artificial Neural Networks and Learning Techniques , 2016 .

[34]  Dongming Zhang,et al.  Deep learning based image recognition for crack and leakage defects of metro shield tunnel , 2018, Tunnelling and Underground Space Technology.

[35]  Ankur Das,et al.  A Survey on Rice Plant Disease Identification Using Image Processing and Data Mining Techniques , 2018, Advances in Intelligent Systems and Computing.

[36]  Ioannis A. Kakadiaris,et al.  Computer Vision and Mathematical Methods in Medical and Biomedical Image Analysis , 2004, Lecture Notes in Computer Science.

[37]  Yao Zhao,et al.  Median filtering detection of small-size image based on CNN , 2018, J. Vis. Commun. Image Represent..

[38]  Muhammad Kamran,et al.  Towards real-time crops surveillance for disease classification: exploiting parallelism in computer vision , 2017, Comput. Electr. Eng..

[39]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Mansour Sheikhan,et al.  Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks , 2011, Neural Computing and Applications.

[41]  Mahdi Ramezani,et al.  Towards Genetic Feature Selection in Image Steganalysis , 2010, 2010 7th IEEE Consumer Communications and Networking Conference.