A New Identification Method for Surface Cracks from UAV Images Based on Machine Learning in Coal Mining Areas

Obtaining real-time, objective, and high-precision distribution information of surface cracks in mining areas is the first task for studying the development regularity of surface cracks and evaluating the risk. The complex geological environment in the mining area leads to low accuracy and efficiency of the existing extracting cracks methods from unmanned air vehicle (UAV) images. Therefore, this manuscript proposes a new identification method of surface cracks from UAV images based on machine learning in coal mining areas. First, the acquired UAV image is cut into small sub-images, and divided into four datasets according to the characteristics of background information: Bright Ground, Dark Dround, Withered Vegetation, and Green Vegetation. Then, for each dataset, a training sample is established with cracks and no cracks as labels and the RGB (red, green, and blue) three-band value of the sub-image as feature. Finally, the best machine learning algorithms, dimensionality reduction methods and image processing techniques are obtained through comparative analysis. The results show that using the V-SVM (Support vector machine with V as penalty function) machine learning algorithm, principal component analysis (PCA) to reduce the full features to 95% of the original variance, and image color enhancement by Laplace sharpening, the overall accuracy could reach 88.99%. This proves that the method proposed in this manuscript can achieve high-precision crack extraction from UAV image.

[1]  Patrick Hostert,et al.  imageRF - A user-oriented implementation for remote sensing image analysis with Random Forests , 2012, Environ. Model. Softw..

[2]  Xiaolin Zhu,et al.  Automatic detection of individual oil palm trees from UAV images using HOG features and an SVM classifier , 2018, International Journal of Remote Sensing.

[3]  Kazunori Fujisawa,et al.  LiDAR-derived DEM evaluation of deep-seated landslides in a steep and rocky region of Japan , 2009 .

[4]  Xiaomeng Hu,et al.  Origin of ground fissures in the Shanxi Graben System, Northern China , 2000 .

[5]  Lin Cao,et al.  Estimating forest structural attributes using UAV-LiDAR data in Ginkgo plantations , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[6]  T.-H. Hubert Chan,et al.  Reducing Curse of Dimensionality , 2016, SODA.

[7]  Nhat-Duc Hoang,et al.  A novel method for asphalt pavement crack classification based on image processing and machine learning , 2019, Engineering with Computers.

[8]  J. Malet,et al.  Image-based mapping of surface fissures for the investigation of landslide dynamics , 2013 .

[9]  Xiaoru Wang,et al.  v-SVM for transient stability assessment in power systems , 2005, Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005..

[10]  Naif Alajlan,et al.  Deep Learning Approach for Car Detection in UAV Imagery , 2017, Remote. Sens..

[11]  Nicolai Petkov,et al.  Edge and line oriented contour detection: State of the art , 2011, Image Vis. Comput..

[12]  Farid Melgani,et al.  A Deep Learning Approach to UAV Image Multilabeling , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Jinling Kong,et al.  Ecological impacts induced by groundwater and their thresholds in the arid areas in northwest china , 2013 .

[14]  Lei Guo,et al.  Wheat yellow rust monitoring by learning from multispectral UAV aerial imagery , 2018, Comput. Electron. Agric..

[15]  D. J. Chadwick,et al.  Analysis of LiDAR-derived topographic information for characterizing and differentiating landslide morphology and activity , 2006 .

[16]  Dinesh Manocha,et al.  Fast GPU-based locality sensitive hashing for k-nearest neighbor computation , 2011, GIS.

[17]  Pascual Campoy Cervera,et al.  A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles , 2017, J. Sensors.

[18]  Norman Kerle,et al.  Object-based gully feature extraction using high spatial resolution imagery , 2011 .

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[21]  Zhang Bo,et al.  Relationship between support vector set and kernel functions in SVM , 2002 .

[22]  Sumathi Poobal,et al.  Crack detection using image processing: A critical review and analysis , 2017, Alexandria Engineering Journal.

[23]  H. Abdi,et al.  Principal component analysis , 2010 .

[24]  Lindi J. Quackenbush.  A Review of Techniques for Extracting Linear Features from Imagery , 2004 .

[25]  Kelvin C. P. Wang,et al.  Pixel-Level Cracking Detection on 3D Asphalt Pavement Images Through Deep-Learning- Based CrackNet-V , 2020, IEEE Transactions on Intelligent Transportation Systems.

[26]  Nhat-Duc Hoang,et al.  Detection of Surface Crack in Building Structures Using Image Processing Technique with an Improved Otsu Method for Image Thresholding , 2018 .

[27]  C. Xiao,et al.  TYPICAL APPLICATIONS OF AIRBORNE LIDAR TECHNOLAGY IN GEOLOGICAL INVESTIGATION , 2018 .

[28]  Chen Wenying.  Application of Multi-scale Principal Component Analysis and SVM to the Motor Fault Diagnosis , 2009, 2009 International Forum on Information Technology and Applications.

[29]  Luís Pádua,et al.  UAS, sensors, and data processing in agroforestry: a review towards practical applications , 2017 .

[30]  San-zhong Li,et al.  Holocene intracontinental deformation of the northern North China Plain: Evidence of tectonic ground fissures , 2016 .

[31]  N. Maerz,et al.  Earth Fissures in Wadi Najran, Kingdom of Saudi Arabia , 2014, Natural Hazards.

[32]  Xiaobai Sun,et al.  Parallel search of k-nearest neighbors with synchronous operations , 2012, 2012 IEEE Conference on High Performance Extreme Computing.

[33]  J. Mercer.  Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[34]  Jianhua Gong,et al.  UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis , 2015, Remote. Sens..

[35]  AbdiHervé,et al.  Principal Component Analysis , 2010, Essentials of Pattern Recognition.

[36]  Petros Maragos,et al.  Image Analysis of Soil Micromorphology: Feature Extraction, Segmentation, and Quality Inference , 2004, EURASIP J. Adv. Signal Process..

[37]  Liang Xu,et al.  A method based on weighted F-score and SVM for feature selection , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[38]  Xiangyang Wang,et al.  Affine invariant image watermarking using intensity probability density-based Harris Laplace detector , 2012, J. Vis. Commun. Image Represent..

[39]  Jian-bing Peng,et al.  Distribution and mechanism of the ground fissures in Wei River Basin, the origin of the Silk Road , 2016, Environmental Earth Sciences.