Computer vision-based techniques and path planning strategy in a slope monitoring system using unmanned aerial vehicle

Unmanned aerial vehicle is a typical field robot which can work in many unstructured environments like mines, forests, and even radiation areas. In our mine monitoring system built in a northeast province of China, special designed unmanned aerial vehicle is applied to take photos and perceive the environment. We select a series of image-based techniques to process aerial pictures to monitor the slope. The visual features are initially refined by histogram equalization. Then, the rocks and cracks can be detected by different digital image processing operators, like Canny, so as to assess displacements. Advanced semantic segmentation model, U-Net, is also selected to process the problem. Experimental results show that both Canny and U-Net can perceive the edges in pictures effectively, better than other operators. In addition, we model the inspection mission for mine slopes into a traveling salesman problem, then plan the path for unmanned aerial vehicle by swarm intelligence-based optimization.

[1]  Yuzo Ohnishi,et al.  A study of the application of digital photogrammetry to slope monitoring systems , 2006 .

[2]  M Saito,et al.  RESEARCH ON FORECASTING THE TIME OF OCCURRENCE OF SLOPE FAILURE , 1969 .

[3]  Yoshua Bengio,et al.  Word-level training of a handwritten word recognizer based on convolutional neural networks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[4]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[5]  Jin Bae Park,et al.  Complete coverage navigation of cleaning robots using triangular-cell-based map , 2004, IEEE Transactions on Industrial Electronics.

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Joachim M. Buhmann,et al.  Crowdsourcing the creation of image segmentation algorithms for connectomics , 2015, Front. Neuroanat..

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[11]  F. Antolini,et al.  Early Warning Monitoring of Natural and Engineered Slopes with Ground-Based Synthetic-Aperture Radar , 2014, Rock Mechanics and Rock Engineering.

[12]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Irwin Edward Sobel,et al.  Camera Models and Machine Perception , 1970 .

[15]  Yong-Joo Lee,et al.  Application of a photogrammetric technique to a model tunnel , 2006 .

[16]  Xi Zhang,et al.  Automatic 3D model reconstruction of cutting tools from a single camera , 2010, Comput. Ind..

[17]  D. J. Chadwick,et al.  Analysis of LiDAR-derived topographic information for characterizing and differentiating landslide morphology and activity , 2006 .

[18]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[19]  Luca Maria Gambardella,et al.  Solving symmetric and asymmetric TSPs by ant colonies , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[20]  T. Stützle,et al.  MAX-MIN Ant System and local search for the traveling salesman problem , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[21]  Hanno Scharr,et al.  Principles of Filter Design , 1999 .

[22]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[23]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Irene Marzolff,et al.  Unmanned Aerial Vehicle (UAV) for Monitoring Soil Erosion in Morocco , 2012, Remote. Sens..

[25]  John H. Holland,et al.  Distributed genetic algorithms for function optimization , 1989 .

[26]  Qing Li,et al.  Ant Colony Optimization Combined with Immunosuppression and Parameters Switching Strategy for Solving Path Planning Problem of Landfill Inspection Robots , 2016 .

[27]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[28]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[29]  Marco Dorigo,et al.  An Investigation of some Properties of an "Ant Algorithm" , 1992, PPSN.

[30]  T. Strozzi,et al.  Detection and monitoring of unstable high-mountain slopes with L-band SAR interferometry , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[31]  William Whittaker.  Field Robots for the Next Century , 1992 .

[32]  Tuan Vo-Dinh,et al.  Development of an Advanced Hyperspectral Imaging (HSI) System with Applications for Cancer Detection , 2006, Annals of Biomedical Engineering.

[33]  Anupam Shukla,et al.  Modified A* Algorithm for Mobile Robot Path Planning , 2012, Soft Computing Techniques in Vision Science.

[34]  Osamu Takahashi,et al.  Motion planning in a plane using generalized Voronoi diagrams , 1989, IEEE Trans. Robotics Autom..

[35]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[36]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[37]  D. Tralli,et al.  Satellite remote sensing of earthquake, volcano, flood, landslide and coastal inundation hazards , 2005 .

[38]  J. Corominas,et al.  Using Global Positioning System techniques in landslide monitoring , 2000 .

[39]  S. Sitharama Iyengar,et al.  Robot navigation in unknown terrains using learned visibility graphs. Part I: The disjoint convex obstacle case , 1987, IEEE Journal on Robotics and Automation.

[40]  Teruki Fukuzono,et al.  A Method to Predict the Time of Slope Failure Caused by Rainfall Using the Inverse Number of Velocity of Surface Displacement , 1985 .

[41]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[42]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[43]  A. T. Mozas-Calvache,et al.  Monitoring of landslide displacements using UAS and control methods based on lines , 2017, Landslides.

[44]  Qing Li,et al.  Hybrid chaos-based particle swarm optimization-ant colony optimization algorithm with asynchronous pheromone updating strategy for path planning of landfill inspection robots , 2019, International Journal of Advanced Robotic Systems.

[45]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[46]  Wu Xiu-yi.  Forecast and prevention of slope deformed destruction in Qidashan Iron Ore Mine , 2006 .

[47]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[48]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.