Vehicle autonomous localization in local area of coal mine tunnel based on vision sensors and ultrasonic sensors

This paper presents a vehicle autonomous localization method in local area of coal mine tunnel based on vision sensors and ultrasonic sensors. Barcode tags are deployed in pairs on both sides of the tunnel walls at certain intervals as artificial landmarks. The barcode coding is designed based on UPC-A code. The global coordinates of the upper left inner corner point of the feature frame of each barcode tag deployed in the tunnel are uniquely represented by the barcode. Two on-board vision sensors are used to recognize each pair of barcode tags on both sides of the tunnel walls. The distance between the upper left inner corner point of the feature frame of each barcode tag and the vehicle center point can be determined by using a visual distance projection model. The on-board ultrasonic sensors are used to measure the distance from the vehicle center point to the left side of the tunnel walls. Once the spatial geometric relationship between the barcode tags and the vehicle center point is established, the 3D coordinates of the vehicle center point in the tunnel’s global coordinate system can be calculated. Experiments on a straight corridor and an underground tunnel have shown that the proposed vehicle autonomous localization method is not only able to quickly recognize the barcode tags affixed to the tunnel walls, but also has relatively small average localization errors in the vehicle center point’s plane and vertical coordinates to meet autonomous unmanned vehicle positioning requirements in local area of coal mine tunnel.

[1]  Jinhua Wang,et al.  Development and prospect on fully mechanized mining in Chinese coal mines , 2014 .

[2]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Warren E. Dixon,et al.  Vision-based localization of a wheeled mobile robot for greenhouse applications: A daisy-chaining approach , 2008 .

[4]  Wei Li,et al.  Improving target localization accuracy of wireless visual sensor networks , 2011, IECON 2011 - 37th Annual Conference of the IEEE Industrial Electronics Society.

[5]  Hairong Qi,et al.  Collaborative localization in visual sensor networks , 2014, TOSN.

[6]  Yingmin Jia,et al.  Indoor localization for mobile robots using lampshade corners as landmarks: Visual system calibration, feature extraction and experiments , 2014 .

[7]  Anna Fabijanska,et al.  A survey of thresholding algorithms on yarn images , 2010, 2010 Proceedings of VIth International Conference on Perspective Technologies and Methods in MEMS Design.

[8]  Li Cui,et al.  The Design and Evaluation of a Wireless Sensor Network for Mine Safety Monitoring , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[9]  Dinko Osmankovic,et al.  Active SLAM-based algorithm for autonomous exploration with mobile robot , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[10]  Yu Zhang,et al.  An Integrated Environment Monitoring System for Underground Coal Mines—Wireless Sensor Network Subsystem with Multi-Parameter Monitoring , 2014, Sensors.

[11]  Manish Dixit,et al.  Image Segmentation Methods: A Survey Approach , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[12]  Hyunchul Shim,et al.  Development of an unmanned coal mining robot and a tele-operation system , 2011, 2011 11th International Conference on Control, Automation and Systems.

[13]  Hyun Myung,et al.  Experiments on localization of an AUV using graph-based SLAM , 2013, 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[14]  Abdelaziz Mouloudi,et al.  Localization algorithms research in wireless sensor network based on Multilateration and Trilateration techniques , 2014, 2014 Third IEEE International Colloquium in Information Science and Technology (CIST).

[15]  Sima Noghanian,et al.  A Survey of Wireless Communications and Propagation Modeling in Underground Mines , 2013, IEEE Communications Surveys & Tutorials.

[16]  B. Paramasivan,et al.  Multi-Velocity Energy-Efficient Reliable Routing Protocol for Coal Mine Monitoring , 2014 .

[17]  Wen-Hsiang Tsai,et al.  Vision-Based Autonomous Vehicle Guidance for Indoor Security Patrolling by a SIFT-Based Vehicle-Localization Technique , 2010, IEEE Transactions on Vehicular Technology.

[18]  Shree K. Nayar,et al.  When Does Computational Imaging Improve Performance? , 2013, IEEE Transactions on Image Processing.

[19]  Guangliang Cheng.  Accurate TOA-Based UWB Localization System in Coal Mine Based on WSN , 2012 .

[20]  Hui Wang,et al.  Network lifetime optimization in wireless sensor networks , 2010, IEEE Journal on Selected Areas in Communications.

[21]  R. Rigler,et al.  Fluorescence correlation spectroscopy with high count rate and low background: analysis of translational diffusion , 1993, European Biophysics Journal.

[22]  Patrick Siarry,et al.  Fast multilevel thresholding for image segmentation through a multiphase level set method , 2013, Signal Process..

[23]  Mark Fiala,et al.  Automatic Projector Calibration Using Self-Identifying Patterns , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  Yu Zhou,et al.  Laser-activated RFID-based Indoor Localization System for Mobile Robots , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[25]  Liang Liu,et al.  Optimal Node Selection for Target Localization in Wireless Camera Sensor Networks , 2010, IEEE Transactions on Vehicular Technology.

[26]  Raman Maini,et al.  A Comparative Analysis of Iterative and Ostu's Thresholding Techniques , 2013 .

[27]  Wei Yang,et al.  The Video Collaborative Localization of a Miner’s Lamp Based on Wireless Multimedia Sensor Networks for Underground Coal Mines , 2015, Sensors.

[28]  Yu Li,et al.  Multiple map representations for vehicle localization and scene reconstruction , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[29]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[30]  Michael H. Dickinson,et al.  Multi-camera real-time three-dimensional tracking of multiple flying animals , 2010, Journal of The Royal Society Interface.

[31]  Muhammad Sher,et al.  Collaborative Image Compression in Wireless Sensor Networks , 2010 .

[32]  Takashi Katagiri,et al.  Real-time ultrasonic distance measurements for autonomous mobile robots using cross correlation by single-bit signal processing , 2009, 2009 IEEE International Conference on Robotics and Automation.

[33]  Liang Zhang,et al.  A Fast Robot Identification and Mapping Algorithm Based on Kinect Sensor , 2015, Sensors.

[34]  Arun S. Mujumdar,et al.  Some approaches to improve ventilation system in underground coal mines environment – A computational fluid dynamic study , 2013 .

[35]  M. Salim Beg,et al.  Use of WSN for detection of metal landmines using unmanned vehicle , 2015, 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom).