Deep Learning-Based Object Detection for Digital Inspection in the Mining Industry

In the mining industry, belt conveyors are essential for transporting large quantities of materials efficiently and inexpensively. The rollers are one of the main components of a belt conveyor. Their maintenance and operation are critical for material transportation during the mining activities. Despite that, its inspection has been done in the same way for almost 20 years, with little technological innovation. The inspection of the belt conveyor rollers automatically via object detection and thermal imaging can improve this process. Therefore, we propose a new system capable of running the detection of defective rollers in real time and with better precision and recall metrics than those of previous works. We based the object detection models on the YOLOv2 deep learning architecture. Comparing our results with previous work, we observe reductions on false discovery and false negative rates of 52.46% and 61.03%, respectively. We also evaluated three computing infrastructures, and the GPU-based one was the only that enabled real-time performance.

[1]  Andrea G. C. Bianchi,et al.  An Integrated Inspection System for Belt Conveyor Rollers - Advancing in an Enterprise Architecture , 2017, ICEIS.

[2]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[3]  Carvalho Júnior,et al.  Processamento digital de imagens para a identificação automática de falhas em rolos dos transportadores de correias. , 2018 .

[4]  Geoffrey C. Fox,et al.  Real-Time, Cloud-Based Object Detection for Unmanned Aerial Vehicles , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[5]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[6]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[12]  Ramakant Nevatia,et al.  SPOT Poachers in Action: Augmenting Conservation Drones With Automatic Detection in Near Real Time , 2018, AAAI.

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.