An Image-Based Hierarchical Deep Learning Framework for Coal and Gangue Detection

The efficient separation of coal and gangue in the mining process is of great significance for improving coal mining efficiency and reducing environmental pollution. Automatic detection of coal and gangue is the key and foundation for the separation of coal and gangue. In this paper, we proposed a hierarchical framework for coal and gangue detection based on deep learning models. In this framework, the Gaussian pyramid principle is first used to construct multi-level training data, leading to the sets of coal and gangue image features with multiple scales. Then, the coal and gangue regional proposal networks (CG-RPN) are designed to determine the candidate regions of the target objects in the image. Next, convolution neural networks (CNNs) are constructed to recognize coal and gangue objects on the basis of extracted candidate regions. We performed our method on three different datasets. Experimental results showed that the proposed method improves the detection accuracy of coal and gangue objects by 0.8% compared with the previous methods, reaching up to 98.33%. In addition, our proposed method enables the detection of multiple coal and gangue objects in an individual image and solves the problem of queuing requirements in traditional methods.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Tianyou Chai,et al.  Recent Progress on Data-Based Optimization for Mineral Processing Plants , 2017 .

[4]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[5]  T. Perraki,et al.  A comparative study on structural differences of xylite and matrix lignite lithotypes by means of FT-IR, XRD, SEM and TGA analyses: An example from the Neogene Greek lignite deposits , 2013 .

[6]  Haoxiang Wang,et al.  An Efficient of Coal and Gangue Recognition Algorithm , 2013 .

[7]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Glenn B. Stracher,et al.  Coal fires burning out of control around the world : Thermodynamic recipe for environmental catastrophe , 2004 .

[9]  Dongyang Dou,et al.  Soft-Sensor Modeling for Separation Performance of Dense-Medium Cyclone by Field Data , 2015 .

[10]  Jane You,et al.  Hyperspectral image unsupervised classification by robust manifold matrix factorization , 2019, Inf. Sci..

[11]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Ángel Rodríguez-Vázquez,et al.  Low-Power CMOS Vision Sensor for Gaussian Pyramid Extraction , 2017, IEEE Journal of Solid-State Circuits.

[13]  Bo Du,et al.  Feature Learning Using Spatial-Spectral Hypergraph Discriminant Analysis for Hyperspectral Image , 2019, IEEE Transactions on Cybernetics.

[14]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Hongwei Ma,et al.  Research on Coal Gangue Identification by Using Convolutional Neural Network , 2018, 2018 2nd IEEE Advanced Information Management,Communicates,Electronic and Automation Control Conference (IMCEC).

[16]  Shaojian Wang,et al.  Energy relations between China and the countries along the Belt and Road: An analysis of the distribution of energy resources and interdependence relationships , 2019, Renewable and Sustainable Energy Reviews.

[17]  Ruofei Zhong,et al.  Multilevel Building Detection Framework in Remote Sensing Images Based on Convolutional Neural Networks , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[19]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Neural Networks , 2013 .

[20]  Jianqing Zhu,et al.  Automatic Recognition of Coal and Gangue based on Convolution Neural Network , 2017, ArXiv.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Cuizhen Wang,et al.  Assessment of heavy metal in coal gangue: distribution, leaching characteristic and potential ecological risk , 2018, Environmental Science and Pollution Research.

[24]  Chen Zhang,et al.  Separating coal and gangue using three-dimensional laser scanning , 2017 .

[25]  T. D. Nguyen,et al.  Application of high-resolution X-ray microcomputed tomography for coal washability analysis , 2018, Minerals Engineering.

[26]  Wei Hou,et al.  Identification of Coal and Gangue by Feed-forward Neural Network Based on Data Analysis , 2019 .

[27]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[28]  Jian-guo Li,et al.  Intelligent Mining Technology for an Underground Metal Mine Based on Unmanned Equipment , 2018, Engineering.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[31]  Dongyang Dou,et al.  A novel distribution rate predicting method of dense medium cyclone in the Taixi coal preparation plant , 2015 .

[32]  Hao Li,et al.  Separation of gangue from coal based on supplementary texture by morphology , 2019, International Journal of Coal Preparation and Utilization.

[33]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Kai Liu,et al.  Extraction of Coal and Gangue Geometric Features with Multifractal Detrending Fluctuation Analysis , 2018 .

[35]  Zhang Ning-b,et al.  Measurement analysis on the fluctuation characteristics of low level natural radiation from gangue , 2015 .

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Robert B. Finkelman,et al.  Stone coal in China: a review , 2018, Coal Geology of China.