Ore image classification based on small deep learning model: Evaluation and optimization of model depth, model structure and data size

Abstract The ore image classification technology based on deep learning is an effective way to improve the image sensor-based ore sorting classification capability. However, in practice, the image sensor-based ore sorting technique often has the problem of insufficient data, and has not systematically considered the impact of model structure and dataset size on the modeling efficiency and classification performance of deep learning. Therefore, this paper attempts to explore a more suitable small deep learning model for ore image classification by considering the model depth, model structure, and dataset size. Six Convolutional Neural Networks (CNNs) models are established with different depths based on Alex Net and VGG Net and the model structure is optimized by adding BN layer. Taking the gas-coal image dataset as case study, we systematically explore the influence of model depth, model structure, dataset size on the training process efficiency and classification accuracy. Meanwhile, the operational process of coal image classifiers is analyzed visually through the ways of Channel Visualization maps, Heatmaps, Grad-CAM map, and Guided Backpropagation maps.

[1]  Ying Liu,et al.  Competitive Voting-based Multi-class Prediction for Ore Selection , 2020, 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE).

[2]  Hossein Izadi,et al.  An intelligent system for mineral identification in thin sections based on a cascade approach , 2017, Comput. Geosci..

[3]  Xu Wang,et al.  Convolutional neural network as a novel classification approach for laser-induced breakdown spectroscopy applications in lithological recognition , 2020 .

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Hongwei Ma,et al.  Research on Coal Gangue Identification by Using Convolutional Neural Network , 2018, 2018 2nd IEEE Advanced Information Management,Communicates,Electronic and Automation Control Conference (IMCEC).

[6]  Laura Fernández-Robles,et al.  Automatic characterisation of chars from the combustion of pulverised coals using machine vision , 2018, Powder Technology.

[7]  Faramarz Doulati Ardejani,et al.  Application of artificial neural networks to predict pyrite oxidation in a coal washing refuse pile , 2013 .

[8]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  Chris Aldrich,et al.  Froth image analysis by use of transfer learning and convolutional neural networks , 2018 .

[11]  Zhongbin Wang,et al.  A Deep Convolutional Neural Network Model for Intelligent Discrimination between Coal and Rocks in Coal Mining Face , 2020, Mathematical Problems in Engineering.

[12]  Narendra Kumar Patel,et al.  Holocene tectono-geomorphic evolution of Haryana plains, Western Ganga plain, India , 2018, Arabian Journal of Geosciences.

[13]  Yuanyuan Pu,et al.  Image Recognition of Coal and Coal Gangue Using a Convolutional Neural Network and Transfer Learning , 2019, Energies.

[14]  Nakwan Kim,et al.  Dynamic model identification of unmanned surface vehicles using deep learning network , 2018, Applied Ocean Research.

[15]  Qiming Qin,et al.  Deep Quadruplet Network for Hyperspectral Image Classification with a Small Number of Samples , 2020, Remote. Sens..

[16]  Virginia C. Gulick,et al.  An automated mineral classifier using Raman spectra , 2013, Comput. Geosci..

[17]  Julio Cesar Alvarez Iglesias,et al.  Deep learning discrimination of quartz and resin in optical microscopy images of minerals , 2019, Minerals Engineering.

[18]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[19]  Ba Tuan Le,et al.  Coal analysis based on visible-infrared spectroscopy and a deep neural network , 2018, Infrared Physics & Technology.

[20]  Snehamoy Chatterjee Vision-based rock-type classification of limestone using multi-class support vector machine , 2012, Applied Intelligence.

[21]  Snehamoy Chatterjee,et al.  Development of an expert system for iron ore classification , 2018, Arabian Journal of Geosciences.

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  C. A. Perez,et al.  Lithological classification based on Gabor texture image analysis , 2012, 2012 International Symposium on Optomechatronic Technologies (ISOT 2012).

[24]  P. M. Ameer,et al.  Brain tumor classification using deep CNN features via transfer learning , 2019, Comput. Biol. Medicine.

[25]  E. Carranza,et al.  Mapping mineral prospectivity through big data analytics and a deep learning algorithm , 2018, Ore Geology Reviews.

[26]  Christopher Robben,et al.  X-ray-transmission based ore sorting at the San Rafael tin mine , 2020 .

[27]  Jiang Hui-hui,et al.  Recognition of coal and stone based on SVM and texture , 2012 .

[28]  Hong Tang,et al.  Classification of Building Damage Triggered by Earthquakes Using Decision Tree , 2020 .

[29]  Chun-bao Sun,et al.  Applying Receiver-Operating-Characteristic (ROC) to bulk ore sorting using XRF , 2020 .

[30]  Yixin Yin,et al.  Real-time Detection of Steel Strip Surface Defects Based on Improved YOLO Detection Network , 2018 .

[31]  Lei Wang,et al.  Multi-information online detection of coal quality based on machine vision , 2020 .

[32]  Chen Song,et al.  Process working condition recognition based on the fusion of morphological and pixel set features of froth for froth flotation , 2018, Minerals Engineering.

[33]  Lyudmila Sukhostat,et al.  Lithological facies classification using deep convolutional neural network , 2019, Journal of Petroleum Science and Engineering.

[34]  Wei Li,et al.  Automatic Coal and Gangue Segmentation Using U-Net Based Fully Convolutional Networks , 2020, Energies.

[35]  B. Póczos,et al.  CMU DeepLens: deep learning for automatic image-based galaxy–galaxy strong lens finding , 2017, Monthly Notices of the Royal Astronomical Society.

[36]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[37]  Neha Sharma,et al.  An Analysis Of Convolutional Neural Networks For Image Classification , 2018 .

[38]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[39]  Yudong Zhang,et al.  Image-based deep learning automated sorting of date fruit , 2019, Postharvest Biology and Technology.

[40]  E. E. Baraboshkin,et al.  Deep Convolutions for In-Depth Automated Rock Typing , 2019, Comput. Geosci..

[41]  Hossein Memarian,et al.  Lithological classification and chemical component estimation based on the visual features of crushed rock samples , 2017, Arabian Journal of Geosciences.

[42]  Snehamoy Chatterjee,et al.  Development of machine vision-based ore classification model using support vector machine (SVM) algorithm , 2017, Arabian Journal of Geosciences.

[43]  J. Watt,et al.  Dual energy gamma-ray transmission techniques applied to on-line analysis in the coal and mineral industries , 1985 .

[44]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[45]  Hyun Myung,et al.  Image-Based Monitoring of Jellyfish Using Deep Learning Architecture , 2016, IEEE Sensors Journal.

[46]  Muhammad Salman Khan,et al.  Predicting bubble size and bubble rate data in water and in froth flotation-like slurry from computational fluid dynamics (CFD) by applying deep neural networks (DNN) , 2016 .

[47]  H. Memarian,et al.  Improving pore type identification from thin section images using an integrated fuzzy fusion of multiple classifiers , 2016 .

[48]  Saeed Abdolshah,et al.  Developing a computer vision method based on AHP and feature ranking for ores type detection , 2016, Appl. Soft Comput..

[49]  Yu Zhou,et al.  Deep learning-based method for SEM image segmentation in mineral characterization, an example from Duvernay Shale samples in Western Canada Sedimentary Basin , 2020, Comput. Geosci..

[50]  Xiaochun Luo,et al.  Measuring rock surface strength based on spectrograms with deep convolutional networks , 2019, Comput. Geosci..

[51]  Claudio A. Perez,et al.  Classification of rock lithology by laser range 3D and color images , 2017 .

[52]  M. Massinaei,et al.  Machine vision based monitoring and analysis of a coal column flotation circuit , 2019, Powder Technology.