Automatic Stones Classification through a CNN-Based Approach

This paper presents an automatic recognition system for classifying stones belonging to different Calabrian quarries (Southern Italy). The tool for stone recognition has been developed in the SILPI project (acronym of “Sistema per l’Identificazione di Lapidei Per Immagini”), financed by POR Calabria FESR-FSE 2014-2020. Our study is based on the Convolutional Neural Network (CNNs) that is used in literature for many different tasks such as speech recognition, neural language processing, bioinformatics, image classification and much more. In particular, we propose a two-stage hybrid approach based on the use of a model of Deep Learning (DL), in our case the CNN, in the first stage and a model of Machine Learning (ML) in the second one. In this work, we discuss a possible solution to stones classification which uses a CNN for the feature extraction phase and the Softmax or Multinomial Logistic Regression (MLR), Support Vector Machine (SVM), k-Nearest Neighbors (kNN), Random Forest (RF) and Gaussian Naive Bayes (GNB) ML techniques in order to perform the classification phase basing our study on the approach called Transfer Learning (TL). We show the image acquisition process in order to collect adequate information for creating an opportune database of the stone typologies present in the Calabrian quarries, also performing the identification of quarries in the considered region. Finally, we show a comparison of different DL and ML combinations in our Two-Stage Hybrid Model solution.

[1]  Leiyu Chen,et al.  Review of Image Classification Algorithms Based on Convolutional Neural Networks , 2021, Remote. Sens..

[2]  A. E. Permanasari,et al.  Butterfly Image Classification Using Convolutional Neural Network (CNN) , 2021, 2021 3rd International Conference on Electronics Representation and Algorithm (ICERA).

[3]  Oscar Lorente,et al.  Image Classification with Classic and Deep Learning Techniques , 2021, ArXiv.

[4]  D. Barca,et al.  RecoStones: a New Tool to Identify Calabrian Stone Materials Through Image Processing , 2021, Geoheritage.

[5]  Vrinda Yadav,et al.  Image Classification Using Deep Neural Network , 2020, 2020 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN).

[6]  M. Suganthi,et al.  An Exploratory of Hybrid Techniques on Deep Learning for Image Classification , 2020, 2020 4th International Conference on Computer, Communication and Signal Processing (ICCCSP).

[7]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[8]  Luís Rato,et al.  Automatic classification of ornamental stones using Machine Learning techniques A study applied to limestone , 2020, 2020 15th Iberian Conference on Information Systems and Technologies (CISTI).

[9]  Zhijie Wang,et al.  Automatic Recognition and Classification of Granite Tiles Using Convolutional Neural Networks (CNN) , 2019, ICAAI.

[10]  Giuseppe Fedele,et al.  Classifiers Comparison for Convolutional Neural Networks (CNNs) in Image Classification , 2019, 2019 IEEE/ACM 23rd International Symposium on Distributed Simulation and Real Time Applications (DS-RT).

[11]  Qiubing Ren,et al.  Intelligent Identification for Rock-Mineral Microscopic Images Using Ensemble Machine Learning Algorithms , 2019, Sensors.

[12]  Venkatesh Umaashankar,et al.  Effectiveness of Hierarchical Softmax in Large Scale Classification Tasks , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[13]  Yue Zhang,et al.  High Resolution SAR Image Classification with Deeper Convolutional Neural Network , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[14]  Yang Song,et al.  Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Hariharan Ramasangu,et al.  An Efficient CNN Architecture for Image Classification on FPGA Accelerator , 2018, 2018 Second International Conference on Advances in Electronics, Computers and Communications (ICAECC).

[16]  Abdullah,et al.  An application of pre-trained CNN for image classification , 2017, 2017 20th International Conference of Computer and Information Technology (ICCIT).

[17]  Kwang-Yeob Lee,et al.  Implemetation of image classification CNN using multi thread GPU , 2017, 2017 International SoC Design Conference (ISOCC).

[18]  Mohammad Taheri,et al.  A non-parametric mixture of Gaussian naive Bayes classifiers based on local independent features , 2017, 2017 Artificial Intelligence and Signal Processing Conference (AISP).

[19]  Thai Hoang Le,et al.  Advertisement image classification using convolutional neural network , 2017, 2017 9th International Conference on Knowledge and Systems Engineering (KSE).

[20]  Jianping Gou,et al.  Sparse Coefficient-Based ${k}$ -Nearest Neighbor Classification , 2017, IEEE Access.

[21]  Gong Cheng,et al.  Scene classification of high resolution remote sensing images using convolutional neural networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Francesco Bianconi,et al.  On Comparing Colour Spaces From a Performance Perspective: Application to Automated Classification of Polished Natural Stones , 2015, ICIAP Workshops.

[25]  Ryosuke Yoshihashi,et al.  Deep Convolutional Neural Networks: A survey of the foundations, selected improvements, and some current applications , 2020, ArXiv.

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[28]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[29]  Usman Qamar,et al.  Texture Classification Using Rotation- and Scale-Invariant Gabor Texture Features , 2013, IEEE Signal Processing Letters.

[30]  Francesco Bianconi,et al.  Automatic classification of granite tiles through colour and texture features , 2012, Expert Syst. Appl..

[31]  Shervan Fekri Ershad,et al.  Color Texture Classification Approach Based on Combination of Primitive Pattern Units and Statistical Features , 2011, ArXiv.

[32]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[33]  Javier Martínez,et al.  Identification of Granite Varieties from Colour Spectrum Data , 2010, Sensors.

[34]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[36]  L. Breiman Random Forests , 2001, Encyclopedia of Machine Learning and Data Mining.

[37]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[38]  S. Aljahdali,et al.  SVM and KNN Based CNN Architectures for Plant Classification , 2022, Computers, Materials & Continua.

[39]  C. Reyes-Aldasoro,et al.  Automatic Gemstone Classification Using Computer Vision , 2022 .

[40]  Jyh-Horng Jeng,et al.  A Study on Combined CNN-SVM Model for Visual Object Recognition , 2019, J. Inf. Hiding Multim. Signal Process..

[41]  Josef Vychodil,et al.  A Pedestrian Detection Method Using SVM and CNN Multistage Classification , 2018, J. Inf. Hiding Multim. Signal Process..

[42]  Shyamala C. Doraisamy,et al.  Texture classification and discrimination for region-based image retrieval , 2015, J. Vis. Commun. Image Represent..

[43]  Francesco A. Cuteri Cave costiere in Calabria tra Jonio e Tirreno , 2013 .