Self-supervised pre-training of CNNs for flatness defect classification in the steelworks industry

Classification of surface defects in the steelworks industry plays a significant role in guaranteeing the quality of the products. From an industrial point of view, a serious concern is represented by the hot-rolled products shape defects and particularly those concerning the strip flatness. Flatness defects are typically divided into four sub-classes depending on which part of the strip is affected and the corresponding shape. In the context of this research, the primary objective is evaluating the improvements of exploiting the self-supervised learning paradigm for defects classification, taking advantage of unlabelled, real, steel strip flatness maps. Different pre-training methods are compared, as well as architectures, taking advantage of well-established neural subnetworks, such as Residual and Inception modules. A systematic approach in evaluating the different performances guarantees a formal verification of the self-supervised pre-training paradigms evaluated hereafter. In particular, pre-training neural networks with the EgoMotion meta-algorithm shows classification improvements over the AutoEncoder technique, which in turn is better performing than a Glorot weight initialization.

[1]  Adam Coates,et al.  Deep Voice: Real-time Neural Text-to-Speech , 2017, ICML.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Paolo Favaro,et al.  Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles , 2016, ECCV.

[4]  Antonia Creswell,et al.  Denoising Adversarial Autoencoders , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Valentina Colla,et al.  Big Data Solution for Quality Monitoring and Improvement on Flat Steel Production , 2016 .

[6]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[7]  Tomaso A. Poggio,et al.  When and Why Are Deep Networks Better Than Shallow Ones? , 2017, AAAI.

[8]  Richard Socher,et al.  Ask Me Anything: Dynamic Memory Networks for Natural Language Processing , 2015, ICML.

[9]  Marco Vannucci,et al.  Surface defects classification in steel products: a comparison between different Artificial Intelligence-based approaches , 2011 .

[10]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shixiao Wu,et al.  Comparison of Machine Learning Algorithms for Handwritten Digit Recognition , 2017 .

[12]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[13]  Dana H. Ballard,et al.  Modular Learning in Neural Networks , 1987, AAAI.

[14]  Guifang Wu,et al.  Application of a new feature extraction and optimization method to surface defect recognition of cold rolled strips , 2007 .

[15]  Alessandro Ardesi,et al.  AUTOMATIC SURFACE INSPECTION IN STEEL PRODUCTS ENSURES SAFE, COST-EFFICIENT AND TIMELY DEFECT DETECTION IN PRODUCTION , 2018, ABM Proceedings.

[16]  Ke Xu,et al.  Design of online surface inspection system of hot rolled strips , 2008, 2008 IEEE International Conference on Automation and Logistics.

[17]  Marco Vannucci,et al.  Flatness Defect Detection and Classification in Hot Rolled Steel Strips Using Convolutional Neural Networks , 2019, IWANN.

[18]  Brendan J. Frey,et al.  k-Sparse Autoencoders , 2013, ICLR.

[19]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[20]  Stefano Ermon,et al.  Label-Free Supervision of Neural Networks with Physics and Domain Knowledge , 2016, AAAI.

[21]  Marco Vannucci,et al.  A Hybrid Feature Selection Method for Classification Purposes , 2014, 2014 European Modelling Symposium.

[22]  Marco Vannucci,et al.  A fuzzy inference system applied to defect detection in flat steel production , 2010, International Conference on Fuzzy Systems.

[23]  Valentina Colla,et al.  A multivariate fuzzy system applied for outliers detection , 2013, J. Intell. Fuzzy Syst..

[24]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[25]  Marco Vannucci,et al.  Thresholded Neural Networks for Sensitive Industrial Classification Tasks , 2009, IWANN.

[26]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[27]  Gregory Shakhnarovich,et al.  Colorization as a Proxy Task for Visual Understanding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Marco Vannucci,et al.  A Genetic Algorithm-Based Approach for Selecting Input Variables and Setting Relevant Network Parameters of a SOM-Based Classifier , 2020, International journal of simulation: systems, science & technology.

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[31]  Jitendra Malik,et al.  Learning to See by Moving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[33]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  P. Caleb,et al.  Classification of surface defects on hot rolled steel using adaptive learning methods , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).