Improved Sacked Denoising Autoencoders-Based Defect Detection in Bar Surface

Traditional pattern recognition methods are widely used to detect defects in the industry, however most of existing methods are not universal for all kinds of defects on bars. This paper proposes a method which combines Rectified Linear Units (ReLU) and Batch Normalization(BN) in Sacked Denoising Autoencoders(SDA) for surface defect detection of bars. Gradient diffusion often occurs in traditional SDA, which leading to inefficient learning. In order to solve gradient diffusion, we replace the Sigmod activation function with ReLU function. The activation value calculated by ReLU is often oversparing which leading to loss of features. For solving the oversparing of ReLU, we add BN layer into SDA to normalize each batch. Finally we obtain network weights through unsupervised pre-training and supervised fine-tuning. We train two models which one for prediction and the other for reconstruction. Experiment results show that the proposed method can achieve an average accuracy rate of 99.1% on our data set. Compared with the traditional pattern recognition method, traditional SDA and Fisher criterion-based stacked denoising autoencoders(FCSDA), our method shows higher accuracy and TPR. Moreover, due to the addition of BN, the time complexity of our method is significantly lower than the SDA and FCSDA.

[1]  Mauricio Orozco-Alzate,et al.  Automatic visual inspection: An approach with multi-instance learning , 2016, Comput. Ind..

[2]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[3]  Yundong Li,et al.  Deformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[4]  J. Mundy Automatic visual inspection , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[5]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[6]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[7]  Sang Woo Kim,et al.  Defect detection for corner cracks in steel billets using a wavelet reconstruction method. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Ying-Ke Lei,et al.  Radio Fingerprint Extraction Based on Marginal Fisher Deep Autoencoders , 2018, Wireless Personal Communications.

[9]  Yi Lu Murphey,et al.  An intelligent real-time vision system for surface defect detection , 2004, ICPR 2004.

[10]  Changhyun Park,et al.  Defect inspection system for steel wire rods produced by hot rolling process , 2014 .

[11]  Florent Dupont,et al.  Optimization of the recognition of defects in flat steel products with the cost matrices theory , 1997 .

[12]  Qingyong Li,et al.  A Real-Time Visual Inspection System for Discrete Surface Defects of Rail Heads , 2012, IEEE Transactions on Instrumentation and Measurement.

[13]  G. B. Porter,et al.  Automatic Visual Inspection Of Metal Surfaces , 1981, Other Conferences.

[14]  Qingyong Li,et al.  A Visual Detection System for Rail Surface Defects , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Dusmanta Kumar Mohanta,et al.  Review of vision-based steel surface inspection systems , 2014, EURASIP Journal on Image and Video Processing.

[16]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[17]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yi Lu Murphey,et al.  An intelligent real-time vision system for surface defect detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[19]  Samee Ullah Khan,et al.  Boosting the Accuracy of AdaBoost for Object Detection and Recognition , 2016, 2016 International Conference on Frontiers of Information Technology (FIT).