Surface Defect Classification for Hot-Rolled Steel Strips by Selectively Dominant Local Binary Patterns

Developments in defect descriptors and computer vision-based algorithms for automatic optical inspection (AOI) allows for further development in image-based measurements. Defect classification is a vital part of an optical-imaging-based surface quality measuring instrument. The high-speed production rhythm of hot continuous rolling requires an ultra-rapid response to every component as well as algorithms in AOI instrument. In this paper, a simple, fast, yet robust texture descriptor, namely selectively dominant local binary patterns (SDLBPs), is proposed for defect classification. First, an intelligent searching algorithm with a quantitative thresholding mechanism is built to excavate the dominant non-uniform patterns (DNUPs). Second, two convertible schemes of pattern code mapping are developed for binary encoding of all uniform patterns and DNUPs. Third, feature extraction is carried out under SDLBP framework. Finally, an adaptive region weighting method is built for further strengthening the original nearest neighbor classifier in the feature matching stage. The extensive experiments carried out on an open texture database (Outex) and an actual surface defect database (Dragon) indicates that our proposed SDLBP yields promising performance on both classification accuracy and time efficiency.

[1]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[2]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[3]  Matti Pietikäinen,et al.  Discriminative features for texture description , 2012, Pattern Recognit..

[4]  Ahmad Reza Naghsh-Nilchi,et al.  Noise tolerant local binary pattern operator for efficient texture analysis , 2012, Pattern Recognit. Lett..

[5]  Rajalingappaa Shanmugamani,et al.  Detection and classification of surface defects of gun barrels using computer vision and machine learning , 2015 .

[6]  Yunhui Yan,et al.  A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects , 2013 .

[7]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[8]  Jun Guo,et al.  Multi-scale Joint Encoding of Local Binary Patterns for Texture and Material Classification , 2013, BMVC.

[9]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Transactions on Image Processing.

[10]  Rong-Seng Chang,et al.  Pretest Gap Mura on TFT LCDs Using the Optical Interference Pattern Sensing Method and Neural Network Classification , 2013, IEEE Transactions on Industrial Electronics.

[11]  Matti Pietikäinen,et al.  Combining LBP Difference and Feature Correlation for Texture Description , 2014, IEEE Transactions on Image Processing.

[12]  Praminda Caleb-Solly,et al.  Adaptive surface inspection via interactive evolution , 2007, Image Vis. Comput..

[13]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[14]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  De Xu,et al.  Robust Visual Detection–Learning–Tracking Framework for Autonomous Aerial Refueling of UAVs , 2016, IEEE Transactions on Instrumentation and Measurement.

[16]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[17]  B. Santhi,et al.  Application of texture analysis method for mammogram density classification , 2017 .

[18]  Yigang He,et al.  Generalized Completed Local Binary Patterns for Time-Efficient Steel Surface Defect Classification , 2019, IEEE Transactions on Instrumentation and Measurement.

[19]  Matti Pietikäinen,et al.  Local binary features for texture classification: Taxonomy and experimental study , 2017, Pattern Recognit..

[20]  Xuelong Li,et al.  Semi-Supervised Multitask Learning for Scene Recognition , 2015, IEEE Transactions on Cybernetics.

[21]  Daniel F. García,et al.  Vibrations in Steel Strips: Effects on Flatness Measurement and Filtering , 2013, IEEE Transactions on Industry Applications.

[22]  In-So Kweon,et al.  Ambiguous Surface Defect Image Classification of AMOLED Displays in Smartphones , 2016, IEEE Transactions on Industrial Informatics.

[23]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[24]  Qian Huang,et al.  Improving Automatic Detection of Defects in Castings by Applying Wavelet Technique , 2006, IEEE Transactions on Industrial Electronics.

[25]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, AMFG.

[26]  Yigang He,et al.  A cost-effective and automatic surface defect inspection system for hot-rolled flat steel , 2016 .

[27]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[29]  Tohid Alizadeh,et al.  An intelligent system for quality measurement of Golden Bleached raisins using two comparative machine learning algorithms , 2017 .

[30]  Ke Xu,et al.  Application of multi-scale feature extraction to surface defect classification of hot-rolled steels , 2013, International Journal of Minerals, Metallurgy, and Materials.

[31]  Baoping Tang,et al.  A texture-based rolling bearing fault diagnosis scheme using adaptive optimal kernel time frequency representation and uniform local binary patterns , 2017 .

[32]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[33]  Yunhui Yan,et al.  A three-dimensional inspection system for high temperature steel product surface sample height using stereo vision and blue encoded patterns , 2017 .

[34]  S. R. Aghdam,et al.  A fast method of steel surface defect detection using decision trees applied to LBP based features , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[35]  Ying Tian,et al.  Steel Surface Defect Detection Using a New Haar–Weibull-Variance Model in Unsupervised Manner , 2017, IEEE Transactions on Instrumentation and Measurement.

[36]  Xiangtao Zheng,et al.  Remote Sensing Scene Classification by Unsupervised Representation Learning , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Pierre Payeur,et al.  Application of Segmented 2-D Probabilistic Occupancy Maps for Robot Sensing and Navigation , 2008, IEEE Transactions on Instrumentation and Measurement.

[38]  Anirban Mukherjee,et al.  Discriminant Analysis for Fast Multiclass Data Classification Through Regularized Kernel Function Approximation , 2010, IEEE Transactions on Neural Networks.