Defect detection on EL images based on deep feature optimized by metric learning for imbalanced data

The defect detection based on machine vision is of great significance for improving the production efficiency and product quality of photovoltaic cells. The common problem in the field of defect detection is the unbalanced distribution between defective data and defect-free data because of the rarity of defective data. However, Convolutional Neural Network (CNN) cannot achieve better processing for unbalanced data sets. In this paper, we propose a novel feature extraction framework that learns the backbone CNN network parameters, optimizes feature space by metric learning in end-to-end training process, which solves the problem of over-fitting of CNN model on imbalanced and small-scale data sets. To verify the effectiveness of this method, extensive experiments on EL image dataset. The comprehensive results demonstrate that the proposed methods can identify the different type of defects with more accuracy rates than the state-of-the-art methods in several cases.

[1]  D. Tsai,et al.  Defect detection of solar cells in electroluminescence images using Fourier image reconstruction , 2012 .

[2]  Zhi-Hua Zhou,et al.  Exploratory Under-Sampling for Class-Imbalance Learning , 2006, Sixth International Conference on Data Mining (ICDM'06).

[3]  Ki-Hyun Kim,et al.  Solar energy: Potential and future prospects , 2018 .

[4]  Lewis D. Griffin,et al.  Detection of concealed cars in complex cargo X-ray imagery using deep learning , 2016, Journal of X-ray science and technology.

[5]  Zhi-Hua Zhou,et al.  Exploratory Undersampling for Class-Imbalance Learning , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Bernard De Baets,et al.  An approach to supervised distance metric learning based on difference of convex functions programming , 2018, Pattern Recognit..

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Mohammad R. Jahanshahi,et al.  Video-based crack detection using deep learning and Nave Bayes data fusion , 2018, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[9]  Hichem Snoussi,et al.  A fast and robust convolutional neural network-based defect detection model in product quality control , 2017, The International Journal of Advanced Manufacturing Technology.

[10]  Anders Landström,et al.  Morphology-Based Crack Detection for Steel Slabs , 2012, IEEE Journal of Selected Topics in Signal Processing.

[11]  Yu-Teng Liang,et al.  Micro crack detection of multi‐crystalline silicon solar wafer using machine vision techniques , 2011 .