Anomaly Detection and Automatic Labeling for Solar Cell Quality Inspection Based on Generative Adversarial Network

Quality inspection applications in industry are required to move towards a zero-defect manufacturing scenario, with non-destructive inspection and traceability of 100% of produced parts. Developing robust fault detection and classification models from the start-up of the lines is challenging due to the difficulty in getting enough representative samples of the faulty patterns and the need to manually label them. This work presents a methodology to develop a robust inspection system, targeting these peculiarities, in the context of solar cell manufacturing. The methodology is divided into two phases: In the first phase, an anomaly detection model based on a Generative Adversarial Network (GAN) is employed. This model enables the detection and localization of anomalous patterns within the solar cells from the beginning, using only non-defective samples for training and without any manual labeling involved. In a second stage, as defective samples arise, the detected anomalies will be used as automatically generated annotations for the supervised training of a Fully Convolutional Network that is capable of detecting multiple types of faults. The experimental results using 1873 Electroluminescence (EL) images of monocrystalline cells show that (a) the anomaly detection scheme can be used to start detecting features with very little available data, (b) the anomaly detection may serve as automatic labeling in order to train a supervised model, and (c) segmentation and classification results of supervised models trained with automatic labels are comparable to the ones obtained from the models trained with manual labels.

[1]  Xiaofang Zhang,et al.  Robust Crack Defect Detection in Inhomogeneously Textured Surface of Near Infrared Images , 2018, PRCV.

[2]  Du-Ming Tsai,et al.  Micro-crack inspection in heterogeneously textured solar wafers using anisotropic diffusion , 2010, Image Vis. Comput..

[3]  Kun Liu,et al.  A robust weakly supervised learning of deep Conv-Nets for surface defect inspection , 2020, Neural Computing and Applications.

[4]  D. Tsai,et al.  Defect detection of solar cells in electroluminescence images using Fourier image reconstruction , 2012 .

[5]  Jing Li,et al.  Micro-crack detection of solar cell based on adaptive deep features and visual saliency , 2020 .

[6]  Xiao Chen,et al.  Automatic detection of photovoltaic module defects in infrared images with isolated and develop-model transfer deep learning , 2020 .

[7]  Haiyong Chen,et al.  U-Net Based Defects Inspection in Photovoltaic Electroluminecscence Images , 2019, 2019 IEEE International Conference on Big Knowledge (ICBK).

[8]  Xue Zhao,et al.  Defect Detection of Photovoltaic Modules Based on Convolutional Neural Network , 2017, MLICOM.

[9]  Kun Liu,et al.  Accurate and robust crack detection using steerable evidence filtering in electroluminescence images of solar cells , 2019, Optics and Lasers in Engineering.

[10]  Bin Yang,et al.  Automated Detection of Solar Cell Defects with Deep Learning , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[11]  Qiang Yang,et al.  Deep learning based automatic defect identification of photovoltaic module using electroluminescence images , 2020 .

[12]  Junliang Wang,et al.  AdaBalGAN: An Improved Generative Adversarial Network With Imbalanced Learning for Wafer Defective Pattern Recognition , 2019, IEEE Transactions on Semiconductor Manufacturing.

[13]  Mohd Abdullah,et al.  Micro-crack detection of multicrystalline solar cells featuring an improved anisotropic diffusion filter and image segmentation technique , 2014, EURASIP Journal on Image and Video Processing.

[14]  Xiao Chen,et al.  CNN based automatic detection of photovoltaic cell defects in electroluminescence images , 2019 .

[15]  Michael Lütjen,et al.  Anomaly detection with convolutional neural networks for industrial surface inspection , 2019, Procedia CIRP.

[16]  Vincent Christlein,et al.  Weakly Supervised Segmentation of Cracks on Solar Cells Using Normalized Lp Norm , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[17]  Alvaro Rodriguez,et al.  Automatic solar cell diagnosis and treatment , 2020, J. Intell. Manuf..

[18]  Du-Ming Tsai,et al.  Defect Detection in Solar Modules Using ICA Basis Images , 2013, IEEE Transactions on Industrial Informatics.

[19]  Jinde Cao,et al.  Micro-cracks detection of solar cells surface via combining short-term and long-term deep features , 2020, Neural Networks.

[20]  Warren Brettenny,et al.  Photovoltaic defect classification through thermal infrared imaging using a machine learning approach , 2019, Progress in Photovoltaics: Research and Applications.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Xu Li,et al.  Machinery fault diagnosis with imbalanced data using deep generative adversarial networks , 2020 .

[23]  Toby P. Breckon,et al.  GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training , 2018, ACCV.

[24]  Polycrystalline Solar Anisotropic Diffusion based Micro-crack Inspection in Polycrystalline Solar Wafers , 2011 .

[25]  Julen Balzategui,et al.  Semi-automatic quality inspection of solar cell based on Convolutional Neural Networks , 2019, 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[26]  Georg Langs,et al.  f‐AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks , 2019, Medical Image Anal..

[27]  Anhong Wang,et al.  Detection of surface defects on solar cells by fusing Multi-channel convolution neural networks , 2020 .

[28]  Zhou Ying,et al.  Automatic Detection of Photovoltaic Module Cells using Multi-Channel Convolutional Neural Network , 2018, 2018 Chinese Automation Congress (CAC).

[29]  Matthias Haselmann,et al.  Anomaly Detection Using Deep Learning Based Image Completion , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[30]  Peng Zhao,et al.  Surface Defect Detection of Solar Cells Based on Feature Pyramid Network and GA-Faster-RCNN , 2019, 2019 2nd China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI).

[31]  Kun Liu,et al.  Solar cell surface defect inspection based on multispectral convolutional neural network , 2018, Journal of Intelligent Manufacturing.

[32]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[33]  S Y Cheng,et al.  GAN-Based Augmentation for Improving CNN Performance of Classification of Defective Photovoltaic Module Cells in Electroluminescence Images , 2019, IOP Conference Series: Earth and Environmental Science.

[34]  Xuewu Zhang,et al.  A Novel Method for Surface Defect Detection of Photovoltaic Module Based on Independent Component Analysis , 2013 .

[35]  Neil Roberts,et al.  Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015 , 2015, Lecture Notes in Computer Science.

[36]  Kun Liu,et al.  Classification of Manufacturing Defects in Multicrystalline Solar Cells With Novel Feature Descriptor , 2019, IEEE Transactions on Instrumentation and Measurement.

[37]  Delfina Muñoz,et al.  Quality control method based on photoluminescence imaging for the performance prediction of c-Si/a-Si:H heterojunction solar cells in industrial production lines , 2016 .

[38]  Christian Riess,et al.  Automatic Classification of Defective Photovoltaic Module Cells in Electroluminescence Images , 2018, Solar Energy.

[39]  M. Köntges,et al.  The risk of power loss in crystalline silicon based photovoltaic modules due to micro-cracks , 2011 .

[40]  Julen Balzategui,et al.  Defect detection on Polycrystalline solar cells using Electroluminescence and Fully Convolutional Neural Networks , 2020, 2020 IEEE/SICE International Symposium on System Integration (SII).

[41]  Ender Konukoglu,et al.  Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoders , 2018, ArXiv.

[42]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Jung-Woo Ha,et al.  StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[45]  T. Fuyuki,et al.  Photographic diagnosis of crystalline silicon solar cells utilizing electroluminescence , 2009 .

[46]  Roberto Pierdicca,et al.  DEEP CONVOLUTIONAL NEURAL NETWORK FOR AUTOMATIC DETECTION OF DAMAGED PHOTOVOLTAIC CELLS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[47]  Du-Ming Tsai,et al.  Defect detection in multi-crystal solar cells using clustering with uniformity measures , 2015, Adv. Eng. Informatics.

[48]  Thomas Brox,et al.  Inline quality rating of multi‐crystalline wafers based on photoluminescence images , 2016 .