SIGAN: A Novel Image Generation Method for Solar Cell Defect Segmentation and Augmentation

Solar cell electroluminescence (EL) defect segmentation is an interesting and challenging topic. Many methods have been proposed for EL defect detection, but these methods are still unsatisfactory due to the diversity of the defect and background. In this paper, we provide a new idea of using generative adversarial network (GAN) for defect segmentation. Firstly, the GAN-based method removes the defect region in the input defective image to get a defect-free image, while keeping the background almost unchanged. Then, the subtracted image is obtained by making difference between the defective input image with the generated defect-free image. Finally, the defect region can be segmented through thresholding the subtracted image. To keep the background unchanged before and after image generation, we propose a novel strong identity GAN (SIGAN), which adopts a novel strong identity loss to constraint the background consistency. The SIGAN can be used not only for defect segmentation, but also small-samples defective dataset augmentation. Moreover, we release a new solar cell EL image dataset named as EL-2019, which includes three types of images: crack, finger interruption and defect-free. Experiments on EL2019 dataset show that the proposed method achieves 90.34% Fscore, which outperforms many state-of-the-art methods in terms of solar cell defects segmentation results.

[1]  Peng Chen,et al.  Structure-aware-based crack defect detection for multicrystalline solar cells , 2020 .

[2]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[5]  Du-Ming Tsai,et al.  Defect Detection in Solar Modules Using ICA Basis Images , 2013, IEEE Transactions on Industrial Informatics.

[6]  Lixin Duan,et al.  Exploiting Images for Video Recognition: Heterogeneous Feature Augmentation via Symmetric Adversarial Learning , 2019, IEEE Transactions on Image Processing.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[9]  Jun Li,et al.  Self-Attentive Generative Adversarial Network for Cloud Detection in High Resolution Remote Sensing Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[10]  Kun Liu,et al.  Iterating Tensor Voting: A Perceptual Grouping Approach for Crack Detection on EL Images , 2020, IEEE Transactions on Automation Science and Engineering.

[11]  Wenbin Cai,et al.  A Unified Framework for Generalizable Style Transfer: Style and Content Separation , 2018, IEEE Transactions on Image Processing.

[12]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[13]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Junzhou Huang,et al.  Low-Dose CT Image Denoising Using Cycle-Consistent Adversarial Networks , 2019, 2019 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC).

[15]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Kun Liu,et al.  Deep Learning-Based Solar-Cell Manufacturing Defect Detection With Complementary Attention Network , 2020, IEEE Transactions on Industrial Informatics.

[17]  Hui Lin,et al.  Defect Image Sample Generation With GAN for Improving Defect Recognition , 2020, IEEE Transactions on Automation Science and Engineering.

[18]  D. Tsai,et al.  Defect detection of solar cells in electroluminescence images using Fourier image reconstruction , 2012 .

[19]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[20]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[21]  Paul L. Rosin,et al.  Structure-Preserving Neural Style Transfer , 2020, IEEE Transactions on Image Processing.

[22]  Kun Liu,et al.  Classification of Manufacturing Defects in Multicrystalline Solar Cells With Novel Feature Descriptor , 2019, IEEE Transactions on Instrumentation and Measurement.

[23]  Hai Su,et al.  Multistage GAN for Fabric Defect Detection , 2019, IEEE Transactions on Image Processing.

[24]  Mohd Abdullah,et al.  Micro-crack detection of multicrystalline solar cells featuring an improved anisotropic diffusion filter and image segmentation technique , 2014, EURASIP Journal on Image and Video Processing.

[25]  Trung Thanh Nguyen,et al.  3D Unet Generative Adversarial Network for Attenuation Correction of SPECT Images , 2020, 2020 4th International Conference on Recent Advances in Signal Processing, Telecommunications & Computing (SigTelCom).

[26]  Zhenan Sun,et al.  Adversarial Cross-Spectral Face Completion for NIR-VIS Face Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Dumitru Erhan,et al.  Show and Tell: Lessons Learned from the 2015 MSCOCO Image Captioning Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Tanfeng Sun,et al.  GAN-Generated Image Detection With Self-Attention Mechanism Against GAN Generator Defect , 2020, IEEE Journal of Selected Topics in Signal Processing.

[29]  Vishal M. Patel,et al.  Image De-Raining Using a Conditional Generative Adversarial Network , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Yinghuan Shi,et al.  Crossbar-Net: A Novel Convolutional Neural Network for Kidney Tumor Segmentation in CT Images , 2018, IEEE Transactions on Image Processing.

[31]  Ruigang Yang,et al.  Gated Path Selection Network for Semantic Segmentation , 2021, IEEE Transactions on Image Processing.

[32]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[34]  Litu Rout,et al.  S2A: Wasserstein GAN with Spatio-Spectral Laplacian Attention for Multi-Spectral Band Synthesis , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Dennis F. Dunn,et al.  Optimal Gabor filters for texture segmentation , 1995, IEEE Trans. Image Process..

[36]  Binyi Su,et al.  BAF-Detector: An Efficient CNN-Based Detector for Photovoltaic Solar Cell Defect Detection , 2020, ArXiv.

[37]  Harshad Rai,et al.  Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks , 2018 .

[38]  Binyi Su,et al.  RCAG-Net: Residual Channelwise Attention Gate Network for Hot Spot Defect Detection of Photovoltaic Farms , 2021, IEEE Transactions on Instrumentation and Measurement.

[39]  Takeshi Nakazawa,et al.  Anomaly Detection and Segmentation for Wafer Defect Patterns Using Deep Convolutional Encoder–Decoder Neural Network Architectures in Semiconductor Manufacturing , 2019, IEEE Transactions on Semiconductor Manufacturing.

[40]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Sébastien Ourselin,et al.  DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Kun Liu,et al.  Accurate and robust crack detection using steerable evidence filtering in electroluminescence images of solar cells , 2019, Optics and Lasers in Engineering.

[44]  Hao Zhang,et al.  BSD-GAN: Branched Generative Adversarial Network for Scale-Disentangled Representation Learning and Image Synthesis , 2020, IEEE Transactions on Image Processing.

[45]  Kaixin Liu,et al.  Generative Principal Component Thermography for Enhanced Defect Detection and Analysis , 2020, IEEE Transactions on Instrumentation and Measurement.