Deep Learning-Based Solar-Cell Manufacturing Defect Detection With Complementary Attention Network

The automatic defects detection for solar cell electroluminescence (EL) images is a challenging task, due to the similarity of defect features and complex background features. To address this problem, a novel Complementary Attention Network (CAN) is designed by connecting the novel channel-wise attention subnetwork with spatial attention subnetwork sequentially, which adaptively suppresses the background noise features and highlights the defect features simultaneously by employing the complementary advantage of the channel features and spatial position features. In CAN, the novel channel-wise attention subnetwork applies convolution operation to integrate the concatenated and discriminative output features extracted by Global Average Pooling (GAP) layer and Global Max Pooling (GMP) layer, which can make fully use of these informative features. Furthermore, a Region Proposal Attention Network (RPAN) is proposed by embedding CAN into Region Proposal Network (RPN) in Faster R-CNN to extract more refined defective region proposals, which is used to construct a novel end-to-end Faster RPAN-CNN framework for detecting defects in raw EL image. Finally, some experimental results on a large-scale EL dataset including 3629 images, 2129 of which are defective, show that the proposed method performs much better than other methods in terms of defects classification and detection results in raw solar cell EL images.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Kun Liu,et al.  Classification of Manufacturing Defects in Multicrystalline Solar Cells With Novel Feature Descriptor , 2019, IEEE Transactions on Instrumentation and Measurement.

[3]  Wei Xu,et al.  Look and Think Twice: Capturing Top-Down Visual Attention with Feedback Convolutional Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[5]  Thomas Brox,et al.  Microcracks in Silicon Wafers I: Inline Detection and Implications of Crack Morphology on Wafer Strength , 2016, IEEE Journal of Photovoltaics.

[6]  Biao Huang,et al.  Hierarchical Quality-Relevant Feature Representation for Soft Sensor Modeling: A Novel Deep Learning Strategy , 2020, IEEE Transactions on Industrial Informatics.

[7]  Scott T. Acton,et al.  Oriented filters for vessel contrast enhancement with local directional evidence , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[8]  Yunhui Yan,et al.  A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects , 2013 .

[9]  Zhiqiang Shen,et al.  Improving Object Detection from Scratch via Gated Feature Reuse , 2017, BMVC.

[10]  Mohd Abdullah,et al.  Micro-crack detection of multicrystalline solar cells featuring an improved anisotropic diffusion filter and image segmentation technique , 2014, EURASIP Journal on Image and Video Processing.

[11]  Du-Ming Tsai,et al.  Mean Shift-Based Defect Detection in Multicrystalline Solar Wafer Surfaces , 2011, IEEE Transactions on Industrial Informatics.

[12]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[13]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Geoffrey E. Hinton,et al.  Learning to combine foveal glimpses with a third-order Boltzmann machine , 2010, NIPS.

[15]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[16]  D. Song,et al.  Research to the Typical Defects of Crystalline Silicon Photovoltaic Cells based on EL Images , 2013 .

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[19]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Kun Liu,et al.  Solar cell surface defect inspection based on multispectral convolutional neural network , 2018, Journal of Intelligent Manufacturing.

[21]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Lin Tang,et al.  Polycrystalline silicon wafer defect segmentation based on deep convolutional neural networks , 2020, Pattern Recognit. Lett..

[24]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[25]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[26]  Siew Kei Lam,et al.  SSA-CNN: Semantic Self-Attention CNN for Pedestrian Detection , 2019, ArXiv.

[27]  Christian Riess,et al.  Automatic Classification of Defective Photovoltaic Module Cells in Electroluminescence Images , 2018, Solar Energy.

[28]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  D. Tsai,et al.  Defect detection of solar cells in electroluminescence images using Fourier image reconstruction , 2012 .

[31]  Biao Huang,et al.  Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE , 2018, IEEE Transactions on Industrial Informatics.

[32]  Yaonan Wang,et al.  A Surface Defect Detection Framework for Glass Bottle Bottom Using Visual Attention Model and Wavelet Transform , 2020, IEEE Transactions on Industrial Informatics.

[33]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[35]  T. Fuyuki,et al.  Photographic diagnosis of crystalline silicon solar cells utilizing electroluminescence , 2009 .

[36]  Weihua Gui,et al.  A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. , 2019, ISA transactions.

[37]  Du-Ming Tsai,et al.  Defect detection in multi-crystal solar cells using clustering with uniformity measures , 2015, Adv. Eng. Informatics.

[38]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Lin Li,et al.  Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network , 2020, IEEE Transactions on Industrial Informatics.