Polycrystalline silicon wafer defect segmentation based on deep convolutional neural networks

Abstract Defect segmentation is an important way for defect detection in machine vision. For polycrystalline silicon wafer production, it is difficult to automatically segment defects due to its inhomogeneous background and unpredictable defect shapes. The conventional methods based on handcrafted models or features not only heavily rely on the expertise, but also are not flexible from one application case to another. In this paper, we propose a defect segmentation method for polycrystalline silicon wafer based on the deep convolutional networks. Firstly, we apply Region Proposal Network (RPN) to generate underlying defect regions. Then, these generated image patches are processed to suitable sizes for feeding into a improved segmentation network which is modified based on U-net and a dilation convolution. Real defect images are used to test the proposed method and experimental results show that proposed method achieves better performance compared with the state-of-the-art methods.

[1]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Du-Ming Tsai,et al.  Automatic saw-mark detection in multicrystalline solar wafer images , 2011 .

[3]  Lei Zhu,et al.  Unsupervised multi-graph cross-modal hashing for large-scale multimedia retrieval , 2016, Multimedia Tools and Applications.

[4]  Ching-Chung Yin,et al.  Crack detection in photovoltaic cells by interferometric analysis of electronic speckle patterns , 2012 .

[5]  M. Pellegrino,et al.  Analysis Techniques for Photovoltaic Modules Based on Amorphous Solar Cells , 2017 .

[6]  Yi Yang,et al.  Semantic Pooling for Complex Event Analysis in Untrimmed Videos , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jean-Stéphane Bailly,et al.  Local urban sprawl accuracy from image segmentation uncertainties simulation , 2014 .

[8]  James S. Goddard,et al.  Robust defect segmentation in woven fabrics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[9]  Hai Jin,et al.  Effective naive Bayes nearest neighbor based image classification on GPU , 2013, The Journal of Supercomputing.

[10]  Fei Su,et al.  A unified framework with a benchmark dataset for surveillance event detection , 2018, Neurocomputing.

[11]  Yang Wang,et al.  Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation , 2016, ISVC.

[12]  Lei Zhu,et al.  Topic Hypergraph Hashing for Mobile Image Retrieval , 2015, ACM Multimedia.

[13]  Du-Ming Tsai,et al.  Defect detection in multi-crystal solar cells using clustering with uniformity measures , 2015, Adv. Eng. Informatics.

[14]  Jinseok Ko,et al.  Defect detection of polycrystalline solar wafers using local binary mean , 2016 .

[15]  Du-Ming Tsai,et al.  Automated surface inspection for directional textures , 1999, Image Vis. Comput..

[16]  Yi Yang,et al.  Image Classification by Cross-Media Active Learning With Privileged Information , 2016, IEEE Transactions on Multimedia.

[17]  Lei Zhu,et al.  Learning Compact Visual Representation with Canonical Views for Robust Mobile Landmark Search , 2016, IJCAI.

[18]  Jaume Escofet,et al.  Inspection of fabric resistance to abrasion by Fourier analysis , 1998, Other Conferences.

[19]  Hamid K. Aghajan,et al.  Patterned wafer inspection by high resolution spectral estimation techniques , 2005, Machine Vision and Applications.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Yang Zou,et al.  Textual sentiment analysis via three different attention convolutional neural networks and cross-modality consistent regression , 2018, Neurocomputing.

[22]  Yide Ma,et al.  An Efficient Approach for Automated Mass Segmentation and Classification in Mammograms , 2015, Journal of Digital Imaging.

[23]  Mohd Abdullah,et al.  Micro-crack detection of multicrystalline solar cells featuring an improved anisotropic diffusion filter and image segmentation technique , 2014, EURASIP Journal on Image and Video Processing.

[24]  Xavier Maldague,et al.  Thermographic inspection of cracked solar cells , 2002, SPIE Defense + Commercial Sensing.

[25]  Tadashi Shibata,et al.  Automatic Defect Pattern Detection on LSI Wafers Using Image Processing Techniques , 1999 .

[26]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[27]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[30]  C.-C. Jay Kuo,et al.  Texture analysis and classification with tree-structured wavelet transform , 1993, IEEE Trans. Image Process..

[31]  Deyu Meng,et al.  Infrared small-dim target detection based on Markov random field guided noise modeling , 2018, Pattern Recognit..

[32]  S. Ostapenko,et al.  Resonance ultrasonic vibrations for crack detection in photovoltaic silicon wafers , 2007 .

[33]  Richard W. Conners,et al.  Identifying and Locating Surface Defects in Wood: Part of an Automated Lumber Processing System , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Amit Patra,et al.  An object-based coding scheme for frontal surface of defective fluted ingot. , 2006, ISA transactions.

[35]  Shuicheng Yan,et al.  Scale-Aware Fast R-CNN for Pedestrian Detection , 2015, IEEE Transactions on Multimedia.

[36]  Éric Gaussier,et al.  A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation , 2005, ECIR.

[37]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[38]  Liu Yang,et al.  Solar cell crack inspection by image processing , 2004, Proceedings of 2004 International Conference on the Business of Electronic Product Reliability and Liability (IEEE Cat. No.04EX809).

[39]  D. P. Hess,et al.  Crack detection in single-crystalline silicon wafers using impact testing , 2008 .

[40]  Du-Ming Tsai,et al.  Automatic Band Selection for Wavelet Reconstruction in the Application of Defect Detection , 2022 .

[41]  Xiaojun Chang,et al.  Revealing Event Saliency in Unconstrained Video Collection , 2017, IEEE Transactions on Image Processing.

[42]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.