A Novel Method Based on Deep Convolutional Neural Networks for Wafer Semiconductor Surface Defect Inspection

Semiconductor wafer is widely used in welding robot, spray robot, unmanned material delivery vehicle, and detection station sensor. The defects of semiconductor wafer, such as stains, burrs, scratches, and holes generated in the manufacturing process, severely affect the quality of downstream products. Therefore, the inspection of wafer defect could not be neglected. Traditional semiconductor wafer defect inspection methods based on handcrafted features heavily rely on the expertise and are limited in some application scenario. In this article, a novel method based on deep convolutional neural networks for semiconductor wafer surface defect inspection is proposed. First, a new structure of feature pyramid networks with atrous convolution (FPNAC) is developed to extract the features and to generate feature maps. Second, the feature maps are fed into region proposal network (RPN) to generate region proposals. Finally, the region proposals are aligned to corresponding size as the inputs of deep multibranches neural network (DMBNN) consisting of three branches, to classify and segment the defects precisely. Experimental results demonstrate that the proposed method yields good comprehensive performance with mean pixel accuracy (MPA) 93.97% and mean intersection over union (MIoU) 83.58%.

[1]  Marko Radulovic,et al.  Gray-Level Co-Occurrence Matrix Texture Analysis of Breast Tumor Images in Prognosis of Distant Metastasis Risk , 2015, Microscopy and Microanalysis.

[2]  Takeshi Nakazawa,et al.  Wafer Map Defect Pattern Classification and Image Retrieval Using Convolutional Neural Network , 2018, IEEE Transactions on Semiconductor Manufacturing.

[3]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Du-Ming Tsai,et al.  Mean Shift-Based Defect Detection in Multicrystalline Solar Wafer Surfaces , 2011, IEEE Transactions on Industrial Informatics.

[5]  Hui Zhou,et al.  Effects of wafer noise on the detection of 20-nm defects using optical volumetric inspection , 2015 .

[6]  Dong-Joong Kang,et al.  Machine learning-based imaging system for surface defect inspection , 2016, International Journal of Precision Engineering and Manufacturing-Green Technology.

[7]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[8]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[9]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[10]  Shing I. Chang,et al.  Computer Vision Based Non-contact Surface Roughness Assessment Using Wavelet Transform and Response Surface Methodology , 2005 .

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Gabriel Cristóbal,et al.  A comprehensive study of texture analysis based on local binary patterns , 2012, Photonics Europe.

[13]  Denis Stajnko,et al.  Original papers: Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry , 2011 .

[14]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Jacob Scharcanski Stochastic Texture Analysis for Measuring Sheet Formation Variability in the Industry , 2006, IEEE Transactions on Instrumentation and Measurement.

[16]  Cheng Hao Jin,et al.  A Novel DBSCAN-Based Defect Pattern Detection and Classification Framework for Wafer Bin Map , 2019, IEEE Transactions on Semiconductor Manufacturing.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Giovanna Castellano,et al.  A Texture-Based Image Processing Approach for the Description of Human Oocyte Cytoplasm , 2010, IEEE Transactions on Instrumentation and Measurement.

[19]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Alina A. von Davier,et al.  Cross-Validation , 2014 .

[21]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.

[23]  H N.,et al.  Automatic Semiconductor Wafer Image Segmentation for Defect Detection Using Multilevel Thresholding , 2016 .

[24]  Yong Xu,et al.  Wavelet Domain Multifractal Analysis for Static and Dynamic Texture Classification , 2013, IEEE Transactions on Image Processing.

[25]  Liu Yang,et al.  Solar cell crack inspection by image processing , 2004, Proceedings of 2004 International Conference on the Business of Electronic Product Reliability and Liability (IEEE Cat. No.04EX809).

[26]  Baharum Baharudin,et al.  Analysis of distance metrics in content-based image retrieval using statistical quantized histogram texture features in the DCT domain , 2013, J. King Saud Univ. Comput. Inf. Sci..

[27]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[28]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[29]  YangSub Park,et al.  A Visual Inspection Method Based on Periodic Feature for Wheel Mark Defect on Wafer Backside , 2017, CAIP.

[30]  Yoshiaki Matsushita,et al.  Solid-Phase Lateral Epitaxial Growth onto Adjacent SiO2 Film from Amorphous Silicon Deposited on Single-Crystal Silicon Substrate , 1982 .

[31]  Dorit Merhof,et al.  Blind weave detection for woven fabrics , 2014, Pattern Analysis and Applications.

[32]  Szu-Hao Huang,et al.  Automated visual inspection in the semiconductor industry: A survey , 2015, Comput. Ind..

[33]  Yang Hu,et al.  Automated Inspection of Defects in Optical Fiber Connector End Face Using Novel Morphology Approaches , 2018, Sensors.

[34]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  Way Kuo,et al.  Detection and classification of defect patterns on semiconductor wafers , 2006 .

[37]  Hua Yang,et al.  An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces , 2018, IEEE Transactions on Instrumentation and Measurement.