A stacking ensemble classifier with handcrafted and convolutional features for wafer map pattern classification

Abstract Recently, machine learning has been effectively applied in the automation of wafer map pattern classification in semiconductor manufacturing. One conventional approach is to extract handcrafted features from a wafer map and build an off-the-shelf classifier on top of the features. Another approach is to use a convolutional neural network that operates directly on a wafer map. These two approaches have different strengths for different classes of wafer map defect patterns. In this study, we present a hybrid method that leverages the advantages of both approaches to improve the classification accuracy. First, we build two base classifiers using each of the approaches. Then, we build a stacking ensemble that combines the outputs of these base classifiers for the final prediction. The stacking ensemble classifies a wafer map by assigning a larger weight to the output of the superior base classifier with respect to each defect class. We demonstrate the effectiveness of the proposed method using real-world data from a semiconductor manufacturer.

[1]  Fabio A. González,et al.  Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection , 2014, Medical Imaging.

[2]  Ian H. Witten,et al.  Issues in Stacked Generalization , 2011, J. Artif. Intell. Res..

[3]  J. Broz,et al.  The leading edge of production wafer probe test technology , 2004, 2004 International Conferce on Test.

[4]  Heeyoung Kim,et al.  Classification of Mixed-Type Defect Patterns in Wafer Bin Maps Using Convolutional Neural Networks , 2018, IEEE Transactions on Semiconductor Manufacturing.

[5]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[6]  Loris Nanni,et al.  Bioimage Classification with Handcrafted and Learned Features , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[7]  Seokho Kang,et al.  Rotation-Invariant Wafer Map Pattern Classification With Convolutional Neural Networks , 2020, IEEE Access.

[8]  Naigong Yu,et al.  Wafer Defect Pattern Recognition and Analysis Based on Convolutional Neural Network , 2019, IEEE Transactions on Semiconductor Manufacturing.

[9]  Cher Ming Tan,et al.  Automated wafer defect map generation for process yield improvement , 2011, 2011 International Symposium on Integrated Circuits.

[10]  Ling Shao,et al.  From handcrafted to learned representations for human action recognition: A survey , 2016, Image Vis. Comput..

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Muhammad Saqlain,et al.  A Deep Convolutional Neural Network for Wafer Defect Identification on an Imbalanced Dataset in Semiconductor Manufacturing Processes , 2020, IEEE Transactions on Semiconductor Manufacturing.

[13]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[14]  Muhammad Saqlain,et al.  A Voting Ensemble Classifier for Wafer Map Defect Patterns Identification in Semiconductor Manufacturing , 2019, IEEE Transactions on Semiconductor Manufacturing.

[15]  Maurício Pamplona Segundo,et al.  Employing Fusion of Learned and Handcrafted Features for Unconstrained Ear Recognition , 2017, IET Biom..

[16]  Yu-Chen Lee,et al.  A Light-Weight Neural Network for Wafer Map Classification Based on Data Augmentation , 2020, IEEE Transactions on Semiconductor Manufacturing.

[17]  Sungzoon Cho,et al.  Active Learning of Convolutional Neural Network for Cost-Effective Wafer Map Pattern Classification , 2020, IEEE Transactions on Semiconductor Manufacturing.

[18]  Cheng Hao Jin,et al.  Wafer map defect pattern classification based on convolutional neural network features and error-correcting output codes , 2020, Journal of Intelligent Manufacturing.

[19]  Suk Joo Bae,et al.  Detection of Spatial Defect Patterns Generated in Semiconductor Fabrication Processes , 2011, IEEE Transactions on Semiconductor Manufacturing.

[20]  Önsen Toygar,et al.  Multi-stage age estimation using two level fusions of handcrafted and learned features on facial images , 2018, IET Biom..

[21]  Ming-Ju Wu,et al.  Wafer Map Failure Pattern Recognition and Similarity Ranking for Large-Scale Data Sets , 2015, IEEE Transactions on Semiconductor Manufacturing.

[22]  Nan Chen,et al.  Defect pattern recognition on wafers using convolutional neural networks , 2020, Qual. Reliab. Eng. Int..

[23]  Eman Ahmed,et al.  House Price Estimation from Visual and Textual Features , 2016, IJCCI.

[24]  José Augusto Baranauskas,et al.  Evaluation of Stacking on Biomedical Data , 2012 .

[25]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[26]  Bernhard C. Geiger,et al.  Feature Extraction From Analog Wafermaps: A Comparison of Classical Image Processing and a Deep Generative Model , 2019, IEEE Transactions on Semiconductor Manufacturing.

[27]  Jianbo Yu,et al.  Wafer Map Defect Detection and Recognition Using Joint Local and Nonlocal Linear Discriminant Analysis , 2016, IEEE Transactions on Semiconductor Manufacturing.

[28]  Sungzoon Cho,et al.  Multi-class classification via heterogeneous ensemble of one-class classifiers , 2015, Eng. Appl. Artif. Intell..

[29]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[30]  Nasir M. Rajpoot,et al.  Handcrafted features with convolutional neural networks for detection of tumor cells in histology images , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[31]  Jianbo Yu,et al.  Stacked convolutional sparse denoising auto-encoder for identification of defect patterns in semiconductor wafer map , 2019, Comput. Ind..

[32]  Seoung Bum Kim,et al.  Self-Supervised Representation Learning for Wafer Bin Map Defect Pattern Classification , 2021, IEEE Transactions on Semiconductor Manufacturing.

[33]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[34]  Vijayan N. Nair,et al.  Monitoring wafer map data from integrated circuit fabrication processes for spatially clustered defects , 1997 .

[35]  Cheng Hao Jin,et al.  Decision Tree Ensemble-Based Wafer Map Failure Pattern Recognition Based on Radon Transform-Based Features , 2018, IEEE Transactions on Semiconductor Manufacturing.

[36]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[37]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Henning Müller,et al.  Late fusion of deep learning and handcrafted visual features for biomedical image modality classification , 2019, IET Image Process..

[39]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[40]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[41]  H. Hajj,et al.  Wafer Classification Using Support Vector Machines , 2012, IEEE Transactions on Semiconductor Manufacturing.

[42]  Chia-Yu Hsu,et al.  Ensemble convolutional neural networks with weighted majority for wafer bin map pattern classification , 2020, J. Intell. Manuf..

[43]  Krystian Mikolajczyk,et al.  Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[44]  Yuzi Kanazawa,et al.  Deep Learning-Based Wafer-Map Failure Pattern Recognition Framework , 2019, 20th International Symposium on Quality Electronic Design (ISQED).

[45]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[46]  Bogdan Gabrys,et al.  Metalearning: a survey of trends and technologies , 2013, Artificial Intelligence Review.

[47]  Takeshi Nakazawa,et al.  Wafer Map Defect Pattern Classification and Image Retrieval Using Convolutional Neural Network , 2018, IEEE Transactions on Semiconductor Manufacturing.

[48]  Bernard Zenko,et al.  Is Combining Classifiers with Stacking Better than Selecting the Best One? , 2004, Machine Learning.

[49]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[50]  Zhaowei Zhong,et al.  Defect detection on semiconductor wafer surfaces , 2005 .

[51]  Qin Wang,et al.  Wafer defect patterns recognition based on OPTICS and multi-label classification , 2016, 2016 IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC).