AdaBalGAN: An Improved Generative Adversarial Network With Imbalanced Learning for Wafer Defective Pattern Recognition

Identification of the defective patterns of the wafer maps can provide insights for the quality control in the semiconductor wafer fabrication systems (SWFSs). In real SWFSs, the collected wafer maps are usually imbalanced from the defective types, which will result in misidentification. In this paper, a novel deep learning model called adaptive balancing generative adversarial network (AdaBalGAN) is proposed for the defective pattern recognition (DPR) of wafer maps with imbalanced data. In addition, a categorical generative adversarial network is improved to generate simulated wafer maps in high fidelity and classify the patterns with high accuracy for all defective categories. Taking consideration of the various learning abilities of the DPR model for different patterns into account, an adaptive generative controller is designed to balance the number of samples of each defective type according to the classification accuracy. The experiment results indicated that the proposed AdaBalGAN model outperforms conventional models with higher accuracy and stability for the DPR of wafer maps. Further results of comparative experiments revealed that the proposed adaptive generative mechanism can enhance and balance the recognition accuracy for all categories in the DPR of wafer maps.

[1]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[2]  Wenjun Chris Zhang,et al.  Big data driven cycle time parallel prediction for production planning in wafer manufacturing , 2018, Enterp. Inf. Syst..

[3]  김창욱,et al.  A Convolutional Neural Network for Fault Classification and Diagnosis in Semiconductor Manufacturing Processes , 2016 .

[4]  Ming Yang,et al.  Classification of Alzheimer’s Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling , 2018, Journal of Medical Systems.

[5]  S. Babu,et al.  EMOTE: Enhanced Minority Oversampling TEchnique , 2017, J. Intell. Fuzzy Syst..

[6]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[7]  Kay Chen Tan,et al.  Evolutionary Cluster-Based Synthetic Oversampling Ensemble (ECO-Ensemble) for Imbalance Learning , 2017, IEEE Transactions on Cybernetics.

[8]  Junliang Wang,et al.  Bilateral LSTM: A Two-Dimensional Long Short-Term Memory Model With Multiply Memory Units for Short-Term Cycle Time Forecasting in Re-entrant Manufacturing Systems , 2018, IEEE Transactions on Industrial Informatics.

[9]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[10]  Cheng-Lung Huang,et al.  Defect spatial pattern recognition using a hybrid SOM-SVM approach in semiconductor manufacturing , 2009, Expert Syst. Appl..

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  MengChu Zhou,et al.  A Distance-Based Weighted Undersampling Scheme for Support Vector Machines and its Application to Imbalanced Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Charles Hung-Jia Huang,et al.  Practical "building-in reliability" approaches for semiconductor manufacturing , 2002, IEEE Trans. Reliab..

[14]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[15]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Junjie Hu.  Active learning for imbalance problem using L-GEM of RBFNN , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[17]  Lihui Wang,et al.  Imbalanced data fault diagnosis of rotating machinery using synthetic oversampling and feature learning , 2018, Journal of Manufacturing Systems.

[18]  Winson Taam,et al.  Detecting Spatial Effects From Factorial Experiments: An Application From Integrated-Circuit Manufacturing , 1993 .

[19]  Takeshi Nakazawa,et al.  Wafer Map Defect Pattern Classification and Image Retrieval Using Convolutional Neural Network , 2018, IEEE Transactions on Semiconductor Manufacturing.

[20]  Cheng Hao Jin,et al.  Decision Tree Ensemble-Based Wafer Map Failure Pattern Recognition Based on Radon Transform-Based Features , 2018, IEEE Transactions on Semiconductor Manufacturing.

[21]  Maryam Farajzadeh-Zanjani,et al.  An Integrated Class-Imbalanced Learning Scheme for Diagnosing Bearing Defects in Induction Motors , 2017, IEEE Transactions on Industrial Informatics.

[22]  Yongdong Zhang,et al.  Adaptive weighted imbalance learning with application to abnormal activity recognition , 2016, Neurocomputing.

[23]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[24]  Mario Cifrek,et al.  A brief introduction to OpenCV , 2012, 2012 Proceedings of the 35th International Convention MIPRO.

[25]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[26]  Sungzoon Cho,et al.  Using Wafer Map Features to Better Predict Die-Level Failures in Final Test , 2015, IEEE Transactions on Semiconductor Manufacturing.

[27]  Ming-Ju Wu,et al.  Wafer Map Failure Pattern Recognition and Similarity Ranking for Large-Scale Data Sets , 2015, IEEE Transactions on Semiconductor Manufacturing.

[28]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[29]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[30]  Bo Tang,et al.  KernelADASYN: Kernel based adaptive synthetic data generation for imbalanced learning , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[31]  Sung-Hee Kim,et al.  Multi-step ART1 algorithm for recognition of defect patterns on semiconductor wafers , 2012 .

[32]  Chih-Hsuan Wang,et al.  Recognition of semiconductor defect patterns using spatial filtering and spectral clustering , 2008, Expert Syst. Appl..

[33]  Heeyoung Kim,et al.  Classification of Mixed-Type Defect Patterns in Wafer Bin Maps Using Convolutional Neural Networks , 2018, IEEE Transactions on Semiconductor Manufacturing.

[34]  Mohammed Ismail,et al.  Simplified Subspaced Regression Network for Identification of Defect Patterns in Semiconductor Wafer Maps , 2015, IEEE Transactions on Industrial Informatics.

[35]  Jie Zhang,et al.  Big data analytics for forecasting cycle time in semiconductor wafer fabrication system , 2016 .

[36]  Wei-Ting Kary Chien,et al.  Electromigration Lifetime Optimization by Uniform Designs and a New Lifetime Index , 2015, IEEE Transactions on Reliability.

[37]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[38]  Jerzy Stefanowski,et al.  Types of minority class examples and their influence on learning classifiers from imbalanced data , 2015, Journal of Intelligent Information Systems.

[39]  Fernando Bação,et al.  Effective data generation for imbalanced learning using conditional generative adversarial networks , 2018, Expert Syst. Appl..

[40]  Lee-Ing Tong,et al.  Wafer defect pattern recognition by multi-class support vector machines by using a novel defect cluster index , 2009, Expert Syst. Appl..

[41]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[42]  Heeyoung Kim,et al.  Detection and clustering of mixed-type defect patterns in wafer bin maps , 2018 .

[43]  Yang Wang,et al.  Cost-sensitive boosting for classification of imbalanced data , 2007, Pattern Recognit..

[44]  Fernando Bação,et al.  Oversampling for Imbalanced Learning Based on K-Means and SMOTE , 2017, Inf. Sci..

[45]  Yong Zhang,et al.  Imbalanced data classification based on scaling kernel-based support vector machine , 2014, Neural Computing and Applications.

[46]  Junliang Wang,et al.  A Data Driven Cycle Time Prediction With Feature Selection in a Semiconductor Wafer Fabrication System , 2018, IEEE Transactions on Semiconductor Manufacturing.

[47]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[48]  R. Uzsoy,et al.  A survey of semiconductor supply chain models part I: semiconductor supply chains, strategic network design, and supply chain simulation , 2018, Int. J. Prod. Res..

[49]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.