Joint modeling of classification and regression for improving faulty wafer detection in semiconductor manufacturing

In the semiconductor manufacturing process, it is important to identify wafers on which faults have occurred or will occur to avoid unnecessary and costly further processing and physical inspections. This issue can be addressed by formulating the faulty wafer detection problem as a predictive modeling task, in which the process parameters/measurements and subsequent inspection results concerning the faults comprise the input and output variables at the wafer level, respectively. To achieve improved predictive performance, this paper presents a joint modeling method that incorporates classification and regression tasks into a single prediction model. Given the output variables in both binary and continuous forms, the prediction model simultaneously considers both the classification and regression tasks to complement each other, where each task predicts the binary and continuous output variables, respectively. The outputs from these two tasks are combined to predict whether a wafer is faulty. The entire model is implemented as a neural network, and is trained by optimizing a single objective function. The effectiveness of the model is demonstrated with a case study using real-world data from a semiconductor manufacturer.

[1]  Fan-Tien Cheng,et al.  Application development of virtual metrology in semiconductor industry , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[2]  Douglas C. Montgomery,et al.  A review of yield modelling techniques for semiconductor manufacturing , 2006 .

[3]  MuDer Jeng,et al.  Wafer defect inspection by neural analysis of region features , 2011, J. Intell. Manuf..

[4]  Eduardo Corrêa Gonçalves,et al.  Combining classification and regression for improving permeability estimations from 1H NMR relaxation data , 2017 .

[5]  Jie Zhang,et al.  Fuzzy neural network based yield prediction model for semiconductor manufacturing system , 2010 .

[6]  Jin Wang,et al.  Fault Detection Using the k-Nearest Neighbor Rule for Semiconductor Manufacturing Processes , 2007, IEEE Transactions on Semiconductor Manufacturing.

[7]  Wen-Chih Wang,et al.  Data mining for yield enhancement in semiconductor manufacturing and an empirical study , 2007, Expert Syst. Appl..

[8]  Xin Zhang,et al.  Condition multi-classification and evaluation of system degradation process using an improved support vector machine , 2017, Microelectron. Reliab..

[9]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[10]  Chee Peng Lim,et al.  Motor fault detection and diagnosis using a hybrid FMM-CART model with online learning , 2016, J. Intell. Manuf..

[11]  Seokho Kang,et al.  On Effectiveness of Transfer Learning Approach for Neural Network-Based Virtual Metrology Modeling , 2018, IEEE Transactions on Semiconductor Manufacturing.

[12]  Jianyu Long,et al.  A comparison of dimension reduction techniques for support vector machine modeling of multi-parameter manufacturing quality prediction , 2019, J. Intell. Manuf..

[13]  James Moyne,et al.  Big Data Capabilities Applied to Semiconductor Manufacturing Advanced Process Control , 2016, IEEE Transactions on Semiconductor Manufacturing.

[14]  C.H. Yu,et al.  Virtual metrology: a solution for wafer to wafer advanced process control , 2005, ISSM 2005, IEEE International Symposium on Semiconductor Manufacturing, 2005..

[15]  Chen-Fu Chien,et al.  Analysing semiconductor manufacturing big data for root cause detection of excursion for yield enhancement , 2017, Int. J. Prod. Res..

[16]  Stefano Carpin,et al.  Combining classification and regression for WiFi localization of heterogeneous robot teams in unknown environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Jason Chao-Hsien Pan,et al.  A new strategy for defect inspection by the virtual inspection in semiconductor wafer fabrication , 2011, Comput. Ind. Eng..

[18]  Pedro Antonio Gutiérrez,et al.  Combining classification and regression approaches for the quantification of highly overlapping capillary electrophoresis peaks by using evolutionary sigmoidal and product unit neural networks , 2007 .

[19]  Chen-Fu Chien,et al.  A Framework for Root Cause Detection of Sub-Batch Processing System for Semiconductor Manufacturing Big Data Analytics , 2014, IEEE Transactions on Semiconductor Manufacturing.

[20]  Der-Chiang Li,et al.  A non-linear quality improvement model using SVR for manufacturing TFT-LCDs , 2012, J. Intell. Manuf..

[21]  Vedang Chauhan,et al.  A flexible machine vision system for small part inspection based on a hybrid SVM/ANN approach , 2018, J. Intell. Manuf..

[22]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[23]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[24]  Chien-Chang Hsu,et al.  Intelligent maintenance prediction system for LED wafer testing machine , 2016, J. Intell. Manuf..

[25]  Hyoungjoo Lee,et al.  Machine learning-based novelty detection for faulty wafer detection in semiconductor manufacturing , 2012, Expert Syst. Appl..

[26]  Christian A. Müller,et al.  Combining regression and classification methods for improving automatic speaker age recognition , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Lee-Ing Tong,et al.  Novel yield model for integrated circuits with clustered defects , 2008, Expert Syst. Appl..

[28]  Tao Zhang,et al.  Industrial feedforward control technology: a review , 2019, J. Intell. Manuf..

[29]  Wenjun Zeng,et al.  Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks , 2016, ECCV.

[30]  SchmidhuberJürgen.  Deep learning in neural networks , 2015 .

[31]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[32]  Reha Uzsoy,et al.  A REVIEW OF PRODUCTION PLANNING AND SCHEDULING MODELS IN THE SEMICONDUCTOR INDUSTRY PART I: SYSTEM CHARACTERISTICS, PERFORMANCE EVALUATION AND PRODUCTION PLANNING , 1992 .

[33]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[34]  Horst Bischof,et al.  Accurate Object Detection with Joint Classification-Regression Random Forests , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Chung Kwan Shin,et al.  A machine learning approach to yield management in semiconductor manufacturing , 2000 .

[36]  D.M. Tilbury,et al.  An Approach for Factory-Wide Control Utilizing Virtual Metrology , 2007, IEEE Transactions on Semiconductor Manufacturing.

[37]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[38]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[39]  Szu-Hao Huang,et al.  Automated visual inspection in the semiconductor industry: A survey , 2015, Comput. Ind..

[40]  Diego Cabrera,et al.  Multimodal deep support vector classification with homologous features and its application to gearbox fault diagnosis , 2015, Neurocomputing.

[41]  Dinggang Shen,et al.  A novel relational regularization feature selection method for joint regression and classification in AD diagnosis , 2017, Medical Image Anal..

[42]  Zhen He,et al.  Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques , 2013, J. Intell. Manuf..

[43]  H. Hajj,et al.  Wafer Classification Using Support Vector Machines , 2012, IEEE Transactions on Semiconductor Manufacturing.

[44]  Biqing Huang,et al.  Approach for fault prognosis using recurrent neural network , 2018, J. Intell. Manuf..

[45]  Chen-Fu Chien,et al.  Semiconductor fault detection and classification for yield enhancement and manufacturing intelligence , 2012, Flexible Services and Manufacturing Journal.

[46]  Pilsung Kang,et al.  Locally linear ensemble for regression , 2018, Inf. Sci..

[47]  Chang Ouk Kim,et al.  Recurrent feature-incorporated convolutional neural network for virtual metrology of the chemical mechanical planarization process , 2018, Journal of Intelligent Manufacturing.

[48]  Ming-Ju Wu,et al.  Wafer Map Failure Pattern Recognition and Similarity Ranking for Large-Scale Data Sets , 2015, IEEE Transactions on Semiconductor Manufacturing.

[49]  Ben Glocker,et al.  Joint Classification-Regression Forests for Spatially Structured Multi-object Segmentation , 2012, ECCV.

[50]  Charles X. Ling,et al.  Using AUC and accuracy in evaluating learning algorithms , 2005, IEEE Transactions on Knowledge and Data Engineering.

[51]  Xiaofeng Zhu,et al.  A novel matrix-similarity based loss function for joint regression and classification in AD diagnosis , 2014, NeuroImage.

[52]  Younghoon Kim,et al.  Multitask learning for virtual metrology in semiconductor manufacturing systems , 2018, Comput. Ind. Eng..

[53]  Luis Alberto Rodríguez-Picón,et al.  Using regression models for predicting the product quality in a tubing extrusion process , 2018, Journal of Intelligent Manufacturing.

[54]  David H. Wolpert,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[55]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[56]  Cheng-Ching Yu,et al.  Control relevant issues in semiconductor manufacturing : Overview with some new results , 2007 .

[57]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[58]  Heeyoung Kim,et al.  Classification of Mixed-Type Defect Patterns in Wafer Bin Maps Using Convolutional Neural Networks , 2018, IEEE Transactions on Semiconductor Manufacturing.