DeepVM: A Deep Learning-based approach with automatic feature extraction for 2D input data Virtual Metrology

Abstract Industry 4.0 encapsulates methods, technologies, and procedures that transform data into informed decisions and added value in an industrial context. In this regard, technologies such as Virtual Metrology or Soft Sensing have gained much interest in the last two decades due to their ability to provide valuable knowledge for production purposes at limited added expense. However, these technologies have struggled to achieve wide-scale industrial adoption, largely due to the challenges associated with handling complex data structures and the feature extraction phase of model building. This phase is generally hand-engineered and based on specific domain knowledge, making it time consuming, difficult to automate, and prone to loss of information, thus ultimately limiting portability. Moreover, in the presence of complex data structures, such as 2-dimensional input data, there are no established procedures for feature extraction. In this paper, we present a Deep Learning approach for Virtual Metrology, called DeepVM, that exploits semi-supervised feature extraction based on Convolutional Autoencoders. The proposed approach is demonstrated using a real world Semiconductor Manufacturing dataset where the Virtual Metrology input data is 2-dimensional Optical Emission Spectrometry data. The feature extraction method is tested with different types of state-of-the-art autoencoder.

[1]  Kwang-Ting Cheng,et al.  An artificial neural network approach for screening test escapes , 2017, 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC).

[2]  Giuseppe De Nicolao,et al.  A hidden-Gamma model-based filtering and prediction approach for monotonic health factors in manufacturing , 2018 .

[3]  John V. Ringwood,et al.  Real-time virtual metrology and control for plasma etch , 2012 .

[4]  Chao Jin,et al.  Methodology on Exact Extraction of Time Series Features for Robust Prognostics and Health Monitoring , 2017 .

[5]  Chang Ouk Kim,et al.  A Deep Learning Model for Robust Wafer Fault Monitoring With Sensor Measurement Noise , 2017, IEEE Transactions on Semiconductor Manufacturing.

[6]  Pablo H. Ibargüengoytia,et al.  Viscosity virtual sensor to control combustion in fossil fuel power plants , 2013, Eng. Appl. Artif. Intell..

[7]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[8]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[9]  Tao Wang,et al.  End-to-end text recognition with convolutional neural networks , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Giuseppe De Nicolao,et al.  An information-theory and Virtual Metrology-based approach to Run-to-Run semiconductor manufacturing control , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[11]  E. Ragnoli,et al.  Identifying key process characteristics and predicting etch rate from high-dimension datasets , 2009, 2009 IEEE/SEMI Advanced Semiconductor Manufacturing Conference.

[12]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[13]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[14]  C. Spanos,et al.  Virtual metrology modeling for plasma etch operations , 2008, 2008 International Symposium on Semiconductor Manufacturing (ISSM).

[15]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[16]  R. Dennis Cook,et al.  Cross-Validation of Regression Models , 1984 .

[17]  R. Gottscho,et al.  Overview of atomic layer etching in the semiconductor industry , 2015 .

[18]  Gian Antonio Susto,et al.  Supervised Aggregative Feature Extraction for Big Data Time Series Regression , 2016, IEEE Transactions on Industrial Informatics.

[19]  Marco Maggipinto,et al.  Deep learning for virtual metrology: Modeling with optical emission spectroscopy data , 2017, 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI).

[20]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Zhe Gan,et al.  Variational Autoencoder for Deep Learning of Images, Labels and Captions , 2016, NIPS.

[24]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[25]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[26]  Manabu Kano,et al.  Adaptive Virtual Metrology Design for Semiconductor Dry Etching Process Through Locally Weighted Partial Least Squares , 2015, IEEE Transactions on Semiconductor Manufacturing.

[27]  Marco Maggipinto,et al.  A Computer Vision-Inspired Deep Learning Architecture for Virtual Metrology Modeling With 2-Dimensional Data , 2018, IEEE Transactions on Semiconductor Manufacturing.

[28]  Gian Antonio Susto,et al.  Virtual metrology enabled early stage prediction for enhanced control of multi-stage fabrication processes , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[29]  Gian Antonio Susto,et al.  Least angle regression for semiconductor manufacturing modeling , 2012, 2012 IEEE International Conference on Control Applications.

[30]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  James Moyne,et al.  Next generation advanced process control: Leveraging big data and prediction , 2016, 2016 27th Annual SEMI Advanced Semiconductor Manufacturing Conference (ASMC).

[32]  James Moyne,et al.  Yield Management Enhanced Advanced Process Control System (YMeAPC)—Part I: Description and Case Study of Feedback for Optimized Multiprocess Control , 2010, IEEE Transactions on Semiconductor Manufacturing.

[33]  Myong Kee Jeong,et al.  Deep Autoencoder With Clipping Fusion Regularization on Multistep Process Signals for Virtual Metrology , 2019, IEEE Sensors Letters.

[34]  Johan A. K. Suykens,et al.  LS-SVM based spectral clustering and regression for predicting maintenance of industrial machines , 2015, Eng. Appl. Artif. Intell..

[35]  Pilsung Kang,et al.  An intelligent virtual metrology system with adaptive update for semiconductor manufacturing , 2017 .

[36]  H. F. Winters,et al.  Ion- and electron-assisted gas-surface chemistry—An important effect in plasma etching , 1979 .

[37]  D. Basak,et al.  Support Vector Regression , 2008 .

[38]  Chia-Yen Lee,et al.  Data Science for Vibration Heteroscedasticity and Predictive Maintenance of Rotary Bearings , 2019, Energies.

[39]  James Moyne,et al.  Virtual metrology and feedback control for semiconductor manufacturing processes using recursive partial least squares , 2008 .

[40]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[41]  Luca Puggini,et al.  Forward Selection Component Analysis: Algorithms and Applications , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Seoung Bum Kim,et al.  Virtual metrology modeling of time-dependent spectroscopic signals by a fused lasso algorithm , 2016 .

[43]  Jay Lee,et al.  Service Innovation and Smart Analytics for Industry 4.0 and Big Data Environment , 2014 .

[44]  Sean McLoone,et al.  Extreme learning machines for virtual metrology and etch rate prediction , 2015, 2015 26th Irish Signals and Systems Conference (ISSC).

[45]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[46]  Fan-Tien Cheng,et al.  Run-to-Run Control Utilizing Virtual Metrology With Reliance Index , 2013, IEEE Transactions on Semiconductor Manufacturing.

[47]  James Moyne,et al.  Big Data Capabilities Applied to Semiconductor Manufacturing Advanced Process Control , 2016, IEEE Transactions on Semiconductor Manufacturing.

[48]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[49]  C.H. Yu,et al.  Virtual metrology: a solution for wafer to wafer advanced process control , 2005, ISSM 2005, IEEE International Symposium on Semiconductor Manufacturing, 2005..

[50]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[52]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[53]  Yuan Di,et al.  Adaptive virtual metrology for semiconductor chemical mechanical planarization process using GMDH-type polynomial neural networks , 2018 .

[54]  Shu-Kai S. Fan,et al.  An integrated advanced process control framework using run-to-run control, virtual metrology and fault detection , 2013 .