Particle Swarm Optimization Based Deep Learning Ensemble for Manufacturing Processes

Faults detection in semiconductor manufacturing processes is a challenging research problem because the manufacturing processes are characterized by hundreds of different types of operations and the identification of those operations that lead to faults in the final products is very challenging. The existence of faults during the manufacturing processes is strongly correlated with the performance of the manufacturing processes and in this article the main challenge that is approached is the accurate classification of the cases in which the manufacturing processes pass or fail the in line testing considering the information collected during the execution of the operations that are involved in the manufacturing processes. This article approaches the classification of the in line testing of the manufacturing processes using a method that is based on an ensemble of deep learning models in which the weights of the models are determined using Particle Swarm Optimization (PSO). The method is tested and validated on the open source SECOM dataset from the UCI Machine Learning Repository.

[1]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[2]  Jae Kwon Kim,et al.  Feature Selection Techniques for Improving Rare Class Classification in Semiconductor Manufacturing Process , 2016, BDTA.

[3]  Dorin Moldovan,et al.  Machine learning for sensor-based manufacturing processes , 2017, 2017 13th IEEE International Conference on Intelligent Computer Communication and Processing (ICCP).

[4]  Wen Chen,et al.  A New Ensemble Approach based on Deep Convolutional Neural Networks for Steel Surface Defect classification , 2018 .

[5]  ChangShui Zhang,et al.  Challenges in machine learning , 2013 .

[6]  Nitin V. Afzulpurkar,et al.  Optimization of tile manufacturing process using particle swarm optimization , 2011, Swarm Evol. Comput..

[7]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[8]  J. Jones,et al.  Semiconductor manufacturing: an introduction to processes and hazards. , 1987, American journal of industrial medicine.

[9]  Chen-Fu Chien,et al.  Semiconductor manufacturing , 2013 .

[10]  Fulei Chu,et al.  Ensemble deep learning-based fault diagnosis of rotor bearing systems , 2019, Comput. Ind..

[11]  Yoon Sang Lee,et al.  Ensemble Classification Method for Imbalanced Data Using Deep Learning , 2018, WEB.

[12]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[13]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[14]  Xiaodong Li,et al.  An Analysis of the Inertia Weight Parameter for Binary Particle Swarm Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[15]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[16]  Dorin Moldovan,et al.  Prediction of Manufacturing Processes Errors: Gradient Boosted Trees Versus Deep Neural Networks , 2018, 2018 IEEE 16th International Conference on Embedded and Ubiquitous Computing (EUC).

[17]  Kari Tammi,et al.  Recent Studies on Chicken Swarm Optimization algorithm: a review (2014–2018) , 2019, Artificial Intelligence Review.

[18]  Balakrishnan Ramadoss,et al.  Predictive Models for Equipment Fault Detection in the Semiconductor Manufacturing Process , 2016 .

[19]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[20]  Gabriel Kronberger,et al.  Smart Manufacturing and Continuous Improvement and Adaptation of Predictive Models , 2020 .

[21]  Nittaya Kerdprasop,et al.  Feature Selection and Boosting Techniques to Improve Fault Detection Accuracy in the Semiconductor Manufacturing Process , 2011 .

[22]  Dorin Moldovan,et al.  Chicken Swarm Optimization and Deep Learning for Manufacturing Processes , 2018, 2018 17th RoEduNet Conference: Networking in Education and Research (RoEduNet).

[23]  Chi-Hyuck Jun,et al.  Variable Selection Under Missing Values and Unlabeled Data in Semiconductor Processes , 2019, IEEE Transactions on Semiconductor Manufacturing.

[24]  M. Jaffar,et al.  Optimization of Ensemble based Decision using PSO , 2010 .

[25]  Jiann-Shiun Yuan,et al.  An Experimental Evaluation of Fault Diagnosis from Imbalanced and Incomplete Data for Smart Semiconductor Manufacturing , 2018, Big Data Cogn. Comput..

[26]  Yijie Shi,et al.  Data imputation and dimensionality reduction using deep learning in industrial data , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[27]  A. Ferrer,et al.  Dealing with missing data in MSPC: several methods, different interpretations, some examples , 2002 .

[28]  Saeid Nahavandi,et al.  Integration of Ensemble and Evolutionary Machine Learning Algorithms for Monitoring Diver Behavior Using Physiological Signals , 2019, IEEE Access.