A manufacturing quality prediction model based on AdaBoost-LSTM with rough knowledge

Abstract Manufacturing quality prediction is one of the significant concerns in modern enterprise production management, which provides data support for reliability assessment and parameter optimization, thus improving the intelligent management level of enterprises and helping achieve high-quality products at lower costs. In this paper, an ensemble learning framework using rough knowledge is proposed for manufacturing quality prediction. The proposed model consists of three elements: (1) significant parameters in different production stages are selected based on attribute reduction and decision rule extraction of rough set theory (RS), (2) long short-term memory network (LSTM) is utilized for building the relationship between the significant parameters and manufacturing quality, and (3) the learning performance of the LSTM is reinforced by AdaBoost approach. To estimate the effectiveness of the proposed model, a competition dataset about manufacturing quality control is applied and six models are investigated. The comparison experiments show that the proposed model overwhelms all the comparison models in terms of root-mean-square error, threshold statistics and residuals analysis. In addition, the proposed model has statistically significant difference from all the comparative models. It is recommended from this work that the ensemble learning technique integrating the rough knowledge synchronously improves the sensitivity and regression capacity of the model.

[1]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[2]  Ziya Arnavut,et al.  Fault diagnosis for airplane engines using Bayesian networks and distributed particle swarm optimization , 2007, Parallel Comput..

[3]  Chuan Li,et al.  A Deep Regression Model with Low-Dimensional Feature Extraction for Multi-Parameter Manufacturing Quality Prediction , 2020 .

[4]  Xuejiao Li,et al.  Multi‐Scale Fuzzy Inference System for Influent Characteristic Prediction of Wastewater Treatment , 2018 .

[5]  Qi Gao,et al.  Exploration of energy saving potential in China power industry based on Adaboost back propagation neural network , 2019 .

[6]  Jianyu Long,et al.  Manufacturing Quality Prediction Using Intelligent Learning Approaches: A Comparative Study , 2017 .

[7]  Min Tan,et al.  Automatic recognition system of welding seam type based on SVM method , 2017, The International Journal of Advanced Manufacturing Technology.

[8]  Johan A. K. Suykens,et al.  LS-SVM based spectral clustering and regression for predicting maintenance of industrial machines , 2015, Eng. Appl. Artif. Intell..

[9]  Mahardhika Pratama,et al.  Autonomous supervision and optimization of product quality in a multi-stage manufacturing process based on self-adaptive prediction models , 2019, Journal of Process Control.

[10]  Balázs Kégl,et al.  The return of AdaBoost.MH: multi-class Hamming trees , 2013, ICLR.

[11]  Shu-Kai S. Fan,et al.  Wafer fault detection and key step identification for semiconductor manufacturing using principal component analysis, AdaBoost and decision tree , 2016 .

[12]  Diego Cabrera,et al.  Deep Hybrid State Network With Feature Reinforcement for Intelligent Fault Diagnosis of Delta 3-D Printers , 2020, IEEE Transactions on Industrial Informatics.

[13]  Chengdong Wu,et al.  The rough set theory and applications , 2004 .

[14]  Ling Xiao,et al.  An improved combination approach based on Adaboost algorithm for wind speed time series forecasting , 2018 .

[15]  Jianyu Long,et al.  A comparison of dimension reduction techniques for support vector machine modeling of multi-parameter manufacturing quality prediction , 2019, J. Intell. Manuf..

[16]  Roman Słowiński,et al.  Optimization of pellets manufacturing process using rough set theory , 2018, European journal of pharmaceutical sciences : official journal of the European Federation for Pharmaceutical Sciences.

[17]  Guoqiang Han,et al.  δ-agree AdaBoost stacked autoencoder for short-term traffic flow forecasting , 2017, Neurocomputing.

[18]  Radu Grosu,et al.  A generative neural network model for the quality prediction of work in progress products , 2019, Appl. Soft Comput..

[19]  Toly Chen.  An ANN approach for modeling the multisource yield learning process with semiconductor manufacturing as an example , 2017, Comput. Ind. Eng..

[20]  Tian-Shyug Lee,et al.  A multi-stage control chart pattern recognition scheme based on independent component analysis and support vector machine , 2016, J. Intell. Manuf..

[21]  Yeong-gwang Oh,et al.  Adaptive SVM-based real-time quality assessment for primer-sealer dispensing process of sunroof assembly line , 2019, Reliab. Eng. Syst. Saf..

[22]  Pawel Lezanski,et al.  The dominance-based rough set approach to cylindrical plunge grinding process diagnosis , 2018, J. Intell. Manuf..

[23]  Gunther Reinhart,et al.  Data mining in lithium-ion battery cell production , 2019, Journal of Power Sources.

[24]  Li Hao,et al.  Residual Life Prediction of Multistage Manufacturing Processes With Interaction Between Tool Wear and Product Quality Degradation , 2017, IEEE Transactions on Automation Science and Engineering.

[25]  Surajit Kumar Paul,et al.  Prediction of complete forming limit diagram from tensile properties of various steel sheets by a nonlinear regression based approach , 2016 .

[26]  Li Pheng Khoo,et al.  Feature extraction using rough set theory and genetic algorithms--an application for the simplification of product quality evaluation , 2002 .

[27]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[28]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[29]  Amir H. Mohammadi,et al.  Hybrid of Two Heuristic Optimizations with LSSVM to Predict Refractive Index as Asphaltene Stability Identifier , 2014 .

[30]  Takashi Hiyama,et al.  Predicting remaining useful life of rotating machinery based artificial neural network , 2010, Comput. Math. Appl..

[31]  Muhammad Saqlain,et al.  A Voting Ensemble Classifier for Wafer Map Defect Patterns Identification in Semiconductor Manufacturing , 2019, IEEE Transactions on Semiconductor Manufacturing.

[32]  Diego Cabrera,et al.  Fuzzy determination of informative frequency band for bearing fault detection , 2016, J. Intell. Fuzzy Syst..

[33]  Yuan Xu,et al.  Fault diagnosis using novel AdaBoost based discriminant locality preserving projection with resamples , 2020, Eng. Appl. Artif. Intell..

[34]  Hai-Feng Li,et al.  A Hybrid Ensemble Model Based on ELM and Improved AdaBoost.RT Algorithm for Predicting the Iron Ore Sintering Characters , 2019, Comput. Intell. Neurosci..

[35]  Xianke Lin,et al.  An adversarial bidirectional serial–parallel LSTM-based QTD framework for product quality prediction , 2020, J. Intell. Manuf..

[36]  Jing-Tao Zhou,et al.  Tool remaining useful life prediction method based on LSTM under variable working conditions , 2019, The International Journal of Advanced Manufacturing Technology.

[37]  Junliang Wang,et al.  Bilateral LSTM: A Two-Dimensional Long Short-Term Memory Model With Multiply Memory Units for Short-Term Cycle Time Forecasting in Re-entrant Manufacturing Systems , 2018, IEEE Transactions on Industrial Informatics.

[38]  Katharina Morik,et al.  Quality Prediction in Interlinked Manufacturing Processes based on Supervised & Unsupervised Machine Learning , 2013 .

[39]  Weizhi Liao,et al.  A knowledge resources fusion method based on rough set theory for quality prediction , 2019, Comput. Ind..

[40]  Jay Lee,et al.  Service Innovation and Smart Analytics for Industry 4.0 and Big Data Environment , 2014 .

[41]  Yi Wang,et al.  A deep learning approach for anomaly detection based on SAE and LSTM in mechanical equipment , 2019, The International Journal of Advanced Manufacturing Technology.

[42]  Peihua Gu,et al.  Robust modelling and prediction of thermally induced positional error based on grey rough set theory and neural networks , 2016 .

[43]  Elisa Guerrero Vázquez,et al.  Multiple comparison procedures applied to model selection , 2002, Neurocomputing.

[44]  Hongchun Sun,et al.  Resistance spot welding quality identification with particle swarm optimization and a kernel extreme learning machine model , 2017 .

[45]  Jianyu Long,et al.  A Novel Sparse Echo Autoencoder Network for Data-Driven Fault Diagnosis of Delta 3-D Printers , 2020, IEEE Transactions on Instrumentation and Measurement.

[46]  Chao Yang,et al.  Ensemble deep kernel learning with application to quality prediction in industrial polymerization processes , 2018 .

[47]  Dongdong Kong,et al.  Relevance vector machine for tool wear prediction , 2019, Mechanical Systems and Signal Processing.

[48]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.