Processes soft modeling based on stacked autoencoders and wavelet extreme learning machine for aluminum plant-wide application

Abstract Data-driven soft modeling has been extensively used for industrial processes to estimate key quality indicators which are hard to measure by some physical devices. However,the existing deep soft methods faces the challenge of training efficiency, gradient diminishing and explosion. Constructing an accurate and robust soft model is still a challenging topic from an application point of view. This paper develops an effective and efficient soft method (SAE-WELM) for processes modeling. First, a stacked autoencoder (SAE) is used to extract the deep features. Then, a top-layer extreme learning machine (ELM) is further applied to a plant-wide industrial aluminum production process. The activation function is wavelet kernel. Finally, the approximation and convergence of the proposed SAE-WELM are theoretically proved. The industrial case demonstrates that SAE-WELM captures the deep features faster than other iterative-based neural networks, and the accuracy and robustness outperform the existing state-of-the-art methods.

[1]  Yusuf Oysal,et al.  Fuzzy Wavelet Neural Network Models for Prediction and Identification of Dynamical Systems , 2010, IEEE Transactions on Neural Networks.

[2]  Morteza Tofighi,et al.  Fuzzy wavelet plus a quantum neural network as a design base for power system stability enhancement , 2015, Neural Networks.

[3]  Witold Pedrycz,et al.  Fuzzy Wavelet Polynomial Neural Networks: Analysis and Design , 2017, IEEE Transactions on Fuzzy Systems.

[4]  Jiuwen Cao,et al.  Kernel-Based Multilayer Extreme Learning Machines for Representation Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Xiaofeng Yuan,et al.  A dynamic CNN for nonlinear dynamic feature learning in soft sensor modeling of industrial process data , 2020 .

[6]  Weihua Gui,et al.  Dynamic modeling and optimal control of goethite process based on the rate-controlling step , 2017 .

[7]  Weihua Gui,et al.  Neurofuzzy-Based Plant-Wide Hierarchical Coordinating Optimization and Control: An Application to Zinc Hydrometallurgy Plant , 2020, IEEE Transactions on Industrial Electronics.

[8]  Zhiqiang Ge,et al.  Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application , 2019, IEEE Transactions on Industrial Informatics.

[9]  Taher Niknam,et al.  Probabilistic Forecasting of Hourly Electricity Price by Generalization of ELM for Usage in Improved Wavelet Neural Network , 2017, IEEE Transactions on Industrial Informatics.

[10]  Taher Niknam,et al.  Probabilistic Load Forecasting Using an Improved Wavelet Neural Network Trained by Generalized Extreme Learning Machine , 2018, IEEE Transactions on Smart Grid.

[11]  Yongfang Xie,et al.  An improved cell situation identification approach with convolutional neural network and wavelet extreme learning machine , 2020 .

[12]  Weihua Gui,et al.  A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. , 2019, ISA transactions.

[13]  Divish Rengasamy,et al.  Deep Learning with Dynamically Weighted Loss Function for Sensor-Based Prognostics and Health Management , 2020, Sensors.

[14]  Lin Li,et al.  Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network , 2020, IEEE Transactions on Industrial Informatics.

[15]  Wen Yu,et al.  Integrated soft sensor with wavelet neural network and adaptive weighted fusion for water quality estimation in wastewater treatment process , 2018, Measurement.

[16]  Le Yao,et al.  Nonlinear probabilistic latent variable regression models for soft sensor application: From shallow to deep structure , 2020 .

[17]  Yi Zheng,et al.  Hot-rolled strip laminar cooling process plant-wide temperature monitoring and control , 2013 .

[18]  Jun Zhang,et al.  Wavelet neural networks for function learning , 1995, IEEE Trans. Signal Process..

[19]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[20]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[21]  Zhiqiang Ge,et al.  Deep Learning of Semisupervised Process Data With Hierarchical Extreme Learning Machine and Soft Sensor Application , 2018, IEEE Transactions on Industrial Electronics.

[22]  Chang Liu,et al.  Online Spatiotemporal Extreme Learning Machine for Complex Time-Varying Distributed Parameter Systems , 2017, IEEE Transactions on Industrial Informatics.

[23]  Tharam S. Dillon,et al.  Optimized Configuration of Exponential Smoothing and Extreme Learning Machine for Traffic Flow Forecasting , 2019, IEEE Transactions on Industrial Informatics.

[24]  Wei Li,et al.  sEMG-Based Identification of Hand Motion Commands Using Wavelet Neural Network Combined With Discrete Wavelet Transform , 2016, IEEE Transactions on Industrial Electronics.

[25]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Yongfang Xie,et al.  A semi-supervised Laplacian extreme learning machine and feature fusion with CNN for industrial superheat identification , 2020, Neurocomputing.

[27]  Markku Niemela,et al.  Soft-Sensor-Based Flow Rate and Specific Energy Estimation of Industrial Variable-Speed-Driven Twin Rotary Screw Compressor , 2016, IEEE Transactions on Industrial Electronics.

[28]  Witold Pedrycz,et al.  Hybrid Fuzzy Wavelet Neural Networks Architecture Based on Polynomial Neural Networks and Fuzzy Set/Relation Inference-Based Wavelet Neurons , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Haibin Wu,et al.  Physically Consistent Soft-Sensor Development Using Sequence-to-Sequence Neural Networks , 2020, IEEE Transactions on Industrial Informatics.

[30]  Zhen He,et al.  Ensemble deep learning based semi-supervised soft sensor modeling method and its application on quality prediction for coal preparation process , 2020, Adv. Eng. Informatics.

[31]  Weihua Gui,et al.  Weighted-coupling CSTR modeling and model predictive control with parameter adaptive correction for the goethite process , 2018 .

[32]  Biao Huang,et al.  Data-Driven Modeling Based on Two-Stream ${\rm{\lambda }}$ Gated Recurrent Unit Network With Soft Sensor Application , 2020, IEEE Transactions on Industrial Electronics.

[33]  Weihua Gui,et al.  A Layer-Wise Data Augmentation Strategy for Deep Learning Networks and Its Soft Sensor Application in an Industrial Hydrocracking Process , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Zhiqiang Ge,et al.  Distributed Parallel PCA for Modeling and Monitoring of Large-Scale Plant-Wide Processes With Big Data , 2017, IEEE Transactions on Industrial Informatics.

[35]  Xiaofeng Yuan,et al.  Deep Learning With Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development , 2020, IEEE Transactions on Industrial Electronics.

[36]  Yaguo Lei,et al.  EEMD method and WNN for fault diagnosis of locomotive roller bearings , 2011, Expert Syst. Appl..

[37]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.

[38]  Biao Huang,et al.  Hierarchical Quality-Relevant Feature Representation for Soft Sensor Modeling: A Novel Deep Learning Strategy , 2020, IEEE Transactions on Industrial Informatics.

[39]  S. Kolås,et al.  Bath temperature and AlF3 control of an aluminium electrolysis cell , 2009 .