Product Yields Forecasting for FCCU via Deep Bi-directional LSTM Network

This paper studies product yields forecasting for fluid catalytic cracking unit (FCCU). Conventional product yields forecasting is usually based on mechanism model, which may ignore some significant factors due to manual approximations. Deep learning methods can extract features automatically based on data without prior knowledge. Considering bidirectional temporal features and spatial features of FCCU, deep bidirectional long-short-term memory (DBLSTM) network is proposed for product yields forecasting. The bidirectional structure can capture bidirectional temporal features of FCCU by considering previous information as well as future information over a period of time. Significant spatial features of sensors at each time step can be extracted automatically through a deep structure by stacking multiple bidirectional structures. Moreover, the deep bidirectional LSTM network can deal with long-term dependencies by integrating deep bidirectional structure with LSTM cell. To avoid overfitting, regularization adopted in this paper is dropout and early stopping. Efficacy of the DBLSTM approach is demonstrated by process data from an actual FCCU in China. Through the comparison of mean squared error on product yields forecasting, the DBLSTM approach is superior to traditional regression models and other recurrent models.

[1]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[2]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[6]  Kam-Fai Wong,et al.  Recurrent Neural Networks with External Memory for Spoken Language Understanding , 2015, NLPCC.

[7]  J. Gary,et al.  Petroleum Refining: Technology and Economics , 1975 .

[8]  Dexian Huang,et al.  Data-driven soft sensor development based on deep learning technique , 2014 .

[9]  Xiangang Li,et al.  Constructing long short-term memory based deep recurrent neural networks for large vocabulary speech recognition , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  O. Nelles Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models , 2000 .

[11]  Reza Sadeghbeigi,et al.  Fluid Catalytic Cracking Handbook: An Expert Guide to the Practical Operation, Design, and Optimization of FCC Units , 2000 .

[12]  Di Tang,et al.  A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application , 2017, IEEE Transactions on Industrial Electronics.

[13]  Xiao Fan Wang,et al.  Soft sensing modeling based on support vector machine and Bayesian model selection , 2004, Comput. Chem. Eng..

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.