Variable and delay selection using neural networks and mutual information for data-driven soft sensors

This paper proposes a new method for input variable and delay selection (IVDS) for Soft Sensors (SS) design. The IVDS algorithm is composed by the following steps: (1) Time delay selection; (2) Identification and exclusion of redundant variables; (3) Best variables subset selection. The IVDS algorithm proposed in this work performs the delay and variable selection through two distinct methods, mutual information (MI) is applied to delay selection and for variable selection a multilayer perceptron (MLP) based approach is performed. It is shown in the case studies that the application of the delay selection before applying the variable selection increases the generalization of the MLP-model. The algorithm uses the relative variance tracking precision (RV TP) criterion and the mean square error (MSE) to evaluate the precision of soft sensor. Simulation results are presented showing the effectiveness of the method.

[1]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[2]  Herman Augusto Lepikson,et al.  Applications of information theory, genetic algorithms, and neural models to predict oil flow , 2009 .

[3]  Xionglin Luo,et al.  Delay Time Identification and Dynamic Characteristics Study on ANN Soft Sensor , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[4]  Å. Björck,et al.  Accelerated projection methods for computing pseudoinverse solutions of systems of linear equations , 1979 .

[5]  Kang Li,et al.  Neural input selection - A fast model-based approach , 2007, Neurocomputing.

[6]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[7]  Giovanna Castellano,et al.  Variable selection using neural-network models , 2000, Neurocomputing.

[8]  Girijesh Prasad,et al.  Statistical and computational intelligence techniques for inferential model development: a comparative evaluation and a novel proposition for fusion , 2004, Eng. Appl. Artif. Intell..

[9]  苏宏业,et al.  Multiple Model Soft Sensor Based on Affinity Propagation, Gaussian Process and Bayesian Committee Machine , 2009 .

[10]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[11]  Hae-Sang Park,et al.  Use of partial least squares regression for variable selection and quality prediction , 2009, 2009 International Conference on Computers & Industrial Engineering.

[12]  P A Vanrolleghem,et al.  Towards a benchmark simulation model for plant-wide control strategy performance evaluation of WWTPs. , 2006, Water science and technology : a journal of the International Association on Water Pollution Research.

[13]  Moustafa Elshafei,et al.  Soft sensor for NOx and O2 using dynamic neural networks , 2009, Comput. Electr. Eng..

[14]  Josep M. Sopena,et al.  Performing Feature Selection With Multilayer Perceptrons , 2008, IEEE Transactions on Neural Networks.