Co-evolutionary genetic Multilayer Perceptron for feature selection and model design

This paper proposes a method for Soft Sensors design using a Multilayer Perceptron model based on co-evolutionary genetic algorithms, called CEV-MLP. This method jointly and automatically selects the best input variables and the best configuration of the network for the prediction setting. The CEV-MLP is constituted by three levels, the first level selects the best input variables and respective delays set, the second level is composed by the parameters of hidden layers to be optimized (number of neurons in the hidden layers and transfer function), and the third level is the combination of first and second level. The method was successfully applied, and compared with two state-of-the-art methods, in three real datasets. In all the experiments, the proposed method shows the best approximation accuracy, while all the design of the prediction setting is performed automatically.

[1]  Omar Fayez Mohamed El-Mahdy,et al.  Computer aided optimization of natural gas pipe networks using genetic algorithm , 2010, Appl. Soft Comput..

[2]  Daniel S. Yeung,et al.  Hidden neuron pruning of multilayer perceptrons using a quantified sensitivity measure , 2006, Neurocomputing.

[3]  Pedro Santos,et al.  Variable and delay selection using neural networks and mutual information for data-driven soft sensors , 2010, 2010 IEEE 15th Conference on Emerging Technologies & Factory Automation (ETFA 2010).

[4]  D.A. Stacey,et al.  Feature subset selection via multi-objective genetic algorithm , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[5]  David R. Cox,et al.  Time Series Analysis , 2012 .

[6]  Josep M. Sopena,et al.  Performing Feature Selection With Multilayer Perceptrons , 2008, IEEE Transactions on Neural Networks.

[7]  Lúcia Valéria Ramos de Arruda,et al.  A neuro-coevolutionary genetic fuzzy system to design soft sensors , 2008, Soft Comput..

[8]  Herman Augusto Lepikson,et al.  Applications of information theory, genetic algorithms, and neural models to predict oil flow , 2009 .

[9]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[10]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[11]  Hecht-Nielsen Theory of the backpropagation neural network , 1989 .

[12]  Timo Similä,et al.  Combined input variable selection and model complexity control for nonlinear regression , 2009, Pattern Recognit. Lett..

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[15]  M. J. Usher Applications of Information Theory , 1984 .

[16]  R. Hecht-Nielsen,et al.  Theory of the Back Propagation Neural Network , 1989 .

[17]  Kang Li,et al.  Neural input selection - A fast model-based approach , 2007, Neurocomputing.

[18]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[19]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[20]  Guoqiang Peter Zhang,et al.  Avoiding Pitfalls in Neural Network Research , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Leslie S. Smith,et al.  Feature subset selection in large dimensionality domains , 2010, Pattern Recognit..