Evolutionary Optimized Forest of Regression Trees: Application in Metallurgy

A forest of regression trees is generated, with each tree using a different randomly chosen subset of data. Then the forest is optimized in two ways. First each tree independently by shifting the split points to the left or to the right to compensate for the fact, that the original split points were set up as being optimal only for the given node and not for the whole tree. Then evolutionary algorithms are used to exchange particular tree subnodes between different trees in the forest. This leads to the best single tree, which although may produce not better results than the forest, but can generate comprehensive logical rules that are very important in some practical applications. The system is currently being applied in the optimization of metallurgical processes.

[1]  Claude Sammut,et al.  Incremental Learning of Linear Model Trees , 2004, Machine Learning.

[2]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[3]  Marcin Blachnik,et al.  A Model for Temperature Prediction of Melted Steel in the Electric Arc Furnace (EAF) , 2010, ICAISC.

[4]  Ivan Zelinka,et al.  Evolutionary Algorithms and Chaotic Systems , 2010, Evolutionary Algorithms and Chaotic Systems.

[5]  Marek Kretowski,et al.  An Evolutionary Algorithm for Global Induction of Regression Trees with Multivariate Linear Models , 2011, ISMIS.

[6]  Michelangelo Ceci,et al.  Top-down induction of model trees with regression and splitting nodes , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Wlodzislaw Duch,et al.  Heterogeneous Forests of Decision Trees , 2002, ICANN.

[8]  Juan M. Corchado,et al.  Hybrid learning machines , 2009, Neurocomputing.

[9]  Norbert Jankowski,et al.  Heterogenous committees with competence analysis , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[10]  Hussein A. Abbass,et al.  Evolving an Ensemble of Neural Networks Using Artificial Immune Systems , 2008, SEAL.

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[12]  Eibe Frank,et al.  Logistic Model Trees , 2003, Machine Learning.

[13]  Jacek M. Zurada,et al.  Artificial Intelligence and Soft Computing, 10th International Conference, ICAISC 2010, Zakopane, Poland, June 13-17, 2010, Part I , 2010, International Conference on Artificial Intelligence and Soft Computing.

[14]  Huanhuan Chen,et al.  Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[15]  Taïcir Loukil,et al.  Multiple crossover genetic algorithm for the multiobjective traveling salesman problem , 2010, Electron. Notes Discret. Math..

[16]  Jacek M. Zurada,et al.  Computational intelligence methods for rule-based data understanding , 2004, Proceedings of the IEEE.

[17]  Marcin Blachnik,et al.  Neural Network Committees Optimized with Evolutionary Methods for Steel Temperature Control , 2011, ICCCI.

[18]  Marcin Blachnik,et al.  Evolutionary Optimization of Regression Model Ensembles in Steel-Making Process , 2011, IDEAL.

[19]  Wlodzislaw Duch,et al.  Variable step search algorithm for feedforward networks , 2008, Neurocomputing.

[20]  David C. Sterratt,et al.  Does Morphology Influence Temporal Plasticity? , 2002, ICANN.

[21]  Z. Ivan,et al.  Evolutionary Scanning and Neural Network Optimization , 2008, 2008 19th International Workshop on Database and Expert Systems Applications.

[22]  Victor J. Rayward-Smith,et al.  Intelligent Data Engineering and Automated Learning - IDEAL 2011 , 2011, Lecture Notes in Computer Science.

[23]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .

[24]  Emilio Corchado,et al.  Hybrid intelligent algorithms and applications , 2010, Inf. Sci..

[25]  Marcin Blachnik,et al.  A Hybrid System with Regression Trees in Steel-Making Process , 2011, HAIS.

[26]  Rudy Setiono,et al.  An Approach To Generate Rules From Neural Networks for Regression Problems , 2004, Eur. J. Oper. Res..

[27]  Shusaku Tsumoto,et al.  Foundations of Intelligent Systems, 15th International Symposium, ISMIS 2005, Saratoga Springs, NY, USA, May 25-28, 2005, Proceedings , 2005, ISMIS.