Combining the Advantages of Neural Networks and Decision Trees for Regression Problems in a Steel Temperature Prediction System

Simple decision trees enable obtaining simple logical rules with a limited accuracy in regression tasks. Neural networks as highly non-linear systems can map much more complex shapes and thus can obtain higher prediction accuracy in regression problems, that is however at the cost of the poor comprehensibility of the decision process. We present a hybrid system which incorporates the features of both a regression tree and a neural network. This system allowed for achieving high prediction accuracy supported by comprehensive logical rules for the practical problem of temperature prediction in electric arc furnace at one of the steelwors.

[1]  Kazumi Saito,et al.  Extracting regression rules from neural networks , 2002, Neural Networks.

[2]  Miroslaw Kordos,et al.  Neural Network Regression for LHF Process Optimization , 2009, ICONIP.

[3]  Wlodzislaw Duch,et al.  Variable step search algorithm for feedforward networks , 2008, Neurocomputing.

[4]  Wei Shi,et al.  Regression rules extraction from artificial neural network based on least squares , 2011, 2011 Seventh International Conference on Natural Computation.

[5]  Juan M. Corchado,et al.  Hybrid learning machines , 2009, Neurocomputing.

[6]  Marcin Blachnik,et al.  Evolutionary Optimization of Regression Model Ensembles in Steel-Making Process , 2011, IDEAL.

[7]  Jacek M. Zurada,et al.  Computational intelligence methods for rule-based data understanding , 2004, Proceedings of the IEEE.

[8]  Marcin Blachnik,et al.  Neural Network Committees Optimized with Evolutionary Methods for Steel Temperature Control , 2011, ICCCI.

[9]  Rudy Setiono,et al.  An Approach To Generate Rules From Neural Networks for Regression Problems , 2004, Eur. J. Oper. Res..

[10]  Marcin Blachnik,et al.  A Hybrid System with Regression Trees in Steel-Making Process , 2011, HAIS.

[11]  Emilio Corchado,et al.  Hybrid intelligent algorithms and applications , 2010, Inf. Sci..

[12]  Marcin Blachnik,et al.  A Model for Temperature Prediction of Melted Steel in the Electric Arc Furnace (EAF) , 2010, ICAISC.

[13]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .