Improving weighted information criterion by using optimization

Although artificial neural networks (ANN) have been widely used in forecasting time series, the determination of the best model is still a problem that has been studied a lot. Various approaches available in the literature have been proposed in order to select the best model for forecasting in ANN in recent years. One of these approaches is to use a model selection strategy based on the weighted information criterion (WIC). WIC is calculated by summing weighted different selection criteria which measure the forecasting accuracy of an ANN model in different ways. In the calculation of WIC, the weights of different selection criteria are determined heuristically. In this study, these weights are calculated by using optimization in order to obtain a more consistent criterion. Four real time series are analyzed in order to show the efficiency of the improved WIC. When the weights are determined based on the optimization, it is obviously seen that the improved WIC produces better results.

[2]  Julian Morris,et al.  A procedure for determining the topology of multilayer feedforward neural networks , 1994, Neural Networks.

[3]  Çagdas Hakan Aladag,et al.  A new model selection strategy in artificial neural networks , 2008, Appl. Math. Comput..

[4]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[5]  R.J.F. Dow,et al.  Neural net pruning-why and how , 1988, IEEE 1988 International Conference on Neural Networks.

[6]  Martin P. DeSimio,et al.  MLP iterative construction algorithm , 1997, Defense, Security, and Sensing.

[7]  Shun-ichi Amari,et al.  Network information criterion-determining the number of hidden units for an artificial neural network model , 1994, IEEE Trans. Neural Networks.

[8]  Somnath Mukhopadhyay,et al.  A polynomial time algorithm for the construction and training of a class of multilayer perceptrons , 1993, Neural Networks.

[9]  F. L. Xiong,et al.  A method for estimating the number of hidden neurons in feed-forward neural networks based on information entropy , 2003 .

[10]  Jun Zeng,et al.  Artificial neural network model for identifying taxi gross emitter from remote sensing data of vehicle emission. , 2007, Journal of environmental sciences.

[11]  Jukka Saarinen,et al.  Evaluation of constructive neural networks with cascaded architectures , 2002, Neurocomputing.

[12]  Sandrine Dudoit,et al.  A deletion/substitution/addition algorithm for classification neural networks, with applications to biomedical data , 2008 .

[13]  Nejib Smaoui,et al.  The Box-Jenkins analysis and neural networks: prediction and time series modelling , 2003 .

[14]  Deoki N. Saraf,et al.  Design of neural networks using genetic algorithm for on-line property estimation of crude fractionator products , 2006, Comput. Chem. Eng..