Integrating Simulated Annealing and Delta Technique for Constructing Optimal Prediction Intervals

This paper aims at developing a new criterion for quantitative assessment of prediction intervals. The proposed criterion is developed based on both key measures related to quality of prediction intervals: length and coverage probability. This criterion is applied as a cost function for optimizing prediction intervals constructed using delta technique for neural network model. Optimization seeks out to minimize length of prediction intervals without compromising their coverage probability. Simulated Annealing method is employed for readjusting neural network parameters for minimization of the new cost function. To further ameliorate search efficiency of the optimization method, parameters of the network trained using weight decay method are considered as the initial set in Simulated Annealing algorithm. Implementation of the proposed method for a real world case study shows length and coverage probability of constructed prediction intervals are better than those constructed using traditional techniques.

[1]  Jay Lee,et al.  Feature signature prediction of a boring process using neural network modeling with confidence bounds , 2006 .

[2]  R. D. Veaux,et al.  Prediction intervals for neural networks via nonlinear regression , 1998 .

[3]  S. Roberts,et al.  Confidence Intervals and Prediction Intervals for Feed-Forward Neural Networks , 2001 .

[4]  Tao Lu,et al.  Prediction of indoor temperature and relative humidity using neural network models: model comparison , 2009, Neural Computing and Applications.

[5]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[6]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[7]  Luren Yang,et al.  An Evaluation of Confidence Bound Estimation Methods for Neural Networks , 2002, Advances in Computational Intelligence and Learning.

[8]  Saeid Nahavandi,et al.  Estimating performance indexes of a baggage handling system using metamodels , 2009, 2009 IEEE International Conference on Industrial Technology.

[9]  Alan F. Murray,et al.  Confidence estimation methods for neural networks : a practical comparison , 2001, ESANN.

[10]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[11]  Thong Ngee Goh,et al.  Neural network modeling with confidence bounds: a case study on the solder paste deposition process , 2001 .

[12]  Saeid Nahavandi,et al.  Constructing prediction intervals for neural network metamodels of complex systems , 2009, 2009 International Joint Conference on Neural Networks.

[13]  William L. Goffe,et al.  SIMANN: FORTRAN module to perform Global Optimization of Statistical Functions with Simulated Annealing , 1992 .

[14]  J. T. Hwang,et al.  Prediction Intervals for Artificial Neural Networks , 1997 .

[15]  Ana E. Sipols,et al.  A time series bootstrap procedure for interpolation intervals , 2008, Comput. Stat. Data Anal..