Prediction Interval Construction and Optimization for Adaptive Neurofuzzy Inference Systems

The performance of an adaptive neurofuzzy inference system (ANFIS) significantly drops when uncertainty exists in the data or system operation. Prediction intervals (PIs) can quantify the uncertainty associated with ANFIS point predictions. This paper first presents a methodology to adapt the delta technique for the construction of PIs for outcomes of the ANFIS models. As the ANFIS models are linear in their consequent part, the ANFIS-based PIs are computationally less expensive than neural network (NN)-based PIs. Second, this paper proposes a method to optimize ANFIS-based PIs. A new PI-based cost function is developed for the training of the ANFIS models. A simulated annealing-based algorithm is applied to minimize the new nonlinear cost function and adjust the premise and consequent parameters of the ANFIS model. Using three real-world case studies, it is shown that ANFIS-based PIs are computationally less expensive than NN-based PIs. The application of the proposed optimization algorithm leads to better quality PIs than optimized NN-based PIs.

[1]  Saeid Nahavandi,et al.  Constructing prediction intervals for neural network metamodels of complex systems , 2009, 2009 International Joint Conference on Neural Networks.

[2]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[3]  Tommy W. S. Chow,et al.  Self-Organizing and Self-Evolving Neurons: A New Neural Network for Optimization , 2007, IEEE Transactions on Neural Networks.

[4]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[5]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[6]  David J. C. MacKay,et al.  The Evidence Framework Applied to Classification Networks , 1992, Neural Computation.

[7]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[8]  Tom Heskes,et al.  Practical Confidence and Prediction Intervals , 1996, NIPS.

[9]  A. Weigend,et al.  Estimating the mean and variance of the target probability distribution , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[10]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[11]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[12]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[13]  José Manuel Benítez,et al.  On the Identifiability of TSK Additive Fuzzy Rule-Based Models , 2006, SMPS.

[14]  Shinn-Ying Ho,et al.  Optimizing fuzzy neural networks for tuning PID controllers using an orthogonal simulated annealing algorithm OSA , 2006, IEEE Transactions on Fuzzy Systems.

[15]  M. Moonen,et al.  On- and off-line identification of linear state-space models , 1989 .

[16]  J. Maciejowski,et al.  System identification using balanced parametrizations , 1997, IEEE Trans. Autom. Control..

[17]  Saeid Nahavandi,et al.  A prediction interval-based approach to determine optimal structures of neural network metamodels , 2010, Expert Syst. Appl..

[18]  Saeid Nahavandi,et al.  Construction of Optimal Prediction Intervals for Load Forecasting Problems , 2010, IEEE Transactions on Power Systems.

[19]  R. D. Veaux,et al.  Prediction intervals for neural networks via nonlinear regression , 1998 .

[20]  J. T. Hwang,et al.  Prediction Intervals for Artificial Neural Networks , 1997 .