An interval type-2 fuzzy logic system-based method for prediction interval construction

Graphical abstractDisplay Omitted HighlightsQuantification of uncertainties using prediction intervals.Interval type-2 fuzzy logic system-based prediction intervals.Training of interval type-2 fuzzy logic systems using a prediction interval-based cost function.Constructing quality prediction intervals. This paper introduces a new non-parametric method for uncertainty quantification through construction of prediction intervals (PIs). The method takes the left and right end points of the type-reduced set of an interval type-2 fuzzy logic system (IT2FLS) model as the lower and upper bounds of a PI. No assumption is made in regard to the data distribution, behaviour, and patterns when developing intervals. A training method is proposed to link the confidence level (CL) concept of PIs to the intervals generated by IT2FLS models. The new PI-based training algorithm not only ensures that PIs constructed using IT2FLS models satisfy the CL requirements, but also reduces widths of PIs and generates practically informative PIs. Proper adjustment of parameters of IT2FLSs is performed through the minimization of a PI-based objective function. A metaheuristic method is applied for minimization of the non-linear non-differentiable cost function. Performance of the proposed method is examined for seven synthetic and real world benchmark case studies with homogenous and heterogeneous noise. The demonstrated results indicate that the proposed method is capable of generating high quality PIs. Comparative studies also show that the performance of the proposed method is equal to or better than traditional neural network-based methods for construction of PIs in more than 90% of cases. The superiority is more evident for the case of data with a heterogeneous noise.

[1]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[2]  Saeid Nahavandi,et al.  Effects of type reduction algorithms on forecasting accuracy of IT2FLS models , 2014, Appl. Soft Comput..

[3]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[4]  Saeid Nahavandi,et al.  A genetic algorithm-based method for improving quality of travel time prediction intervals , 2011 .

[5]  Jerry M. Mendel,et al.  Centroid of a type-2 fuzzy set , 2001, Inf. Sci..

[6]  Jerry Mendel,et al.  Type-2 Fuzzy Sets and Systems: An Overview [corrected reprint] , 2007, IEEE Computational Intelligence Magazine.

[7]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Jerry M. Mendel,et al.  Computing With Words for Hierarchical Decision Making Applied to Evaluating a Weapon System , 2010, IEEE Transactions on Fuzzy Systems.

[9]  J. T. Hwang,et al.  Prediction Intervals for Artificial Neural Networks , 1997 .

[10]  Saeid Nahavandi,et al.  A neural network-GARCH-based method for construction of Prediction Intervals , 2013 .

[11]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[12]  Jerry M. Mendel,et al.  Equalization of nonlinear time-varying channels using type-2 fuzzy adaptive filters , 2000, IEEE Trans. Fuzzy Syst..

[13]  Saeid Nahavandi,et al.  Constructing prediction intervals for neural network metamodels of complex systems , 2009, 2009 International Joint Conference on Neural Networks.

[14]  Jerry M. Mendel,et al.  On the Stability of Interval Type-2 TSK Fuzzy Logic Control Systems , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Hani Hagras,et al.  A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots , 2004, IEEE Transactions on Fuzzy Systems.

[16]  Amir F. Atiya,et al.  Comprehensive Review of Neural Network-Based Prediction Intervals and New Advances , 2011, IEEE Transactions on Neural Networks.

[17]  D. Srinivasan,et al.  Interval Type-2 Fuzzy Logic Systems for Load Forecasting: A Comparative Study , 2012, IEEE Transactions on Power Systems.

[18]  Saeid Nahavandi,et al.  Quantifying uncertainties of neural network-based electricity price forecasts , 2013 .

[19]  R. D. Veaux,et al.  Prediction intervals for neural networks via nonlinear regression , 1998 .

[20]  David J. C. MacKay,et al.  The Evidence Framework Applied to Classification Networks , 1992, Neural Computation.

[21]  Saeid Nahavandi,et al.  Prediction interval-based neural network modelling of polystyrene polymerization reactor – A new perspective of data-based modelling , 2014 .

[22]  H. Hagras,et al.  Type-2 FLCs: A New Generation of Fuzzy Controllers , 2007, IEEE Computational Intelligence Magazine.

[23]  Abbas Khosravi,et al.  Particle swarm optimization for construction of neural network-based prediction intervals , 2014, Neurocomputing.

[24]  Saeid Nahavandi,et al.  Short term load forecasting using Interval Type-2 Fuzzy Logic Systems , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[25]  Jerry M. Mendel,et al.  Interval type-2 fuzzy logic systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[26]  Jerry M. Mendel,et al.  Type-2 fuzzy logic systems , 1999, IEEE Trans. Fuzzy Syst..

[27]  Aidong Adam Ding,et al.  Backpropagation of pseudo-errors: neural networks that are adaptive to heterogeneous noise , 2003, IEEE Trans. Neural Networks.

[28]  Dongrui Wu,et al.  Genetic learning and performance evaluation of interval type-2 fuzzy logic controllers , 2006, Eng. Appl. Artif. Intell..

[29]  Jerry M. Mendel,et al.  Type-2 fuzzy sets made simple , 2002, IEEE Trans. Fuzzy Syst..

[30]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[31]  L. A. ZADEH,et al.  The concept of a linguistic variable and its application to approximate reasoning - I , 1975, Inf. Sci..

[32]  Constantino Tsallis,et al.  Optimization by Simulated Annealing: Recent Progress , 1995 .

[33]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[34]  R. John,et al.  Type-2 Fuzzy Logic: A Historical View , 2007, IEEE Computational Intelligence Magazine.

[35]  Saeid Nahavandi,et al.  A prediction interval-based approach to determine optimal structures of neural network metamodels , 2010, Expert Syst. Appl..

[36]  Saeid Nahavandi,et al.  Prediction Intervals to Account for Uncertainties in Travel Time Prediction , 2011, IEEE Transactions on Intelligent Transportation Systems.

[37]  Saeid Nahavandi,et al.  Construction of Optimal Prediction Intervals for Load Forecasting Problems , 2010, IEEE Transactions on Power Systems.

[38]  Jerry M. Mendel,et al.  Uncertainty bounds and their use in the design of interval type-2 fuzzy logic systems , 2002, IEEE Trans. Fuzzy Syst..

[39]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[40]  Jerry M. Mendel,et al.  Interval Type-2 Fuzzy Logic Systems Made Simple , 2006, IEEE Transactions on Fuzzy Systems.

[41]  Jerry M. Mendel,et al.  Type-2 fuzzy sets and systems: an overview , 2007, IEEE Computational Intelligence Magazine.