Prediction interval methodology based on fuzzy numbers and its extension to fuzzy systems and neural networks

Prediction interval modelling has been proposed in the literature to characterize uncertain phenomena and provide useful information from a decision-making point of view. In most of the reported studies, assumptions about the data distribution are made and/or the models are trained at one step ahead, which can decrease the quality of the interval in terms of the information about the uncertainty modelled for a higher prediction horizon. In this paper, a new prediction interval modelling methodology based on fuzzy numbers is proposed to solve the abovementioned drawbacks. Fuzzy and neural network prediction interval models are developed based on this proposed methodology by minimizing a novel criterion that includes the coverage probability and normalized average width. The fuzzy number concept is considered because the affine combination of fuzzy numbers generates, by definition, prediction intervals that can handle uncertainty without requiring assumptions about the data distribution. The developed models are compared with a covariance-based prediction interval method, and high-quality intervals are obtained, as determined by the narrower interval width of the proposed method. Additionally, the proposed prediction intervals are tested by forecasting up to two days ahead of the load of the Huatacondo microgrid in the north of Chile and the consumption of the residential dwellings in the town of Loughborough, UK. The results show that the proposed models are suitable alternatives to electrical consumption forecasting because they obtain the minimum interval widths that characterize the uncertainty of this type of stochastic process. Furthermore, the information provided by the obtained prediction interval could be used to develop robust energy management systems that, for example, consider the worst-case scenario.

[1]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Yan-Lin He,et al.  An improved multi-kernel RVM integrated with CEEMD for high-quality intervals prediction construction and its intelligent modeling application , 2017 .

[3]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[4]  Mahdi Bashiri,et al.  A goal programming-TOPSIS approach to multiple response optimization using the concepts of non-dominated solutions and prediction intervals , 2011, Expert Syst. Appl..

[5]  Saeid Nahavandi,et al.  A prediction interval-based approach to determine optimal structures of neural network metamodels , 2010, Expert Syst. Appl..

[6]  Saeid Nahavandi,et al.  Closure to the Discussion of “Prediction Intervals for Short-Term Wind Farm Generation Forecasts” and “Combined Nonparametric Prediction Intervals for Wind Power Generation” and the Discussion of “Combined Nonparametric Prediction Intervals for Wind Power Generation” , 2014 .

[7]  Yulei Rao,et al.  A deep learning framework for financial time series using stacked autoencoders and long-short term memory , 2017, PloS one.

[8]  Igor Škrjanc,et al.  Fuzzy confidence interval for pH titration curve , 2011 .

[9]  Linan Zhang,et al.  Short-term travel time prediction by deep learning: A comparison of different LSTM-DNN models , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[10]  Saeid Nahavandi,et al.  Neural Network-Based Uncertainty Quantification: A Survey of Methodologies and Applications , 2018, IEEE Access.

[11]  Arash Ghanbari,et al.  Comparison of Artificial Intelligence Based Techniques for Short Term Load Forecasting , 2010, 2010 Third International Conference on Business Intelligence and Financial Engineering.

[12]  D. Saez,et al.  Cluster optimization for Takagi & Sugeno fuzzy models and its application to a combined cycle power plant boiler , 2004, Proceedings of the 2004 American Control Conference.

[13]  Bijaya K. Panigrahi,et al.  Prediction Interval Estimation of Electricity Prices Using PSO-Tuned Support Vector Machines , 2015, IEEE Transactions on Industrial Informatics.

[14]  Massimo Melucci,et al.  Relevance Feedback Algorithms Inspired By Quantum Detection , 2016, IEEE Transactions on Knowledge and Data Engineering.

[15]  Felipe Valencia,et al.  Robust Energy Management System Based on Interval Fuzzy Models , 2016, IEEE Transactions on Control Systems Technology.

[16]  Tom Heskes,et al.  Practical Confidence and Prediction Intervals , 1996, NIPS.

[17]  Nikolay Laptev,et al.  Deep and Confident Prediction for Time Series at Uber , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[18]  Kit Po Wong,et al.  Discussion of “Combined Nonparametric Prediction Intervals for Wind Power Generation” , 2014 .

[19]  Saeid Nahavandi,et al.  Prediction Interval Construction and Optimization for Adaptive Neurofuzzy Inference Systems , 2011, IEEE Transactions on Fuzzy Systems.

[20]  S. Roberts,et al.  Confidence Intervals and Prediction Intervals for Feed-Forward Neural Networks , 2001 .

[21]  Menglin Zhang,et al.  A Novel Multi-Objective Optimal Approach for Wind Power Interval Prediction , 2017 .

[22]  Felipe Valencia,et al.  Robust Energy Management System for a Microgrid Based on a Fuzzy Prediction Interval Model , 2016, IEEE Transactions on Smart Grid.

[23]  D. Srinivasan,et al.  Interval Type-2 Fuzzy Logic Systems for Load Forecasting: A Comparative Study , 2012, IEEE Transactions on Power Systems.

[24]  J. Mendel,et al.  Parametric design of stable type-2 TSK fuzzy systems , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[25]  Claudio A. Cañizares,et al.  Robust Energy Management of Isolated Microgrids , 2019, IEEE Systems Journal.

[26]  Chen Jie,et al.  Wind speed forecasting using nonlinear-learning ensemble of deep learning time series prediction and extremal optimization , 2018, Energy Conversion and Management.

[27]  Zhijian Wu,et al.  A new approach based on enhanced PSO with neighborhood search for data clustering , 2013, 2013 International Conference on Soft Computing and Pattern Recognition (SoCPaR).

[28]  A. C. Rencher Linear models in statistics , 1999 .

[29]  Saeid Nahavandi,et al.  Load Forecasting Using Interval Type-2 Fuzzy Logic Systems: Optimal Type Reduction , 2014, IEEE Transactions on Industrial Informatics.

[30]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[31]  Min Qi,et al.  Pricing and hedging derivative securities with neural networks: Bayesian regularization, early stopping, and bagging , 2001, IEEE Trans. Neural Networks.

[32]  Tien-Cuong Bui,et al.  A Deep Learning Approach for Forecasting Air Pollution in South Korea Using LSTM , 2018, 1804.07891.

[33]  S. Nahavandi,et al.  Prediction Intervals for Short-Term Wind Farm Power Generation Forecasts , 2013, IEEE Transactions on Sustainable Energy.

[34]  Andreas Kroll,et al.  Benchmark problems for nonlinear system identification and control using Soft Computing methods: Need and overview , 2014, Appl. Soft Comput..

[35]  Omolbanin Yazdanbakhsh,et al.  A systematic review of complex fuzzy sets and logic , 2017, Fuzzy Sets Syst..

[36]  Omolbanin Yazdanbakhsh,et al.  Forecasting of Multivariate Time Series via Complex Fuzzy Logic , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[38]  Scott Dick,et al.  ANCFIS: A Neurofuzzy Architecture Employing Complex Fuzzy Sets , 2011, IEEE Transactions on Fuzzy Systems.

[39]  Pierre Pinson,et al.  Discussion of “Prediction Intervals for Short-Term Wind Farm Generation Forecasts” and “Combined Nonparametric Prediction Intervals for Wind Power Generation” , 2014 .

[40]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[41]  S. Jafarzadeh,et al.  Solar Power Prediction Using Interval Type-2 TSK Modeling , 2013, IEEE Transactions on Sustainable Energy.

[42]  Tao Zhang,et al.  Interval prediction of solar power using an Improved Bootstrap method , 2018 .

[43]  Donald E. Grierson,et al.  Comparison among five evolutionary-based optimization algorithms , 2005, Adv. Eng. Informatics.

[44]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Appendix , 2015, 1506.02157.

[45]  Saeid Nahavandi,et al.  Combined Nonparametric Prediction Intervals for Wind Power Generation , 2013, IEEE Transactions on Sustainable Energy.

[46]  Igor Skrjanc,et al.  Interval Fuzzy Model Identification Using$l_infty$-Norm , 2005, IEEE Transactions on Fuzzy Systems.

[47]  Claudio A. Cañizares,et al.  Fuzzy Prediction Interval Models for Forecasting Renewable Resources and Loads in Microgrids , 2015, IEEE Transactions on Smart Grid.

[48]  Enrico Zio,et al.  NSGA-II-trained neural network approach to the estimation of prediction intervals of scale deposition rate in oil & gas equipment , 2013, Expert Syst. Appl..

[49]  Chunshien Li,et al.  Complex Neurofuzzy ARIMA Forecasting—A New Approach Using Complex Fuzzy Sets , 2013, IEEE Transactions on Fuzzy Systems.

[50]  Bijaya Ketan Panigrahi,et al.  A multiobjective framework for wind speed prediction interval forecasts , 2016 .

[51]  Jerry M. Mendel,et al.  Interval type-2 fuzzy logic systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[52]  Suqin Wang,et al.  Prediction Intervals for Short-Term Photovoltaic Generation Forecasts , 2015, 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC).

[53]  Saeid Nahavandi,et al.  An interval type-2 fuzzy logic system-based method for prediction interval construction , 2014, Appl. Soft Comput..

[54]  Jakub Safarik,et al.  Comparison of artificial intelligence classifiers for SIP attack data , 2016, SPIE Defense + Security.

[55]  Rodrigo Palma-Behnke,et al.  A Microgrid Energy Management System Based on the Rolling Horizon Strategy , 2013, IEEE Transactions on Smart Grid.

[56]  Kwang Hyung Lee,et al.  First Course on Fuzzy Theory and Applications , 2005, Advances in Soft Computing.

[57]  Alfredo Núñez,et al.  Prediction Interval Modeling Tuned by an Improved Teaching Learning Algorithm Applied to Load Forecasting in Microgrids , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[58]  Jianhui Wang,et al.  Interval Deep Generative Neural Network for Wind Speed Forecasting , 2019, IEEE Transactions on Smart Grid.

[59]  Jerry M. Mendel,et al.  Operations on type-2 fuzzy sets , 2001, Fuzzy Sets Syst..

[60]  Felipe Valencia,et al.  Prediction interval based on type-2 fuzzy systems for wind power generation and loads in microgrid control design , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[61]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[62]  G. Notton,et al.  Prediction intervals for global solar irradiation forecasting using regression trees methods , 2018, Renewable Energy.

[63]  Francisco C. Pereira,et al.  Combining time-series and textual data for taxi demand prediction in event areas: a deep learning approach , 2018, Inf. Fusion.

[64]  Amir F. Atiya,et al.  Comprehensive Review of Neural Network-Based Prediction Intervals and New Advances , 2011, IEEE Transactions on Neural Networks.

[65]  Omolbanin Yazdanbakhsh,et al.  Predicting solar power output using complex fuzzy logic , 2013, 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS).

[66]  Hossein Lotfi,et al.  State of the Art in Research on Microgrids: A Review , 2015, IEEE Access.

[67]  Junyong Liu,et al.  Robust Energy Management of Microgrid With Uncertain Renewable Generation and Load , 2016, IEEE Transactions on Smart Grid.