Uncertainty Quantification Neural Network from Similarity and Sensitivity

Uncertainty quantification (UQ) from similar events brings transparency. However, the presence of an irrelevant event may degrade the performance of similarity-based algorithms. This paper presents a UQ technique from similarity and sensitivity. A traditional neural network (NN) for the point prediction is trained at first to obtain the sensitivity of different input parameters at different points. The relative range of each input parameter is set based on sensitivity. When the sensitivity of one parameter is very high, a small deviation in that parameter may result in a large deviation in output. While selecting similar events, we allow a small deviation in highly sensitive parameters and a large deviation in less sensitive parameters. Uncertainty bounds are computed based on similar events. Similar events contain exact matches and slightly different samples. Therefore, we train a NN for bound correction. The bound-corrected uncertainty bounds (UB) provide a fair and domain-independent uncertainty bound. Finally, we train NNs to compute UB directly. The end-user need to run the final NN to obtain UB, instead of following the entire process. The code of the proposed method is also uploaded to Github. Also, users need to run only the fifth script to train a NN of a different UB.

[1]  Yarin Gal,et al.  Uncertainty in Deep Learning , 2016 .

[2]  Saeid Nahavandi,et al.  Integration of Ensemble and Evolutionary Machine Learning Algorithms for Monitoring Diver Behavior Using Physiological Signals , 2019, IEEE Access.

[3]  Saeid Nahavandi,et al.  Partial Adversarial Training for Neural Network-Based Uncertainty Quantification , 2021, IEEE Transactions on Emerging Topics in Computational Intelligence.

[4]  Pavan Kumar,et al.  On Optimizing Neutrosophic Complex Programming Using Lexicographic Order , 2020 .

[5]  Charles Blundell,et al.  Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , 2016, NIPS.

[6]  Yonggang Wu,et al.  An Advanced Approach for Construction of Optimal Wind Power Prediction Intervals , 2015, IEEE Transactions on Power Systems.

[7]  Andrew T. Foerster,et al.  Uncertainty and Fiscal Cliffs , 2014, Journal of Money, Credit and Banking.

[8]  Saeid Nahavandi,et al.  Prediction interval with examples of similar pattern and prediction strength , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[9]  Suiyang Khoo,et al.  A Linear Time-Varying Model Predictive Control-Based Motion Cueing Algorithm for Hexapod Simulation-Based Motion Platform , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Felipe Valencia,et al.  Prediction interval based on type-2 fuzzy systems for wind power generation and loads in microgrid control design , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[11]  Saeid Nahavandi,et al.  Neural Network-Based Uncertainty Quantification: A Survey of Methodologies and Applications , 2018, IEEE Access.

[12]  Saeid Nahavandi,et al.  Openga, a C++ genetic algorithm library , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[13]  Saeid Nahavandi,et al.  Optimal Uncertainty-guided Neural Network Training , 2019, Appl. Soft Comput..

[14]  Marios M. Polycarpou,et al.  Neural network-based construction of online prediction intervals , 2019, Neural Computing and Applications.

[15]  Héctor Allende,et al.  Probabilistic Forecasting Using Monte Carlo Dropout Neural Networks , 2019, CIARP.

[16]  Qiguang Miao,et al.  A Construction Approach to Prediction Intervals Based on Bootstrap and Deep Belief Network , 2019, IEEE Access.

[17]  Abbas Khosravi,et al.  Integration of renewable generation uncertainties into stochastic unit commitment considering reserve and risk: A comparative study , 2016 .

[18]  Antorweep Chakravorty,et al.  Household Power Demand Prediction Using Evolutionary Ensemble Neural Network Pool with Multiple Network Structures , 2019, Sensors.

[19]  Pericle Zanchetta,et al.  A Distributed Model Predictive Control Strategy for Back-to-Back Converters , 2016, IEEE Transactions on Industrial Electronics.

[20]  Shady M. K. Mohamed,et al.  Semicircular canal modeling in human perception , 2017, Reviews in the neurosciences.

[21]  Saeid Nahavandi,et al.  High-Fidelity Hexarot Simulation-Based Motion Platform Using Fuzzy Incremental Controller and Model Predictive Control-Based Motion Cueing Algorithm , 2020, IEEE Systems Journal.

[22]  Mohamed Salem Nashwan,et al.  Uncertainty in Estimated Trends Using Gridded Rainfall Data: A Case Study of Bangladesh , 2019, Water.

[23]  Pericle Zanchetta,et al.  A Distributed Model Predictive Control Strategy for Back-toBack Converters , 2022 .

[24]  Doris Sáez,et al.  Prediction Intervals With LSTM Networks Trained By Joint Supervision , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[25]  Xingqi Zhang,et al.  Uncertainty Quantification of Radio Propagation Models Using Artificial Neural Networks , 2019, 2019 IEEE International Symposium on Antennas and Propagation and USNC-URSI Radio Science Meeting.

[26]  Mohamed Zaki,et al.  High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach , 2018, ICML.

[27]  Junwei Lu,et al.  Applicability of load forecasting techniques for customer energy storage control systems , 2015, 2015 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[28]  Mark J. F. Gales,et al.  Predictive Uncertainty Estimation via Prior Networks , 2018, NeurIPS.

[29]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[30]  Chee Peng Lim,et al.  A genetic algorithm–based nonlinear scaling method for optimal motion cueing algorithm in driving simulator , 2018, J. Syst. Control. Eng..