Optimization of neural network parameters by Stochastic Fractal Search for dynamic state estimation under communication failure

Abstract A powerful metaheuristic technique is proposed that uses a mathematical concept called Stochastic Fractal Search (SFS) to ensure fast convergence along with accuracy. This paper intends to determine the optimal set of multilayer perceptron neural network (MLP) parameters (weights and thresholds) to improve the performance of MLP by using the SFS technique. The SFS is used because of its effective search in finding the global minima and therefore, it avoids the MLP neural network trapped in local minima. The hybrid approach (MLP-SFS) is applied to solve the dynamic state estimation (DSE) problem at the filtering stage. DSE amalgamates forecasting procedure with measurement data to precisely assess the system state. The approach classifies the process into three stages. In the first stage, a short term hourly load forecasting is applied using support vector machine (STLF-SVM) for time series to forecast the unavailable load data due to communication failure from the previous hourly historical data load. The second stage constitutes an optimal power flow (OPF) that is used to determine the minimum cost generation dispatch to serve the given load and convert the obtained loads, and generations into measurement data. The third stage has a filtering process, which uses SFS technique to optimize the MLP neural network parameters (weights and thresholds) to estimate the system state. The hybrid MLP-SFS is used to find the optimal connection weights and thresholds for the MLP neural network. Following this, a simple backpropagation neural network (BPN) will adjust the final parameters. The approach is tested on IEEE 14-and 118-bus systems using realistic load patterns from the New York Independent System Operator (NYISO) under several scenarios of measurement error and communication failure. The mean absolute percentage error index of the system state (phase and magnitude voltage) is used to determine the accuracy of the approach (MLP-SFS). Results of the proposed approach (MLP-SFS) are compared with non-optimized MLP (random weights and thresholds) and other methods, such as, optimized MLP based on genetic algorithm (MLP-GA) and Particle Swarm Optimization (MLP-PSO) individually. The results indicate that the hybrid (MLP-SFS) increases the precision by about 20%–50% and reduces the computational time around by 30%–50%, which is good for real-time applications, such as, security assessment and contingency evaluation. Details of the models of generation and distribution level are not part of the state estimation in the high voltage transmission problems.

[1]  Victor Sreeram,et al.  A review on phasor measurement units placement for state estimation studies , 2014, 2014 Australasian Universities Power Engineering Conference (AUPEC).

[2]  Chen-Ching Liu,et al.  Intruders in the Grid , 2012, IEEE Power and Energy Magazine.

[3]  Mohammad Valipour,et al.  Use of average data of 181 synoptic stations for estimation of reference crop evapotranspiration by temperature-based methods , 2014, Water Resources Management.

[4]  Avinash Kumar Sinha,et al.  Dynamic state estimator using ANN based bus load prediction , 1999 .

[5]  Mousa Marzband,et al.  Adaptive load shedding scheme for frequency stability enhancement in microgrids , 2016 .

[6]  L. Sander,et al.  Diffusion-limited aggregation , 1983 .

[7]  John Y. Hung,et al.  Denial of service attacks on network-based control systems: impact and mitigation , 2005, IEEE Transactions on Industrial Informatics.

[8]  Andreas Sumper,et al.  Experimental validation of a real time energy management system for microgrids in islanded mode using a local day-ahead electricity market and MINLP , 2013 .

[9]  S. Sitharama Iyengar,et al.  Overview of the Security and Privacy Issues in Smart Grids , 2017 .

[10]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[11]  Panida Jirutitijaroen,et al.  Dynamic State Estimation Under Communication Failure Using Kriging Based Bus Load Forecasting , 2015, IEEE Transactions on Power Systems.

[12]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[13]  Rajeevan Chandel,et al.  Power system dynamic state estimation using prediction based evolutionary technique , 2016 .

[14]  Mousa Marzband,et al.  A real-time evaluation of energy management systems for smart hybrid home Microgrids , 2017 .

[15]  J. Klafter,et al.  Introduction to the Theory of Lévy Flights , 2008 .

[16]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[17]  Kai Mao,et al.  Optimization of Neural Network by Genetic Algorithm for Flowrate Determination in Multipath Ultrasonic Gas Flowmeter , 2016, IEEE Sensors Journal.

[18]  Kevin Jones,et al.  A review of cyber security risk assessment methods for SCADA systems , 2016, Comput. Secur..

[19]  George Atia,et al.  Sparsity-based error detection in DC power flow state estimation , 2016, 2016 IEEE International Conference on Electro Information Technology (EIT).

[20]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[22]  Mehdi Savaghebi,et al.  An Optimal Energy Management System for Islanded Microgrids Based on Multiperiod Artificial Bee Colony Combined With Markov Chain , 2017, IEEE Systems Journal.

[23]  Nicol N. Schraudolph,et al.  Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent , 2002, Neural Computation.

[24]  G. Durga Prasad,et al.  A new approach to dynamic state estimation of power systems , 1998 .

[25]  Wei Sun,et al.  Using a back propagation neural network based on improved particle swarm optimization to study the influential factors of carbon dioxide emissions in Hebei Province, China , 2016 .

[26]  J. Harris,et al.  Trapping of molecular hydrogen at surfaces via translational-rotational energy conversion , 1983 .

[27]  Kai Cao,et al.  A Learning Algorithm of Artificial Neural Network Based on GA - PSO , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[28]  Jin Lin,et al.  Optimal Meter Placement for Distribution Network State Estimation: A Circuit Representation Based MILP Approach , 2016, IEEE Transactions on Power Systems.

[29]  Andreas Sumper,et al.  Experimental Validation of a Real-Time Energy Management System Using Multi-Period Gravitational Search Algorithm for Microgrids in Islanded Mode , 2014 .

[30]  Mousa Marzband,et al.  Non-cooperative game theory based energy management systems for energy district in the retail market considering DER uncertainties , 2016 .

[31]  Minyue Fu,et al.  Optimal PMU placement for power system state estimation with random component outages , 2013 .

[32]  Mehdi Savaghebi,et al.  Distributed Smart Decision-Making for a Multimicrogrid System Based on a Hierarchical Interactive Architecture , 2016, IEEE Transactions on Energy Conversion.

[33]  Osama A. Mohammed,et al.  Detection of magnetic body using artificial neural network with modified simulated annealing , 1994 .

[34]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[35]  M. Valipour Optimization of neural networks for precipitation analysis in a humid region to detect drought and wet year alarms , 2016 .

[36]  Mousa Marzband,et al.  Optimal energy management for stand‐alone microgrids based on multi‐period imperialist competition algorithm considering uncertainties: experimental validation , 2016 .

[37]  T. Vigneswaran,et al.  Primal dual interior point algorithm for constrained economic load dispatch and optimal power flow , 2013, 2013 International Conference on Power, Energy and Control (ICPEC).

[38]  Nathaniel C. Bantayan,et al.  Using Genetic Algorithm Neural Network on Near Infrared Spectral Data for Ripeness Grading of Oil Palm (Elaeis guineensis Jacq.) Fresh Fruit , 2016 .

[39]  Andreas Sumper,et al.  Experimental evaluation of a real time energy management system for stand-alone microgrids in day-ahead markets , 2013 .

[40]  Venkata Dinavahi,et al.  Extended Kalman filter-based parallel dynamic state estimation , 2015, 2016 IEEE Power and Energy Society General Meeting (PESGM).

[41]  Philip K. Rawlings Modes of a Gaussian Random Walk , 2003 .

[42]  Gustavo Valverde,et al.  Unscented kalman filter for power system dynamic state estimation , 2011 .

[43]  Shyh-Jier Huang,et al.  Application of sliding surface-enhanced fuzzy control for dynamic state estimation of a power system , 2003 .

[44]  Greg Welch,et al.  A Two-Stage Kalman Filter Approach for Robust and Real-Time Power System State Estimation , 2014, IEEE Transactions on Sustainable Energy.

[45]  Hamid Salimi,et al.  Stochastic Fractal Search: A powerful metaheuristic algorithm , 2015, Knowl. Based Syst..

[46]  Chii-Wann Lin,et al.  Partial least-squares algorithm for weights initialization of backpropagation network , 2003, Neurocomputing.

[47]  Mohammad Valipour,et al.  Modelling Evapotranspiration to Increase the Accuracy of the Estimations Based on the Climatic Parameters , 2016, Water Conservation Science and Engineering.

[48]  S. Sitharama Iyengar,et al.  Smart Grids: Security and Privacy Issues , 2016 .

[49]  Andreas Sumper,et al.  Real time experimental implementation of optimum energy management system in standalone Microgrid by using multi-layer ant colony optimization , 2016 .

[50]  Yan Liu,et al.  Weight Initialization of Feedforward Neural Networks by Means of Partial Least Squares , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[51]  Shyh-Jier Huang,et al.  Application of a Robust Algorithm for Dynamic State Estimation of a Power System , 2002 .

[52]  Xingyu Wang,et al.  Decentralized unscented Kalman filter based on a consensus algorithm for multi-area dynamic state estimation in power systems , 2015 .

[53]  J.C.S. de Souza,et al.  Forecasting-Aided State Estimation—Part I: Panorama , 2009 .

[54]  Thomas Reindl,et al.  Spatial Load Forecasting With Communication Failure Using Time-Forward Kriging , 2014, IEEE Transactions on Power Systems.

[55]  Andrew J. Meade,et al.  An Initialization Method for Feedforward Artificial Neural Networks Using Polynomial Bases , 2011, Adv. Data Sci. Adapt. Anal..

[56]  M. Valipour,et al.  Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir , 2013 .

[57]  Daniel S. Kirschen,et al.  Assessing the effect of failures in the information and communication infrastructure on power system reliability , 2011, 2011 IEEE/PES Power Systems Conference and Exposition.