Adaptive critic design based cooperative control for pulsed power loads accommodation in shipboard power system

Since a pulsed power load (PPL) consumes a huge amount of energy within very short period of time, its deployment might cause large disturbances even instability to a power system that has limited generation, small inertia, and small ramp rate. To mitigate the strike during PPL deployment, energy storage system (ESS) is usually installed in shipboard power system (SPS) to serve as the sole power supply for PPL. To realise fast charging of the ESS and minimise disturbance during charging, generation control and charging control of SPS should be well coordinated. For this important but not well-studied problem, this study presents an adaptive critic design based control algorithm for a non-linear model integrating the basic dynamics of synchronous generator and supercapacitor, which is a popular type of ESS for PPL application. Through interactive learning of two neural networks for cost-to-go function approximation and optimal control approximation, respectively, near optimal control can be realised even under disturbance and model impreciseness. The algorithm is tested with both detailed single- and multiple-generator SPS models and tested through both real-time digital and power hardware-in-the-loop simulations. Simulation results demonstrate the effectiveness of the developed model and control algorithm.

[1]  Takis Zourntos,et al.  A Multi-Agent System Framework for Real-Time Electric Load Management in MVAC All-Electric Ship Power Systems , 2015, IEEE Transactions on Power Systems.

[2]  B. Cassimere,et al.  System impact of pulsed power loads on a laboratory scale integrated fight through power (IFTP) system , 2005, IEEE Electric Ship Technologies Symposium, 2005..

[3]  Goran Andersson,et al.  Dynamics and Control of Electric Power Systems , 2007 .

[4]  Derong Liu,et al.  Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown Dynamics , 2014, IEEE Transactions on Automation Science and Engineering.

[5]  Donald C. Wunsch,et al.  A heuristic dynamic programming based power system stabilizer for a turbogenerator in a single machine power system , 2003, 38th IAS Annual Meeting on Conference Record of the Industry Applications Conference, 2003..

[6]  Osama A. Mohammed,et al.  Distributed Flywheel Energy Storage Systems for mitigating the effects of pulsed loads , 2014, 2014 IEEE PES General Meeting | Conference & Exposition.

[7]  Qinmin Yang,et al.  Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems using Online Approximators , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[9]  S. D. Sudhoff Currents of Change , 2011, IEEE Power and Energy Magazine.

[10]  Wei Zhang,et al.  Online Optimal Generation Control Based on Constrained Distributed Gradient Algorithm , 2015, IEEE Transactions on Power Systems.

[11]  J. McGroarty,et al.  Flywheel energy storage system for electric start and an all-electric ship , 2005, IEEE Electric Ship Technologies Symposium, 2005..

[12]  Scott D. Sudhoff,et al.  Reducing Impact of Pulsed Power Loads on Microgrid Power Systems , 2010, IEEE Transactions on Smart Grid.

[13]  R. Hebner,et al.  Coordination of Large Pulsed Loads on Future Electric Ships , 2007, IEEE Transactions on Magnetics.

[14]  Derong Liu,et al.  Model-Free Adaptive Dynamic Programming for Optimal Control of Discrete-Time Ane Nonlinear System , 2014 .

[15]  Derong Liu,et al.  Policy Iteration Algorithm for Online Design of Robust Control for a Class of Continuous-Time Nonlinear Systems , 2014, IEEE Transactions on Automation Science and Engineering.

[16]  Jennie Si,et al.  Online learning control by association and reinforcement , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[17]  Osama Mohammed,et al.  Pulse-load effects on ship power system stability , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[18]  M. Andrus,et al.  Investigating the Impact of Pulsed Power Charging Demands on Shipboard Power Quality , 2007, 2007 IEEE Electric Ship Technologies Symposium.

[19]  S.D. Sudhoff,et al.  A Medium Voltage DC Testbed for ship power system research , 2009, 2009 IEEE Electric Ship Technologies Symposium.

[20]  F. Scuiller,et al.  Study of a supercapacitor Energy Storage System designed to reduce frequency modulation on shipboard electric power system , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[21]  A. Keyhani,et al.  Control of distributed generation systems-Part I: Voltages and currents control , 2004, IEEE Transactions on Power Electronics.

[22]  F Scuiller,et al.  Simulation of an energy storage system to compensate pulsed loads on shipboard electric power system , 2011, 2011 IEEE Electric Ship Technologies Symposium.

[23]  Osama A. Mohammed,et al.  Real-Time Energy Management Algorithm for Mitigation of Pulse Loads in Hybrid Microgrids , 2012, IEEE Transactions on Smart Grid.

[24]  S. Santoso,et al.  Impact of pulse loads on electric ship power system: With and without flywheel energy storage systems , 2009, 2009 IEEE Electric Ship Technologies Symposium.

[25]  C. S. Edrington,et al.  A novel inductive-capacitive pulse forming circuit for pulse power load applications , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[26]  J.J.A. van der Burgt,et al.  Pulsed power requirements for future naval ships , 1999, Digest of Technical Papers. 12th IEEE International Pulsed Power Conference. (Cat. No.99CH36358).

[27]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.