Intelligent Control of Grid-Connected Microgrids: An Adaptive Critic-Based Approach

This paper presents an adaptive and intelligent power control approach for microgrid systems in the grid-connected operation mode. The proposed critic-based adaptive control system contains a neuro-fuzzy controller and a fuzzy critic agent. The fuzzy critic agent employs a reinforcement learning algorithm based on neuro-dynamic programming. The system feedback is made available to the critic agent's input as the controller's action in the previous state. The evaluation or reinforcement signal produced by the critic agent together with the back-propagation of error is then used for online tuning of the output layer weights of the neuro-fuzzy controller. The proposed controller shows superior results compared with the traditional PI control. The transient response time is significantly reduced, power oscillations are eliminated, and fast convergence is achieved. The simple design and improved dynamic behavior of the proposed controller make it a promising nominee for power control of microgrid systems.

[1]  Jiabing Hu,et al.  Improved Voltage-Vector Sequences on Dead-Beat Predictive Direct Power Control of Reversible Three-Phase Grid-Connected Voltage-Source Converters , 2013, IEEE Transactions on Power Electronics.

[2]  T.C. Green,et al.  Modeling, Analysis and Testing of Autonomous Operation of an Inverter-Based Microgrid , 2007, IEEE Transactions on Power Electronics.

[3]  S. Mishra,et al.  A Seamless Control Methodology for a Grid Connected and Isolated PV-Diesel Microgrid , 2013, IEEE Transactions on Power Systems.

[4]  J. Driesen,et al.  Control of Microgrids , 2007, 2007 IEEE Power Engineering Society General Meeting.

[5]  Soon-Ryul Nam,et al.  Power-Sharing Method of Multiple Distributed Generators Considering Control Modes and Configurations of a Microgrid , 2010, IEEE Transactions on Power Delivery.

[6]  C. von Altrock,et al.  Recent successful fuzzy logic applications in industrial automation , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[7]  P.W. Lehn,et al.  Control and Power Management of Converter Fed Microgrids , 2008, IEEE Transactions on Power Systems.

[8]  Frede Blaabjerg,et al.  Proportionalresonant controllers and filters for gridconnected voltagesource converters , 2006 .

[9]  N.L. Diaz,et al.  Analysis and Design of a Nonlinear Fuzzy Controller Applied to a VSC to Control the Active and Reactive Power Flow , 2007, Electronics, Robotics and Automotive Mechanics Conference (CERMA 2007).

[10]  M.R. Iravani,et al.  Power Management Strategies for a Microgrid With Multiple Distributed Generation Units , 2006, IEEE Transactions on Power Systems.

[11]  Yasser Abdel-Rady I. Mohamed,et al.  Integrating VSCs to Weak Grids by Nonlinear Power Damping Controller With Self-Synchronization Capability , 2014, IEEE Transactions on Power Systems.

[12]  Dehong Xu,et al.  A New Feedback Method for PR Current Control of LCL-Filter-Based Grid-Connected Inverter , 2010, IEEE Transactions on Industrial Electronics.

[13]  S. Bhattacharya,et al.  Vector-Controlled Voltage-Source-Converter-Based Transmission Under Grid Disturbances , 2013, IEEE Transactions on Power Electronics.

[14]  T. C. Green,et al.  State-space model of grid-connected inverters under current control mode , 2007 .

[15]  Robert H. Lasseter,et al.  Microgrids And Distributed Generation , 2007, Intell. Autom. Soft Comput..

[16]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Alfred Rufer,et al.  Decoupled dq-Current Control of Grid-Tied Voltage Source Converters Using Nonparametric Models , 2013, IEEE Transactions on Industrial Electronics.

[18]  Ronnie Belmans,et al.  Distributed generation: definition, benefits and issues , 2005 .

[19]  Guillaume Rami,et al.  Fuzzy logic supervision and control of distributed generators , 2005 .

[20]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[21]  Timothy C. Green,et al.  Control and filter design of three-phase inverters for high power quality grid connection , 2003 .

[22]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[23]  Alan F. Lynch,et al.  Experimental Validation of Nonlinear Control for a Voltage Source Converter , 2009, IEEE Transactions on Control Systems Technology.

[24]  Harold Rene.  Implementation of Inverse Neural Control To VSC Converter for Active and Reactive Power Flow , 2009 .

[25]  Lionel Jouffe,et al.  Fuzzy inference system learning by reinforcement methods , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[26]  Alireza R. Bakhshai,et al.  A synchronous reference frame intelligent structure for power control of distributed generators in a microgrid , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[27]  G. Ramos,et al.  Microgrid central fuzzy controller for active and reactive power flow using instantaneous power measurements , 2011, 2011 IEEE Power and Energy Conference at Illinois.

[28]  Chuan-Kai Lin,et al.  Adaptive critic autopilot design of Bank-to-turn missiles using fuzzy basis function networks , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Rong-Jong Wai,et al.  Design of backstepping power control for grid-side converter of voltage source converter-based high-voltage dc wind power generation system , 2013 .

[30]  Donald Grahame Holmes,et al.  Stationary frame current regulation of PWM inverters with zero steady state error , 1999, 30th Annual IEEE Power Electronics Specialists Conference. Record. (Cat. No.99CH36321).

[31]  Bill Rose,et al.  Microgrids , 2018, Smart Grids.

[32]  Frede Blaabjerg,et al.  Overview of Control and Grid Synchronization for Distributed Power Generation Systems , 2006, IEEE Transactions on Industrial Electronics.

[33]  M. B. Brennen,et al.  Vector analysis and control of advanced static VAr compensators , 1991 .

[34]  N. Hatziargyriou,et al.  Microgrids: an overview of ongoing research, development, anddemonstration projects , 2007 .

[35]  Paul J. Werbos,et al.  New directions in ACDs: keys to intelligent control and understanding the brain , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.