An approach for revising a fuzzy logic controller using Q-learning algorithm

The use of renewable energies along with the unexpected changes in load and the intermittence in power transmission lines may cause a voltage drop in a stand-alone system and challenge the reliability of the system. One way to indemnify the changing nature of renewable energies in the short term without the need to disconnect loads or turn on other plants is the energy storage. This paper proposes an improvement of a fuzzy logic controller adopted to manage the energy in a stand-alone renewable energy system using the Q-learning algorithm. All the fuzzy rules generated by the controller were based on expert knowledge which means that they are obtained on the basis of observations by human operators. Modified fuzzy rules using the Q-learning algorithm are proposed to incorporate the reinforcement and therefore, present an optimal method for charge and discharge the storage devices which are the batteries.

[1]  Michael I. Jordan,et al.  MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES , 1996 .

[2]  Ali Yahyaouy,et al.  Implementing a Fuzzy Logic Based Algorithm to Predict Solar and Wind Energies in a Hybrid Renewable Energy System , 2015, Int. J. Fuzzy Syst. Appl..

[3]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.

[4]  Ali Yahyaouy,et al.  Energy management in a hybrid PV/wind/battery system using a type-1 fuzzy logic computer algorithm , 2016, Int. J. Intell. Eng. Informatics.

[5]  Reza Tavakkoli-Moghaddam,et al.  Designing a fuzzy Q-learning multi-agent quality control system for a continuous chemical production line - A case study , 2016, Comput. Ind. Eng..

[6]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[7]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[8]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[9]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[10]  Hung-Yuan Chung,et al.  A self-learning fuzzy logic controller using genetic algorithms with reinforcements , 1997, IEEE Trans. Fuzzy Syst..

[11]  A. Kaufmann Introduction à la logique floue , 1992, Mathématiques.

[12]  Ju-Jang Lee,et al.  Self-Learning Fuzzy Logic Controller using Q-Learning , 2000, J. Adv. Comput. Intell. Intell. Informatics.

[13]  Hyo-Sung Ahn,et al.  Fault detection and isolation for a small CMG-based satellite: A fuzzy Q-learning approach , 2015 .

[14]  Grzegorz Głowaty ENHANCEMENTS OF FUZZY Q-LEARNING ALGORITHM , 2005 .

[15]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[16]  Guoqing Xu,et al.  An Online Learning Control Strategy for Hybrid Electric Vehicle Based on Fuzzy Q-Learning , 2015 .

[17]  Shahaboddin Shamshirband,et al.  Cooperative game theoretic approach using fuzzy Q-learning for detecting and preventing intrusions in wireless sensor networks , 2014, Eng. Appl. Artif. Intell..

[18]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[19]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.