Generalized Reinforcement Learning Fuzzy Control with Vague States

This paper presents a generalized method for tuning a fuzzy logic controller based on reinforcement learning in a dynamic environment. We extend the Generalized Approximate Reasoning-base Intelligent Controller (GARIC) model of Berenji and Khedkar to be able to work in presence of vagueness in states. Similar to GARIC, the proposed architecture, i.e., Generalized Reinforcement Learning Fuzzy Controller (GRLFC), has the self-tuning capability even when only a weak reinforcement signal such a binary failure signal is available. The proposed controller shows a better performance, regarding learning speed and robustness to changes in controlled system dynamics, than similar models even in the presence of uncertainty in states.

[1]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[2]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3]  Cheng-Jian Lin,et al.  A novel genetic reinforcement learning for nonlinear fuzzy control problems , 2006, Neurocomputing.

[4]  Hung-Yuan Chung,et al.  A self-learning fuzzy logic controller using genetic algorithms with reinforcements , 1997, IEEE Trans. Fuzzy Syst..

[5]  L. Jouffe,et al.  Actor-critic learning based on fuzzy inference system , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[6]  C. S. George Lee,et al.  Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems , 1994, IEEE Trans. Fuzzy Syst..

[7]  Hamid R. Berenji,et al.  Using fuzzy logic for performance evaluation in reinforcement learning , 1998, Int. J. Approx. Reason..