Fuzzy genetic Network Programming with Reinforcement Learning for mobile robot navigation

This paper proposes Fuzzy Genetic Network Programming with Reinforcement Learning (Fuzzy GNP-RL). This method integrates fuzzy logic to the conventional GNP-RL. The new part of the proposed method is fuzzy judgment nodes. Fuzzy GNP-RL provides flexibility to determine the appropriate next node by the probabilistic transition instead of that by the threshold values on GNP-RL. The simulation of the wall following behavior of a Khepera robot is used to evaluate the performance of Fuzzy GNP-RL compared with that of GNP-RL. The result shows that Fuzzy GNP-RL is more robust than GNP-RL.

[1]  Shingo Mabu,et al.  A genetic network programming with learning approach for enhanced stock trading model , 2009, Expert Syst. Appl..

[3]  Frank Hoffmann,et al.  Evolutionary algorithms for fuzzy control system design , 2001, Proc. IEEE.

[4]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[5]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[7]  Shingo Mabu,et al.  Genetic Network Programming with Reinforcement Learning and Its Application to Making Mobile Robot Behavior , 2006 .

[8]  Meng Joo Er,et al.  An Evolutionary Approach Toward Dynamic Self-Generated Fuzzy Inference Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Shingo Mabu,et al.  Genetic Network Programming with Rule Accumulation and its Application to Tile-World Problem , 2009, J. Adv. Comput. Intell. Intell. Informatics.

[10]  Kotaro Hirasawa,et al.  A Double-Deck Elevator Group Supervisory Control System Using Genetic Network Programming , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Michael L. Littman,et al.  A tutorial on partially observable Markov decision processes , 2009 .

[14]  Shingo Mabu,et al.  A Graph-Based Evolutionary Algorithm: Genetic Network Programming (GNP) and Its Extension Using Reinforcement Learning , 2007, Evolutionary Computation.

[15]  Kotaro Hirasawa,et al.  Comparison between Genetic Network Programming (GNP) and Genetic Programming (GP) , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).