Knowledge based Reinforcement Learning Robot in Maze Environment

simple approach for knowledge based maze solving is presented for a mobile robot. The artificial intelligence concept like reinforcement learning technique is utilized by the robot to learn the new environment. The robot travels through the environment and identifies the target by following a set of rules. After reaching the target, the robot returns back through the optimum path by avoiding dead ends. For achieving this, the robot uses a line maze solving algorithm which uses a set of replacement rules to replace the wrong paths travelled with the correct ones. The algorithm for this maze solver is qualitative in nature, requiring no map of environment, no image Jacobian, no Homography, no fundamental matrix, and no assumption. The environment is accessible, deterministic and static. The working procedure of this project consists of line path following, mobile robot navigation, knowledge based navigation, reinforcement learning.

[1]  Vinod G. Shelake,et al.  Exploring C for Microcontrollers: A Hands on Approach , 2007 .

[2]  Jianghao Li,et al.  Wheels Optimization and Vision Control of Omni-directional Mobile Microrobot , 2008 .

[3]  Gerasimos Rigatos Multi-Robot Motion Planning Using Swarm Intelligence , 2008 .

[4]  Tom Duckett,et al.  Vision-based reinforcement learning using approximate policy iteration , 2009, 2009 International Conference on Advanced Robotics.

[5]  Kao-Shing Hwang,et al.  Q-learning in multi-agent cooperation , 2008, 2008 IEEE Workshop on Advanced robotics and Its Social Impacts.

[6]  Alvo Aabloo,et al.  Learning Innovative Routes for Mobile Robots in Dynamic Partially Unknown Environments , 2005 .

[7]  Zhichao Chen,et al.  Qualitative Vision-Based Path Following , 2009, IEEE Transactions on Robotics.

[8]  M. Piaggio,et al.  Learning navigation situations using roadmaps , 1997, Proceedings Second EUROMICRO Workshop on Advanced Mobile Robots.

[9]  Caro Lucas,et al.  Combined Intelligent Control (CIC) an Intelligent Decision Making Algorithm , 2007 .

[10]  Fares Boudjema,et al.  Car-Like Mobile Robot Oriented Positioning by Fuzzy Controllers , 2008 .

[11]  Robin R. Murphy,et al.  Mobile robots in mine rescue and recovery , 2009, IEEE Robotics & Automation Magazine.

[12]  Javier Minguez,et al.  Extending Collision Avoidance Methods to Consider the Vehicle Shape, Kinematics, and Dynamics of a Mobile Robot , 2009, IEEE Transactions on Robotics.

[13]  Andras Majdik,et al.  Path planning and dynamic objects detection , 2009, 2009 International Conference on Advanced Robotics.

[14]  Claude F. Touzet,et al.  Distributed Lazy Q-Learning for Cooperative Mobile Robots , 2004 .