Learning to optimize mobile robot navigation based on HTN plans

High-level symbolic representations of actions to control the working of autonomous robots are used in all hybrid (reactive and deliberative) robot control architectures. Abstract action representations serve several purposes, such as structuring the control code, optimizing the robot performance, and providing a basis for reasoning about future robot action. The paper presents results about re-designing the RHINO navigation system by introducing an HTN plan layer. Besides yielding a more structured robot control software, this layer is used as a basis for optimizing the navigation performance by plan transformations. We show how a robot can learn to select plan transformations based on projections of its intended behavior. Our experimental evaluation shows that the overall robot navigation performance is increased by almost 42 % when using learned projective models to select plan transformations.

[1]  Wolfram Burgard,et al.  Experiences with an Interactive Museum Tour-Guide Robot , 1999, Artif. Intell..

[2]  Wolfram Burgard,et al.  Active Mobile Robot Localization , 1997, IJCAI.

[3]  Dana S. Nau,et al.  Success in Spades: Using AI Planning Techniques to Win the World Championship of Computer Bridge , 1998, AAAI/IAAI.

[4]  Robin R. Murphy,et al.  Introduction to AI Robotics , 2000 .

[5]  Dirk Schulz,et al.  Local action planning for mobile robot collision avoidance , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[7]  David E. Wilkins,et al.  Practical planning - extending the classical AI planning paradigm , 1989, Morgan Kaufmann series in representation and reasoning.

[8]  Aram Karalic.  Linear Regression in Regression Tree Leaves , 1992 .

[9]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[10]  Earl David Sacerdoti,et al.  A Structure for Plans and Behavior , 1977 .

[11]  Wolfram Burgard,et al.  MINERVA: a second-generation museum tour-guide robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[12]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[13]  Michael Beetz,et al.  Expressing Transformations of Structured Reactive Plans , 1997, ECP.

[14]  Joachim Hertzberg,et al.  Advances in Plan-Based Control of Robotic Agents , 2003, Lecture Notes in Computer Science.

[15]  Drew McDermott,et al.  Robot Planning , 1991, AI Mag..

[16]  Armin B. Cremers,et al.  Learning of plan execution policies for indoor navigation , 2002, AI Commun..

[17]  Wolfram Burgard,et al.  Map learning and high-speed navigation in RHINO , 1998 .

[18]  W. O. Berry,et al.  Preface , 1988, Brain Research Bulletin.

[19]  Hector Muñoz-Avila,et al.  SHOP: Simple Hierarchical Ordered Planner , 1999, IJCAI.

[20]  Wolfram Burgard,et al.  Active mobile robot localization by entropy minimization , 1997, Proceedings Second EUROMICRO Workshop on Advanced Mobile Robots.

[21]  Robin R. Murphy,et al.  Artificial intelligence and mobile robots: case studies of successful robot systems , 1998 .