A multi-scale navigation method for intelligent wheelchair based on hierarchical POMDPs and DBNS

This paper describes a multi-scale navigation method for intelligent wheelchair based on hierarchical Partially Observable Decision Process (POMDPs) and dynamic Bayesian networks (DBNs) in indoor environment. The intelligent wheelchair and the model of POMDPs are introduced. A hierarchical POMDPs model is given, which decomposes the decision making process into a set of small ones that can be done more efficiently. We explore the advantages of representing hierarchical POMDPs as DBNs. The multi-scale navigation method based on hierarchical POMDPS and DBNs is proposed. The method is implemented and tested onboard a smart wheelchair in the indoor navigation task. The experimental results show the reliability and efficiency of the navigation method.

[1]  Paul A. Viola,et al.  Cooperative control of a semi-autonomous mobile robot , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[2]  Joelle Pineau,et al.  Pearl: A Mobile Robotic Assistant for the Elderly , 2002 .

[3]  Andrew G. Barto,et al.  Optimal learning: computational procedures for bayes-adaptive markov decision processes , 2002 .

[4]  Joelle Pineau,et al.  High-level robot behavior control using POMDPs , 2002 .

[5]  S P Levine,et al.  The NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Miguel Ángel Sotelo,et al.  Indoor robot navigation using a POMDP based on WiFi and ultrasound observations , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Richard Simpson,et al.  The smart wheelchair component system. , 2004, Journal of rehabilitation research and development.

[8]  Hendrik Van Brussel,et al.  Shared control for intelligent wheelchairs: an implicit estimation of the user intention , 2003 .

[9]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[10]  David Andre,et al.  Model based Bayesian Exploration , 1999, UAI.

[11]  Pradip Sheth,et al.  Stability Margin Monitoring in Steering-Controlled Intelligent Walkers for the Elderly , 2005, AAAI Fall Symposium: Caring Machines.

[12]  Alain Pruski,et al.  Assisted navigation for a powered wheelchair , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[13]  Holly A. Yanco,et al.  Wheelesley: A Robotic Wheelchair System: Indoor Navigation and User Interface , 1998, Assistive Technology and Artificial Intelligence.

[14]  Christian Mandel,et al.  Towards an Autonomous Wheelchair: Cognitive Aspects in Service Robotics , 2005 .

[15]  Young Ho Kim,et al.  Development of an intelligent guide-stick for the blind , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[16]  Jesse Hoey,et al.  An analytic solution to discrete Bayesian reinforcement learning , 2006, ICML.

[17]  R. Simpson.  Smart wheelchairs: A literature review. , 2005, Journal of rehabilitation research and development.

[18]  A.T. de Almeida,et al.  RobChair-a powered wheelchair using a behaviour-based navigation , 1998, AMC'98 - Coimbra. 1998 5th International Workshop on Advanced Motion Control. Proceedings (Cat. No.98TH8354).