POMDP-based long-term user intention prediction for wheelchair navigation

This paper presents an intelligent decision-making agent to assist wheelchair users in their daily navigation activities. Several navigational techniques have been successfully developed in the past to assist with specific behaviours such as "door passing" or "corridor following". These shared control strategies normally require the user to manually select the level of assistance required during use. Recent research has seen a move towards more intelligent systems that focus on forecasting users' intentions based on current and past actions. However, these predictions have been typically limited to locations immediately surrounding the wheelchair. The key contribution of the work presented here is the ability to predict the users' intended destination at a larger scale, that of a typical office arena. The systems relies on minimal user input - obtained from a standard wheelchair joystick - in conjunction with a learned Partially Observable Markov Decision Process (POMDP), to estimate and subsequently drive the user to his destination. The projection is constantly being updated, allowing for true user- platform integration. This shifts users' focus from fine motor- skilled control to coarse control broadly intended to convey intention. Successful simulation and experimental results on a real wheelchair robot demonstrate the validity of the approach.

[1]  B. Kröse,et al.  Human-Robot User Studies in Eldercare: Lessons Learned , 2006 .

[2]  Dikai Liu,et al.  An Efficient Path Planner for Large Mobile Platforms in Cluttered Environments , 2006, 2006 IEEE Conference on Robotics, Automation and Mechatronics.

[3]  Hendrik Van Brussel,et al.  Shared control for intelligent wheelchairs: an implicit estimation of the user intention , 2003 .

[4]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[5]  Young Ho Kim,et al.  Development of an intelligent guide-stick for the blind , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[6]  Karim A. Tahboub,et al.  Journal of Intelligent and Robotic Systems (2005) DOI: 10.1007/s10846-005-9018-0 Intelligent Human–Machine Interaction Based on Dynamic Bayesian Networks Probabilistic Intention Recognition , 2004 .

[7]  Christian Mandel,et al.  Towards an Autonomous Wheelchair: Cognitive Aspects in Service Robotics , 2005 .

[8]  A. Pruski,et al.  VAHM: a user adapted intelligent wheelchair , 2002, Proceedings of the International Conference on Control Applications.

[9]  Pradip Sheth,et al.  Stability Margin Monitoring in Steering-Controlled Intelligent Walkers for the Elderly , 2005, AAAI Fall Symposium: Caring Machines.

[10]  Holly A. Yanco,et al.  Development and Testing of a Robotic Wheelchair System for Outdoor Navigation , 2001 .

[11]  Joelle Pineau,et al.  POMDP Planning for Robust Robot Control , 2005, ISRR.

[12]  Jesse Hoey,et al.  Assisting persons with dementia during handwashing using a partially observable Markov decision process. , 2007, ICVS 2007.

[13]  Luis Miguel Bergasa,et al.  A Navigation System for Assistant Robots Using Visually Augmented POMDPs , 2005, Auton. Robots.

[14]  Ben J. A. Kröse,et al.  BIRON, where are you? Enabling a robot to learn new places in a real home environment by integrating spoken dialog and visual localization , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  A.T. de Almeida,et al.  RobChair-a powered wheelchair using a behaviour-based navigation , 1998, AMC'98 - Coimbra. 1998 5th International Workshop on Advanced Motion Control. Proceedings (Cat. No.98TH8354).

[16]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[17]  Hendrik Van Brussel,et al.  Bayesian Estimation of Wheelchair Driver Intents: Modeling Intents as Geometric Paths Tracked by the Driver , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.