A visual servoing approach for autonomous corridor following and doorway passing in a wheelchair

Navigating within an unknown indoor environment using an electric wheelchair is a challenging task, especially if the user suffers from severe disabilities. In order to reduce fatigability and increase autonomy, control architectures have to be designed that would assist users in wheelchair navigation. We present a framework for vision-based autonomous indoor navigation in an electric wheelchair capable of following corridors, and passing through open doorways using a single doorpost. Visual features extracted from cameras on board the wheelchair are used as inputs for image based controllers built-in the wheelchair. It has to be noted that no a-priori information is utilized except for the assumption that the wheelchair moves in a typical indoor environment while the system is coarsely calibrated. The designed control schemes have been implemented onto a robotized wheelchair and experimental results show the robust behaviour of the designed system. We devise a visual servoing approach for indoor wheelchair navigation.The fundamental tasks of corridor following and doorway passing are tackled.Results in simulation and on a robotic platform show the convergence and validity of the control system.This work is proposed as a first step in developing the concept of semi-autonomous assistive systems.

[1]  Oscar Nasisi,et al.  Stable AGV corridor navigation with fused vision-based control signals , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[2]  Sebastian Thrun,et al.  Detecting and modeling doors with mobile robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  Marilena Vendittelli,et al.  Vision-based corridor navigation for humanoid robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Camillo J. Taylor,et al.  Sensor based door navigation for a nonholonomic vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Ricardo O. Carelli,et al.  Corridor navigation and wall-following stable control for sonar-based mobile robots , 2003, Robotics Auton. Syst..

[6]  Honglak Lee,et al.  A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Philippe Martinet,et al.  Catadioptric Visual Servoing From 3-D Straight Lines , 2008, IEEE Transactions on Robotics.

[8]  Patrick Rives,et al.  Image-Based Visual Servoing for Vanishing Features and Ground Lines Tracking: Application to a UAV Automatic Landing , 2008 .

[9]  Thierry Floquet,et al.  SYSIASS – an intelligent powered wheelchair , 2013 .

[10]  M. Laplante,et al.  MOBILITY DEVICE USE IN THE UNITED STATES: DISABILITY STATISTICS REPORT , 2000 .

[11]  M. Finlayson,et al.  Experiencing the loss of mobility: perspectives of older adults with MS , 2003, Disability and rehabilitation.

[12]  Zhichao Chen,et al.  Visual detection of lintel-occluded doors from a single image , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  P. Fiorini,et al.  Switching visual servoing approach for stable corridor navigation , 2009, 2009 International Conference on Advanced Robotics.

[14]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[15]  Giuseppe Oriolo,et al.  Visual servoing for path reaching with nonholonomic robots , 2011, Robotica.

[16]  Benjamin Kuipers,et al.  Towards a Safe, Low-Cost, Intelligent Wheelchair , 2009 .

[17]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[18]  Takashi Gomi,et al.  Developing Intelligent Wheelchairs for the Handicapped , 1998, Assistive Technology and Artificial Intelligence.

[19]  J. Gaspar,et al.  Omni-directional vision for robot navigation , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[20]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[21]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[22]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[23]  Roger B. Davis,et al.  Mobility difficulties are not only a problem of old age , 2001, Journal of General Internal Medicine.

[24]  Nicolas Mansard,et al.  Task Sequencing for High-Level Sensor-Based Control , 2007, IEEE Transactions on Robotics.

[25]  Woojin Chung,et al.  Safe Navigation of a Mobile Robot Considering Visibility of Environment , 2009, IEEE Transactions on Industrial Electronics.

[26]  Saso Blazic,et al.  A novel trajectory-tracking control law for wheeled mobile robots , 2011, Robotics Auton. Syst..

[27]  François Pasteau,et al.  Simple monocular door detection and tracking , 2013, 2013 IEEE International Conference on Image Processing.

[28]  Sumanta N. Pattanaik,et al.  ATIP: A Tool for 3D Navigation inside a Single Image with Automatic Camera Calibration , 2006, TPCG.

[29]  Patrick Bouthemy,et al.  A Maximum Likelihood Framework for Determining Moving Edges , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[31]  Holly A. Yanco Integrating Robotic Research: A Survey of Robotic Wheelchair Development , 1998 .

[32]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[33]  Sašo Blaič A novel trajectory-tracking control law for wheeled mobile robots , 2011 .

[34]  Samia Boukir,et al.  A local method for contour matching and its parallel implementation , 1998, Machine Vision and Applications.

[35]  S P Levine,et al.  The NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  Tae-Gyung Kang,et al.  Mobility Device Use in the United States , 2003 .

[37]  Frank Dellaert,et al.  Vistas and Wall-Floor Intersection Features: Enabling Autonomous Flight in Man-made Environments , 2012 .

[38]  Joris De Schutter,et al.  Wheelchair Navigation Assistance in the FP7 Project RADHAR: Objectives and Current State , 2012 .

[39]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[40]  Benjamin Kuipers,et al.  A smooth control law for graceful motion of differential wheeled mobile robots in 2D environment , 2011, 2011 IEEE International Conference on Robotics and Automation.