Visual Servoing in the Large

In this paper we consider the problem of maneuvering an autonomous robot in complex unknown environments using vision. The goal is to accurately servo a wheeled vehicle to a desired posture using only feedback from an on-board camera, taking into account the nonholonomic nature of the vehicle kinematics and the limited field-of-view of the camera. With respect to existing visual servoing schemes, which achieve similar goals locally (i.e. when the desired and actual camera views are sufficiently similar), we propose a method to visually navigate the robot through an extended visual map before eventually reaching the desired goal. The map comprises a set of images, previously stored in an exploratory phase, that convey both topological and metric information regarding the connectivity through feasible robot paths and the geometry of the environment, respectively. Experimental results on a laboratory setup are reported showing the practicality of the proposed approach.

[1]  V. Thompson.  Automatic Landmark Selection for Navigation with Panoramic , 1999 .

[2]  Antonio Bicchi,et al.  Visual-servoed Parking with Limited View Angle , 2002, ISER.

[3]  Paolo Pirjanian,et al.  A Visual Front-end for Simultaneous Localization and Mapping , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[4]  Antonio Bicchi,et al.  Vision-based dynamic estimation and set-point stabilization of nonholonomic vehicles , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Toshiro Noritsugu,et al.  Visual servoing of nonholonomic cart , 1997, Proceedings of International Conference on Robotics and Automation.

[6]  George Kantor,et al.  Feedback Control of Underactuated Systems via Sequential Composition: Visually Guided Control of a Unicycle , 2003, ISRR.

[7]  Daniel E. Koditschek,et al.  Visual Servoing for Nonholonomically Constrained Three Degree of Freedom Kinematic Systems , 2007, Int. J. Robotics Res..

[8]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[9]  Philippe Martinet,et al.  Omnidirectional visual servoing from polar lines , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Selim Benhimane,et al.  Vision-based control with respect to planar and non-planar objects using a zooming camera , 2003 .

[11]  Josechu J. Guerrero,et al.  Switched Homography-Based Visual Control of Differential Drive Vehicles with Field-of-View Constraints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Dimitris P. Tsakiris,et al.  Applying Visual Servoing Techniques to Control Nonholonomic Mobile Robots , 1997 .

[13]  Sebastian Thrun,et al.  Integrating Grid-Based and Topological Maps for Mobile Robot Navigation , 1996, AAAI/IAAI, Vol. 2.

[14]  Antonio Bicchi,et al.  A Hybrid-Control Approach to the Parking Problem of a Wheeled Vehicle Using Limited View-Angle Visual Feedback , 2004, Int. J. Robotics Res..

[15]  Domenico Prattichizzo,et al.  Image-Based Visual Servoing for Mobile Robots with Catadioptric Camera , 2006, EUROS.

[16]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Stefano Soatto,et al.  KALMANSAC: robust filtering by consensus , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Michel Dhome,et al.  Outdoor autonomous navigation using monocular vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[21]  Michael Bosse,et al.  Mapping Partially Observable Features from Multiple Uncertain Vantage Points , 2002, Int. J. Robotics Res..

[22]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[23]  Gregory Dudek,et al.  Collaborative exploration for the construction of visual maps , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[24]  Hugh Durrant-Whyte,et al.  SLAM Updates Require Constant Time , 2002 .

[25]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[26]  Paolo Pirjanian,et al.  The vSLAM Algorithm for Robust Localization and Mapping , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[27]  Rafael Murrieta-Cid,et al.  Optimal Paths for Landmark-Based Navigation by Differential-Drive Vehicles With Field-of-View Constraints , 2007, IEEE Transactions on Robotics.

[28]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[29]  Gregory D. Hager,et al.  Efficient particle filtering using RANSAC with application to 3D face tracking , 2006, Image and Vision Computing.

[30]  Joao P. Hespanha,et al.  Single-camera visual servoing , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[31]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..