Visual navigation of a mobile robot with laser-based collision avoidance

In this paper, we propose and validate a framework for visual navigation with collision avoidance for a wheeled mobile robot. Visual navigation consists of following a path, represented as an ordered set of key images, which have been acquired by an on-board camera in a teaching phase. While following such a path, the robot is able to avoid obstacles which were not present during teaching, and which are sensed by an on-board range scanner. Our control scheme guarantees that obstacle avoidance and navigation are achieved simultaneously. In fact, in the presence of obstacles, the camera pan angle is actuated to maintain scene visibility while the robot circumnavigates the obstacle. The risk of collision and the eventual avoiding behaviour are determined using a tentacle-based approach. The framework can also deal with unavoidable obstacles, which make the robot decelerate and eventually stop. Simulated and real experiments show that with our method, the vehicle can navigate along a visual path while avoiding collisions.

[1]  Thierry Siméon,et al.  Motion generation for a rover on rough terrains , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[2]  Sinisa Segvic,et al.  A mapping and localization framework for scalable appearance-based navigation , 2009, Comput. Vis. Image Underst..

[3]  Alberto Broggi,et al.  Sensing requirements for a 13,000 km intercontinental autonomous drive , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[4]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Beom Hee Lee,et al.  Mobile robot navigation with reactive free space estimation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Michael Himmelsbach,et al.  Driving with Tentacles - Integral Structures for Sensing and Motion , 2008, The DARPA Urban Challenge.

[7]  Gonzalo López-Nicolás,et al.  A Sliding-Mode-Control Law for Mobile Robots Based on Epipolar Visual Servoing From Three Views , 2011, IEEE Transactions on Robotics.

[8]  Carlos Sagüés,et al.  Wheeled mobile robots navigation from a visual memory using wide field of view cameras , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Christian Laugier,et al.  Guest Editorial Introducing Perception, Planning, and Navigation for Intelligent Vehicles , 2009, IEEE Trans. Intell. Transp. Syst..

[10]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[11]  Yilu Zhang,et al.  Driving skill characterization: A feasibility study , 2008, 2008 IEEE International Conference on Robotics and Automation.

[12]  Gonzalo López-Nicolás,et al.  Vision-based exponential stabilization of mobile robots , 2011, Auton. Robots.

[13]  Sumetee kesorn Visual Navigation for Mobile Robots: a Survey , 2012 .

[14]  Wang Wei,et al.  Mobile robot indoor navigation using laser range finder and monocular vision , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[15]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[16]  Viviane Cadenat,et al.  A New Predictor/Corrector Pair to Estimate the Visual Features Depth during a Vision-based Navigation Task in an Unknown Environment - A Solution for Improving the Visual Features Reconstruction During an Occlusion , 2010, ICINCO.

[17]  Philippe Martinet,et al.  Autonomous Navigation of Vehicles from a Visual Memory Using a Generic Camera Model , 2009, IEEE Transactions on Intelligent Transportation Systems.

[18]  Avinash C. Kak,et al.  Vision-based navigation by a mobile robot with obstacle avoidance using single-camera vision and ultrasonic sensing , 1998, IEEE Trans. Robotics Autom..

[19]  I. Masaki,et al.  An obstacle detection method by fusion of radar and motion stereo , 2002, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[20]  Giuseppe Oriolo,et al.  Local incremental planning for nonholonomic mobile robots , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[21]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[23]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[24]  Roland Siegwart,et al.  Appearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles , 2008, IEEE Transactions on Robotics.

[25]  Sinisa Segvic,et al.  Experimental Evaluation of Autonomous Driving Based on Visual Memory and Image-Based Visual Servoing , 2011, IEEE Transactions on Intelligent Transportation Systems.

[26]  Giuseppe Oriolo,et al.  Comparing appearance-based controllers for nonholonomic navigation from a visual memory , 2009 .

[27]  François Chaumette,et al.  Point-based and region-based image moments for visual servoing of planar objects , 2005, IEEE Transactions on Robotics.

[28]  Andrea Cherubini,et al.  Visual navigation with obstacle avoidance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Lindsay Kleeman,et al.  Robust Appearance Based Visual Route Following for Navigation in Large-scale Outdoor Environments , 2009, Int. J. Robotics Res..

[30]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[31]  Bruno Siciliano,et al.  Modeling and Control of Robot Manipulators , 1995 .

[32]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[33]  Lionel Lapierre,et al.  Simulatneous Path Following and Obstacle Avoidance Control of a Unicycle-type Robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[34]  Andrea Cherubini,et al.  A new tentacles-based technique for avoiding obstacles during visual navigation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[35]  L. Siciliano Modelling and Control of Robot Manipulators , 2000 .

[36]  Takahiro Wada,et al.  A deceleration control method of automobile for collision avoidance based on driver's perceptual risk , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Giuseppe Oriolo,et al.  Feature Depth Observation for Image-based Visual Servoing: Theory and Experiments , 2008, Int. J. Robotics Res..

[38]  Michel Dhome,et al.  Monocular Vision for Mobile Robot Localization and Autonomous Navigation , 2007, International Journal of Computer Vision.

[39]  David Folio,et al.  A redundancy-based scheme to perform safe vision-based tasks amidst obstacles , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[40]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[41]  Ben J. A. Kröse,et al.  Navigation using an appearance based topological map , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[42]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[44]  Oussama Khatib,et al.  Elastic bands: connecting path planning and control , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[45]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[46]  RoyerEric,et al.  Monocular Vision for Mobile Robot Localization and Autonomous Navigation , 2007 .

[47]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[48]  Florent Lamiraux,et al.  Reactive path deformation for nonholonomic mobile robots , 2004, IEEE Transactions on Robotics.

[49]  Guillaume Allibert,et al.  Real-time visual predictive controller for image-based trajectory tracking of a mobile robot , 2008 .

[50]  Michael Himmelsbach,et al.  Driving with tentacles: Integral structures for sensing and motion , 2008 .

[51]  Antonio Bicchi,et al.  Visual Servoing in the Large , 2009, Int. J. Robotics Res..

[52]  Luc Van Gool,et al.  Omnidirectional Vision Based Topological Navigation , 2007, International Journal of Computer Vision.

[53]  Ana Cristina Murillo,et al.  Localization and Matching Using the Planar Trifocal Tensor With Bearing-Only Data , 2008, IEEE Transactions on Robotics.