Image-based robot navigation from an image memory

This paper addresses the problem of vision-based navigation and proposes an original control law to perform such navigation. The overall approach is based on an appearance-based representation of the environment, where the scene is directly defined in the sensor space by a database of images acquired during a learning phase. Within this context, a path to follow is described by a set of images, or image path extracted from the database. This image path is designed so as to provide enough information to control the robotic system. The central contribution of this paper is the closed-loop control law that drives the robot to its desired position using this image path. This control does not require either a global 3D reconstruction or a temporal planning step. Furthermore, the robot is not constrained to converge directly upon each image of the path, but chooses its trajectory automatically. We propose a process of qualitative visual servoing, enabling us to enlarge the convergence space towards positioning in a range within a confidence interval. We propose and use specific visual features which ensure that the robot navigates within the visibility path. Experimental simulations are given to show the effectiveness of this method for controlling the motion of a camera in three-dimensional environments (free-flying camera, or camera moving on a plane). In addition, experiments realized with a robotic arm observing a planar scene are also presented.

[1]  Tieniu Tan,et al.  Mobile robot self-localization based on global visual appearance features , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[2]  Patrick Gros,et al.  Images interpolation for image-based control under large displacement , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Nassir Navab,et al.  Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Darius Burschka,et al.  Vision-based control of mobile robots , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[6]  François Chaumette,et al.  Point-based and region-based image moments for visual servoing of planar objects , 2005, IEEE Transactions on Robotics.

[7]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[8]  Patrick Gros,et al.  Image based robot navigation in 3D environments , 2005 .

[9]  Michael J. Black,et al.  Robust principal component analysis for computer vision , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Stefano Soatto,et al.  Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination , 2001, ICCV.

[11]  Jana Kosecka,et al.  Qualitative image based localization in indoors environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[14]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Martin Jägersand,et al.  Image-based localization with depth-enhanced image map , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[16]  James L. Crowley,et al.  Appearance based process for visual navigation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Antonis A. Argyros,et al.  Robot homing based on corner tracking in a sequence of panoramic images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Michel Dhome,et al.  Towards an alternative GPS sensor in dense urban environment from visual memory , 2004, BMVC.

[19]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[20]  Wolfram Burgard,et al.  A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[21]  Myung Hwangbo,et al.  Visual self-localization for indoor mobile robots using natural lines , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[22]  Patrick Gros,et al.  Robot motion control from a visual memory , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[23]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[24]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[25]  Michael J. Black,et al.  Robust Principal Component Analysis for Computer Vision , 2001, ICCV.

[26]  Philippe Martinet,et al.  Indoor Navigation of a Wheeled Mobile Robot along Visual Routes , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[27]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[28]  Masayuki Inaba,et al.  View-based approach to robot navigation , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[29]  Gregory D. Hager,et al.  Robot Navigation Using Image Sequences , 1996, AAAI/IAAI, Vol. 2.