Visual motion planning for mobile robots

This paper presents a novel framework for image-based motion planning, which we term Visual Motion Planning. The method skips the step of transferring image features back to robot pose, and hence makes motion plans directly in the image plane. Analogous to visual servo control, the visual motion planning concept takes advantage of the image features to achieve a direct and fast motion planning solution. It provides a "virtual" trajectory in the image plane for the robot to track with standard visual servoing techniques. In this paper, we show the result of applying the idea to simulated 2-D and 3-D mobile robot systems. Within this motion planning paradigm, we also discuss the mechanisms for taking advantage of surplus features and incorporating image-based constraints, such as requiring that the images remain in the field of view. Experimental results using a Pioneer AT ground mobile robot are presented, showing excellent agreement with theory.

[1]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[2]  Jean-Paul Laumond,et al.  Robot Motion Planning and Control , 1998 .

[3]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[4]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[5]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[6]  Daniel E. Koditschek,et al.  Planar image based visual servoing as a navigation problem , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[7]  Jean-Claude Latombe,et al.  Motion Planning with Uncertainty: A Landmark Approach , 1995, Artif. Intell..

[8]  A. Ohya,et al.  A fast and accurate sonar-ring sensor for a mobile robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Howie Choset,et al.  Sensor-Based Exploration: The Hierarchical Generalized Voronoi Graph , 2000, Int. J. Robotics Res..

[10]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[11]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[12]  J. Canny,et al.  Nonholonomic Motion Planning , 1992 .

[13]  S. Shankar Sastry,et al.  Vision guided navigation for a nonholonomic mobile robot , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[14]  William H. Press,et al.  Numerical recipes in C , 2002 .

[15]  François Chaumette,et al.  Path planning in image space for robust visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Vijay R. Kumar,et al.  Continuous methods for motion planning , 1996 .

[17]  J.P. Desai,et al.  Control of changes in formation for a team of mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[18]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[19]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[20]  James P. Ostrowski,et al.  Visual servoing with dynamics: control of an unmanned blimp , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[21]  Rajeev Sharma,et al.  A framework for motion planning in stochastic environments: applications and computational issues , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[22]  G.D. Hager,et al.  Toward domain-independent navigation: dynamic vision and control , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[23]  Masahiro Fujita,et al.  Evolving robust gaits with AIBO , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[24]  François Chaumette,et al.  Model-free optimal trajectories in the image space , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[25]  F. Bullo.  Nonlinear control of mechanical systems : a Riemannian geometry approach , 1999 .

[26]  J. Gregory,et al.  Constrained optimization in the calculus of variations and optimal control theory , 1992 .

[27]  Vladimir J. Lumelsky,et al.  A Unified Methodology for Motion Planning with Uncertainty for 2D and 3D Two-Link Robot Arm Manipulators , 1990, Int. J. Robotics Res..

[28]  Vijay Kumar,et al.  Motion planning with uncertainty , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[29]  Matthew T. Mason,et al.  Robot Motion: Planning and Control , 1983 .

[30]  Camillo J. Taylor,et al.  Robust visual servoing based on relative orientation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[31]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[32]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[33]  Ruzena Bajcsy,et al.  Reflective surfaces as computational sensors , 2001, Image Vis. Comput..

[34]  Roderic A. Grupen,et al.  Feature extraction for autonomous navigation using an active sonar head , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[35]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[36]  Daniel E. Koditschek,et al.  Exact robot navigation using artificial potential functions , 1992, IEEE Trans. Robotics Autom..

[37]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[38]  Naomi Ehrich Leonard,et al.  Controllability and motion algorithms for underactuated Lagrangian systems on Lie groups , 2000, IEEE Trans. Autom. Control..

[39]  Hong Zhang.  Motion control for dynamic mobile robots , 2000 .