A framework for robot motion planning with sensor constraints

Visual feedback can play a crucial role in a dynamic robotic task such as the interception of a moving target. To utilize the feedback effectively, there is a need to develop robot motion planning techniques that also take into account properties of the sensed data. We propose a motion planning framework that achieves this with the help of a space called the perceptual control manifold (PCM) defined on the product of the robot configuration space and an image-based feature space. We show how the task of intercepting a moving target can be mapped to the PCM, using image feature trajectories of the robot end-effector and the moving target. This leads to the generation of motion plans that satisfy various constraints and optimality criteria derived from the robot kinematics, the control system, and the sensing mechanism. Specific interception tasks are analyzed to illustrate this vision-based planning technique.

[1]  Michael A. Erdmann,et al.  Using Backprojections for Fine Motion Planning with Uncertainty , 1986 .

[2]  Jean-Claude Latombe,et al.  Planning the Motions of a Mobile Robot in a Sensory Uncertainty Field , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[4]  Rajeev Sharma,et al.  Unifying configuration space and sensor space for vision-based motion planning , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[5]  William F. Clocksin,et al.  An Implementation of Model-Based Visual Feedback for Robot Arc Welding of Thin Sheet Steel , 1985 .

[6]  Rajeev Sharma,et al.  Optimizing hand/eye configuration for visual-servo systems , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[7]  Alain Lambert,et al.  Safe actions and observations planning for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[8]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Peter K. Allen,et al.  Active, uncalibrated visual servoing , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[10]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[11]  Robert M. Haralick.  Propagating covariance in computer vision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  Steven M. LaValle,et al.  An objective-based stochastic framework for manipulation planning , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[13]  Brenan J. McCarragher,et al.  Achieving efficient data fusion through integration of sensory perception control and sensor fusion , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[14]  Jean-Claude Latombe,et al.  Robot Motion Planning with Uncertainty in Control and Sensing , 1991, Artif. Intell..

[15]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[16]  Rajeev Sharma,et al.  The Geometry of Visual Coordination , 1991, AAAI.

[17]  Steven B. Skaar,et al.  Camera-Space Manipulation , 1987 .

[18]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[19]  Wolfram Burgard,et al.  Coastal navigation-mobile robot navigation with uncertainty in dynamic environments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[20]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[21]  R. Sharma,et al.  Global performance evaluation of image features for visual servo control , 1996 .

[22]  Thierry Fraichard,et al.  Path planning with uncertainty for car-like robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[23]  Gregory D. Hager,et al.  Real-time feature tracking and projective invariance as a basis for hand-eye coordination , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Richard S. Sutton,et al.  Neural networks for control , 1990 .

[25]  Bernard Roth,et al.  Analysis of Multifingered Hands , 1986 .

[26]  Yiannis Aloimonos,et al.  Perspective approximations , 1990, Image Vis. Comput..

[27]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[28]  Sebastian Thrun.  Finding landmarks for mobile robot navigation , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[29]  Armando Fox,et al.  Exploiting visual constraints in the synthesis of uncertainty-tolerant motion plans , 1995, IEEE Trans. Robotics Autom..

[30]  Fritz B. Prinz,et al.  An Algorithm for Seam Tracking Applications , 1985 .

[31]  Bruce Randall Donald,et al.  Sensor interpretation and task-directed planning using perceptual equivalence classes , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[32]  S. Zucker,et al.  Toward Efficient Trajectory Planning: The Path-Velocity Decomposition , 1986 .

[33]  Peter Corke,et al.  VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW , 1993 .

[34]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[35]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[36]  Rajeev Sharma,et al.  Dynamic robot manipulation using visual tracking , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[37]  Michael Werman,et al.  A novel Bayesian method for fitting parametric and non-parametric models to noisy data , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[38]  Rajeev Sharma,et al.  On the observability of robot motion under active camera control , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[39]  Peter K. Allen,et al.  Real-time visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[40]  Tomás Lozano-Pérez,et al.  Automatic Planning of Manipulator Transfer Movements , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Brenan J. McCarragher,et al.  Improving sensory perception through predictive correction of monitoring errors , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[42]  Konstantinos A. Tarabanis,et al.  A survey of sensor planning in computer vision , 1995, IEEE Trans. Robotics Autom..