Global Path-Planning for Constrained and Optimal Visual Servoing

Visual servoing consists of steering a robot from an initial to a desired location by exploiting the information provided by visual sensors. This paper deals with the problem of realizing visual servoing for robot manipulators taking into account constraints such as visibility, workspace (that is obstacle avoidance), and joint constraints, while minimizing a cost function such as spanned image area, trajectory length, and curvature. To solve this problem, a new path-planning scheme is proposed. First, a robust object reconstruction is computed from visual measurements which allows one to obtain feasible image trajectories. Second, the rotation path is parameterized through an extension of the Euler parameters that yields an equivalent expression of the rotation matrix as a quadratic function of unconstrained variables, hence, largely simplifying standard parameterizations which involve transcendental functions. Then, polynomials of arbitrary degree are used to complete the parametrization and formulate the desired constraints and costs as a general optimization problem. The optimal trajectory is followed by tracking the image trajectory with an IBVS controller combined with repulsive potential fields in order to fulfill the constraints in real conditions.

[1]  François Chaumette,et al.  Optimal Camera Trajectory with Image-Based Control , 2003, Int. J. Robotics Res..

[2]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[4]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[5]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[6]  Camillo J. Taylor,et al.  Robust vision-based pose control , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[8]  Myung Jin Chung,et al.  Path planning with uncalibrated stereo rig for image-based visual servoing under large pose discrepancy , 2003, IEEE Trans. Robotics Autom..

[9]  Daniel E. Koditschek,et al.  Visual servoing via navigation functions , 2002, IEEE Trans. Robotics Autom..

[10]  Philippe Martinet,et al.  Position based visual servoing: keeping the object in the field of vision , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Koichiro Deguchi,et al.  Optimal motion control for image-based visual servoing by decoupling translation and rotation , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[12]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[13]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[14]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[15]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[16]  Graziano Chesi,et al.  Visual servoing for large camera displacements , 2004, IEEE Transactions on Robotics.

[17]  François Chaumette,et al.  Image moments: generic descriptors for decoupled image-based visual servo , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  Koichiro Deguchi,et al.  Optimal Motion Control for Image-Based Visual Servoing by Decoupling Translation and Rotation , 1999 .

[19]  Peter K. Allen,et al.  Visual servoing by partitioning degrees of freedom , 2001, IEEE Trans. Robotics Autom..

[20]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[21]  Domenico Prattichizzo,et al.  Visual Servoing: Reaching the Desired Location Following a Straight Line via Polynomial Parameterizations , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[22]  Ezio Malis Visual servoing invariant to changes in camera-intrinsic parameters , 2001, IEEE Transactions on Robotics and Automation.

[23]  James P. Ostrowski,et al.  Visual motion planning for mobile robots , 2002, IEEE Trans. Robotics Autom..

[24]  Koichi Hashimoto,et al.  A review on vision-based control of robot manipulators , 2003, Adv. Robotics.