Motion planning from demonstrations and polynomial optimization for visual servoing applications

Vision feedback control techniques are desirable for a wide range of robotics applications due to their robustness to image noise and modeling errors. However in the case of a robot-mounted camera, they encounter difficulties when the camera traverses large displacements. This scenario necessitates continuous visual target feedback during the robot motion, while simultaneously considering the robot's self- and external-constraints. Herein, we propose to combine workspace (Cartesian space) path-planning with robot teach-by-demonstration to address the visibility constraint, joint limits and “whole arm” collision avoidance for vision-based control of a robot manipulator. User demonstration data generates safe regions for robot motion with respect to joint limits and potential “whole arm” collisions. Our algorithm uses these safe regions to generate new feasible trajectories under a visibility constraint that achieves the desired view of the target (e.g., a pre-grasping location) in new, undemonstrated locations. Experiments with a 7-DOF articulated arm validate the proposed method.

[1]  James J. Little,et al.  Constrained Manipulator Visual Servoing (CMVS): Rapid robot programming in cluttered workspaces , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Domenico Prattichizzo,et al.  Keeping features in the field of view in eye-in-hand visual servoing: a switching approach , 2004, IEEE Transactions on Robotics.

[3]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[4]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[5]  Peter K. Allen,et al.  Visual servoing by partitioning degrees of freedom , 2001, IEEE Trans. Robotics Autom..

[6]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[7]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[8]  Camillo J. Taylor,et al.  Robust vision-based pose control , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[11]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[12]  Yeung Sam Hung,et al.  Global Path-Planning for Constrained and Optimal Visual Servoing , 2007, IEEE Transactions on Robotics.

[13]  Siddhartha S. Srinivasa,et al.  Manipulation planning on constraint manifolds , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[15]  Siddhartha S. Srinivasa,et al.  Manipulation planning with goal sets using constrained trajectory optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Daniel E. Koditschek,et al.  Visual servoing via navigation functions , 2002, IEEE Trans. Robotics Autom..

[17]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Graziano Chesi,et al.  Visual Servoing via Advanced Numerical Methods , 2010 .