LMI-based Trajectory Planning for Closed-loop Control of Robotic Systems with Visual Feedback

Closed-loop robot control based on visual feedback is an important research area, with useful applications in various fields. Planning the trajectory to be followed by the robot allows one to take into account multiple constraints during the motion, such as limited field of view of the camera and limited workspace of the robot. This paper proposes a strategy for path-planning from an estimate of the point correspondences between the initial view and the desired one, and an estimate of the camera intrinsic parameters. This strategy consists of generating a parametrization of the trajectories connecting the initial location to the desired one via polynomials. The trajectory constraints are then imposed by using suitable relaxations and LMIs (linear matrix inequalities). Some examples illustrate the proposed approach.

[1]  Domenico Prattichizzo,et al.  Keeping features in the field of view in eye-in-hand visual servoing: a switching approach , 2004, IEEE Transactions on Robotics.

[2]  Myung Jin Chung,et al.  Path planning with uncalibrated stereo rig for image-based visual servoing under large pose discrepancy , 2003, IEEE Trans. Robotics Autom..

[3]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[4]  Hikaru Inooka,et al.  Model-less visual servoing using modified simplex optimization , 2005, Artificial Life and Robotics.

[5]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[6]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[7]  Kamal K. Gupta,et al.  Path planning with general end-effector constraints , 2007, Robotics Auton. Syst..

[8]  François Chaumette,et al.  Point-based and region-based image moments for visual servoing of planar objects , 2005, IEEE Transactions on Robotics.

[9]  Yeung Sam Hung,et al.  Global Path-Planning for Constrained and Optimal Visual Servoing , 2007, IEEE Transactions on Robotics.

[10]  Benedetto Allotta,et al.  3D Motion Planning for Image-Based Visual Servoing Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  橋本 浩一.  Visual servoing : real-time control of robot manipulators based on visual sensory feedback , 1993 .

[12]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[13]  William J. Wilson,et al.  Hybrid motion control and planning strategies for visual servoing , 2005, IEEE Transactions on Industrial Electronics.

[14]  Ezio Malis.  Visual servoing invariant to changes in camera-intrinsic parameters , 2004, IEEE Trans. Robotics Autom..

[15]  Noah J. Cowan,et al.  Geometric visual servoing , 2005, IEEE Transactions on Robotics.

[16]  Graziano Chesi,et al.  Camera Displacement via Constrained Minimization of the Algebraic Error , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Graziano Chesi,et al.  Visual servoing for large camera displacements , 2004, IEEE Transactions on Robotics.

[18]  Graziano Chesi,et al.  Solving quadratic distance problems: an LMI-based approach , 2003, IEEE Trans. Autom. Control..

[19]  Graziano Chesi,et al.  Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations , 2009, IEEE Transactions on Robotics.

[20]  S. Tarbouriech,et al.  A multicriteria image-based controller based on a mixed polytopic and norm-bounded representation of uncertainties , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  A. Vicino,et al.  On convexification of some minimum distance problems , 1999, 1999 European Control Conference (ECC).

[22]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[23]  Kamal K. Gupta,et al.  Global path planning for robust Visual Servoing in complex environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[24]  Philippe Martinet,et al.  Position based visual servoing: keeping the object in the field of vision , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[25]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[26]  Roberto Cipolla,et al.  212D Visual Servoing with Respect to Planar Contours having Complex and Unknown Shapes , 2003, Int. J. Robotics Res..

[27]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[28]  Josechu J. Guerrero,et al.  Switched Homography-Based Visual Control of Differential Drive Vehicles with Field-of-View Constraints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[29]  Masami Iwatsuki,et al.  A new formulation of visual servoing based on cylindrical coordinate system , 2002, IEEE Transactions on Robotics.

[30]  Graziano Chesi,et al.  A simple technique for improving camera displacement estimation in eye-in-hand visual servoing , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.