Visual predictive control for manipulators with catadioptric camera

This paper deals with image based visual servoing (IBSV) by a visual predictive control (VPC) approach. Based on nonlinear model predictive control (NMPC), the visual servoing problem is formulated into a nonlinear constrained minimization problem in the image plane. A global model describing the behavior of the robotic system equipped with the camera is used to predict the evolution of the visual feature on a future horizon. The main interest of this method is the capability to easily take into account different constraints like mechanical limitations and/or visibility constraints. Simulation experiments are performed on a planar manipulator with an omnidirectional camera. Comparisons with the classical control law based on the interaction matrix highlight the efficiency and the robustness of the proposed approach, especially in difficult initial configurations and large displacements.

[1]  Selim Benhimane,et al.  Vision-based control with respect to planar and non-planar objects using a zooming camera , 2003 .

[2]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[3]  M. Fujita,et al.  Predictive Visual Feedback Control with Eye-in-Hand System via Stabilizing Receding Horizon Approach , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[4]  C. V. Jawahar,et al.  Visual Servoing by Optimization of a 2D/3D Hybrid Objective Function , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[6]  Radu Horaud,et al.  Visual Servoing/Tracking Using Central Catadioptric Images , 2002, ISER.

[7]  P. Poignet,et al.  Image Based Visual Servoing through Nonlinear Model Predictive Control , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[8]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[9]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[10]  Estelle Courtial,et al.  A FLAT MODEL PREDICTIVE CONTROLLER FOR TRAJECTORY TRACKING IN IMAGE BASED VISUAL SERVOING , 2007 .

[11]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[12]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[13]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[14]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[15]  Domenico Prattichizzo,et al.  Keeping features in the field of view in eye-in-hand visual servoing: a switching approach , 2004, IEEE Transactions on Robotics.

[16]  Ezio Malis,et al.  Improving vision-based control using efficient second-order minimization techniques , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.