Direct Visual Servoing to Track Trajectories in Human-Robot Cooperation

This paper describes a dynamic image-based control system to guide two coupled robots. The first robot is a Mitsubishi PA-10 robotic manipulator which has a second mini-robot with 3 degrees of freedom (DOF) attached at its end-effector. The vision system used for the guidance of both robots is composed of a camera at the end-effector of the mini-robot. The paper presents a new method to perform the mini-robot guidance using dynamic control to track a previous generated image trajectory. The mini-robot performs the tracking in a workspace in cooperation with a human operator. Therefore, the proposed visual control is combined with virtual visual servoing to perform a safety behavior.

[1]  Myung Jin Chung,et al.  Stability Analysis of Image-Based Visual Servoing Regarding with Camera Calibration Error , 2007 .

[2]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[3]  Jose Alvarez-Ramirez,et al.  On Transpose Jacobian Control for Monocular Fixed-Camera 3D Direct Visual Servoing , 2008 .

[4]  Yasuhiro Masutani,et al.  Robustness of sensory feedback control based on imperfect Jacobian , 1991 .

[5]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Suguru Arimoto,et al.  A New Feedback Method for Dynamic Control of Manipulators , 1981 .

[7]  Fernando Torres Medina,et al.  Sensor data integration for indoor human tracking , 2010, Robotics Auton. Syst..

[8]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[9]  Jorge Pomares,et al.  Automatic robotic tasks in unstructured environments using an image path tracker , 2009 .

[10]  Jorge Pomares,et al.  Direct visual servo control of a robot to track trajectories in supervision tasks , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[11]  Patrick Rives,et al.  Robustness of image-based visual servoing with respect to depth distribution errors , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[13]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[14]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[15]  Francisco A. Candelas,et al.  Safe human-robot interaction based on dynamic sphere-swept line bounding volumes , 2011 .

[16]  Jorge Pomares,et al.  Adaptive Visual Servoing by Simultaneous Camera Calibration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.