Adaptive control of nonlinear visual servoing systems for 3D cartesian tracking

This paper presents a control strategy for robot manipulators to perform 3D cartesian tracking using visual servoing. Considering a fixed camera, the 3D cartesian motion is decomposed in a 2D motion on a plane orthogonal to the optical axis and a 1D motion parallel to this axis. An image-based visual servoing approach is used to deal with the nonlinear control problem generated by the depth variation without requiring direct depth estimation. Due to the lack of camera calibration, an adaptive control method is used to ensure both depth and planar tracking in the image frame. The depth feedback loop is closed by measuring the image area of a target object attached to the robot end-effector. Simulation and experimental results obtained with a real robot manipulator illustrate the viability of the proposed scheme.