New approach to visual servo control using terminal constraints

Abstract A large class of visual servo controllers relies on an a priori obtained reference image, captured at the desired position and orientation (i.e., pose) of a camera, to yield control signals to regulate the camera from its current pose to a desired pose. In many applications, accessibility and economics of the operation may prohibit acquisition of such a reference image. This paper introduces a new visual servo control paradigm that enables control of the camera in the absence of reference image using a set of terminal constraints. Specifically, the desired pose is encoded using the angle of obliquity of the optical axis with respect to the object plane and its direction of arrival at the plane. A constrained convex optimization problem is formulated over a conic section defined by the terminal constraints to yield an error system for the control problem. Subsequently, this work introduces continuous terminal sliding mode visual servo controllers to regulate the camera to the desired pose. Lyapunov-based stability analysis guarantees that the origin is a finite-time-stable equilibrium of the system. Numerical simulation results are provided to verify the performance of the proposed visual servo controller.

[1]  Guoqiang Hu,et al.  Homography-Based Visual Servo Control With Imperfect Camera Calibration , 2009, IEEE Transactions on Automatic Control.

[2]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[3]  Guillaume Morel,et al.  Explicit Incorporation of 2D Constraints in Vision Based Control of Robot Manipulators , 1999, ISER.

[4]  P. C. Chou,et al.  A survey of shaped-charge jet penetration models , 1988 .

[5]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[6]  M. Held,et al.  Penetration Theory for Inclined and Moving Shaped Charges , 1986 .

[7]  Hideki Nomura,et al.  Integrated visual servoing system to grasp industrial parts moving on conveyer by controlling 6DOF arm , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[8]  William MacKunis,et al.  Robust visual servo control in the presence of fruit motion for robotic citrus harvesting , 2016, Comput. Electron. Agric..

[9]  Warren E. Dixon,et al.  Adaptive 2.5D visual servoing of kinematically redundant robot manipulators , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[10]  François Chaumette,et al.  Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods , 2002, IEEE Trans. Robotics Autom..

[11]  Danica Kragic,et al.  Real-time tracking meets online grasp planning , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  Siddhartha S. Mehta,et al.  Vision-based control of robotic manipulator for citrus harvesting , 2014 .

[13]  Jochen Hemming,et al.  Analysis of a motion planning problem for sweet-pepper harvesting in a dense obstacle environment , 2016 .

[14]  Koichi Hashimoto,et al.  A review on vision-based control of robot manipulators , 2003, Adv. Robotics.

[15]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2006, IEEE Transactions on Robotics.

[16]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[17]  Jian Chen,et al.  2.5D visual servoing with a fixed camera , 2003, Proceedings of the 2003 American Control Conference, 2003..

[18]  Ying Wang,et al.  A modified image-based visual servo controller with hybrid camera configuration for robust robotic grasping , 2014, Robotics Auton. Syst..

[19]  Zhihong Man,et al.  Continuous finite-time control for robotic manipulators with terminal sliding mode , 2003, Autom..

[20]  Warren E. Dixon,et al.  Robust 2.5D visual servoing for robot manipulators , 2003, Proceedings of the 2003 American Control Conference, 2003..

[21]  Siddhartha S. Mehta,et al.  A geometric approach to visual servo control in the absence of reference image , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[22]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[23]  Koichiro Deguchi,et al.  Optimal motion control for image-based visual servoing by decoupling translation and rotation , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[24]  Guoqiang Hu,et al.  Adaptive Homography-Based Visual Servo Tracking Control via a Quaternion Formulation , 2010, IEEE Transactions on Control Systems Technology.

[25]  W.E. Dixon,et al.  Visual servo control of an unmanned ground vehicle via a moving airborne monocular camera , 2006, 2006 American Control Conference.

[26]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[27]  V. Jayaraman,et al.  Teach by zooming: A unified approach to visual servo control☆ , 2012 .

[28]  Warren E. Dixon,et al.  Single Camera Structure and Motion , 2012, IEEE Transactions on Automatic Control.

[29]  Peter Corke,et al.  VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW , 1993 .

[30]  S. Bhat,et al.  Lyapunov analysis of finite-time differential equations , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[31]  M.S. de Queiroz,et al.  Homography-based visual servoing of wheeled mobile robots , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[32]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[33]  Warren E. Dixon,et al.  An exponential Class of Visual Servoing controllers in the Presence of uncertain Camera Calibration , 2006, Int. J. Robotics Autom..

[34]  Rita Cunha,et al.  Landing on a moving target using image-based visual servo control , 2014, 53rd IEEE Conference on Decision and Control.

[35]  Warren E. Dixon,et al.  Globally exponentially stable observer for vision-based range estimation , 2012 .

[36]  Alessandro Astolfi,et al.  A new solution to the problem of range identification in perspective vision systems , 2005, IEEE Transactions on Automatic Control.

[37]  G.M. Siouris,et al.  Guided weapon control systems , 1983, Proceedings of the IEEE.

[38]  Robert E. Mahony,et al.  The landing problem of a VTOL Unmanned Aerial Vehicle on a moving platform using optical flow , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  N.R. Gans,et al.  Adaptive Vision-Based Collaborative Tracking Control of An UGV via a Moving Airborne Camera: A Daisy Chaining Approach , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.