Visual tracking of mobile robots with both velocity and acceleration saturation constraints

Abstract In this paper, an adaptive visual tracking controller is proposed for the nonholonomic mobile robot with an onboard monocular camera, wherein both the velocity and acceleration saturation constraints can be guaranteed by properly selecting the control parameters during the visual servoing process. Specifically, the virtual velocity-level controller is firstly designed based on the first-order filter, by which the bounds of the virtual velocity signals can be estimated. Then, according to the finite-time control theory, the actual acceleration-level controller is developed to track the virtual velocity input in a finite time. For the unknown distance between the plane of feature points and the origin of the global frame due to the lack of the image depth, an adaptive updating law is designed and also used for the parameter identification. The global asymptotical stability of the closed-loop system is proven using Lyapunov techniques with Barbalat’s lemma. The calculations for the upper bounds of velocity and acceleration signals are given. In addition, some tips for the control gains tuning in practical experiments are summarized. Experimental results are provided to validate the effectiveness of the proposed controller.

[1]  Zhijun Li,et al.  Robust Tube-Based Predictive Control for Visual Servoing of Constrained Differential-Drive Mobile Robots , 2018, IEEE Transactions on Industrial Electronics.

[2]  Yongchun Fang,et al.  Visual servoing of mobile robots for posture stabilization: from theory to experiments , 2015 .

[3]  Izabela Nielsen,et al.  A methodology for implementation of mobile robot in adaptive manufacturing environments , 2017, J. Intell. Manuf..

[4]  Venkatesh K. Subramanian,et al.  A Novel Vision-Based Tracking Algorithm for a Human-Following Mobile Robot , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Liguang Xu,et al.  New Results for Studying a Certain Class of Nonlinear Delay Differential Systems , 2010, IEEE Transactions on Automatic Control.

[6]  M. Michaek,et al.  Vector-Field-Orientation Feedback Control Method for a Differentially Driven Vehicle , 2010, IEEE Transactions on Control Systems Technology.

[7]  Jian Chen,et al.  Trifocal Tensor-Based Adaptive Visual Trajectory Tracking Control of Mobile Robots , 2017, IEEE Transactions on Cybernetics.

[8]  Changyin Sun,et al.  Adaptive Neural Impedance Control of a Robotic Manipulator With Input Saturation , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Jinfa Chen,et al.  A Human-Following Mobile Robot Providing Natural and Universal Interfaces for Control With Wireless Electronic Devices , 2019, IEEE/ASME Transactions on Mechatronics.

[10]  Bahram Tarvirdizadeh,et al.  Control of tractor-trailer wheeled robots considering self-collision effect and actuator saturation limitations , 2019, Mechanical Systems and Signal Processing.

[11]  Jian Chen,et al.  Visual Tracking and Depth Estimation of Mobile Robots Without Desired Velocity Information , 2020, IEEE Transactions on Cybernetics.

[12]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[13]  Nicholas R. Gans,et al.  Unified Tracking and Regulation Visual Servo Control for Wheeled Mobile Robots , 2007, 2007 IEEE International Conference on Control Applications.

[14]  Dennis S. Bernstein,et al.  Finite-Time Stability of Continuous Autonomous Systems , 2000, SIAM J. Control. Optim..

[15]  Yu Qiu,et al.  Visual Servo Tracking of Wheeled Mobile Robots With Unknown Extrinsic Parameters , 2019, IEEE Transactions on Industrial Electronics.

[16]  Bao-Zhu Guo,et al.  On convergence of tracking differentiator and application to frequency estimation of sinusoidal signals , 2011, 2011 8th Asian Control Conference (ASCC).

[17]  Hua Chen,et al.  Robust stabilization for a class of dynamic feedback uncertain nonholonomic mobile robots with input saturation , 2014 .

[18]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[19]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[20]  Xuebo Zhang,et al.  Visual Servoing of Nonholonomic Mobile Robots With Uncalibrated Camera-to-Robot Parameters , 2017, IEEE Transactions on Industrial Electronics.

[21]  Liang Ding,et al.  A multi-mode real-time terrain parameter estimation method for wheeled motion control of mobile robots , 2018 .

[22]  Krzysztof Kozlowski,et al.  Vector-Field-Orientation Feedback Control Method for a Differentially Driven Vehicle , 2010, IEEE Trans. Control. Syst. Technol..

[23]  Liang Sun,et al.  Extended state observer augmented finite-time trajectory tracking control of uncertain mechanical systems , 2020 .

[24]  Eduardo Zalama Casanova,et al.  Long-term assessment of a service robot in a hotel environment , 2016, Robotics Auton. Syst..

[25]  Chun-Yi Su,et al.  Vision-Based Model Predictive Control for Steering of a Nonholonomic Mobile Robot , 2016, IEEE Transactions on Control Systems Technology.

[26]  Charalampos P. Bechlioulis,et al.  Robust Image-Based Visual Servoing With Prescribed Performance Under Field of View Constraints , 2019, IEEE Transactions on Robotics.

[27]  Yingmin Jia,et al.  Simple tracking controller for unicycle-type mobile robots with velocity and torque constraints , 2015 .

[28]  Zhong-Ping Jiang,et al.  Saturated stabilization and tracking of a nonholonomic mobile robot , 2001 .

[29]  Antonio Bicchi,et al.  Shortest paths for wheeled robots with limited Field-Of-View: Introducing the vertical constraint , 2013, 52nd IEEE Conference on Decision and Control.

[30]  Jian Chen,et al.  Unified Visual Servoing Tracking and Regulation of Wheeled Mobile Robots With an Uncalibrated Camera , 2018, IEEE/ASME Transactions on Mechatronics.

[31]  Warren E. Dixon,et al.  Global exponential tracking control of a mobile robot system via a PE condition , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[32]  Xuebo Zhang,et al.  Acceleration-Level Pseudo-Dynamic Visual Servoing of Mobile Robots With Backstepping and Dynamic Surface Control , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Zewei Zheng,et al.  Path Following of a Surface Vessel With Prescribed Performance in the Presence of Input Saturation and External Disturbances , 2017, IEEE/ASME Transactions on Mechatronics.

[34]  Gang Sun,et al.  Adaptive Image-Based Visual Servoing With Temporary Loss of the Visual Signal , 2019, IEEE Transactions on Industrial Informatics.

[35]  Zhong-Ping Jiang,et al.  Adaptive stabilization and tracking control of a nonholonomic mobile robot with input saturation and disturbance , 2013, Syst. Control. Lett..

[36]  Xi Liu,et al.  Motion-Estimation-Based Visual Servoing of Nonholonomic Mobile Robots , 2011, IEEE Transactions on Robotics.

[37]  Xuebo Zhang,et al.  Visual Servo Regulation of Wheeled Mobile Robots With Simultaneous Depth Identification , 2018, IEEE Transactions on Industrial Electronics.

[38]  Haoping Wang,et al.  Vision servoing of robot systems using piecewise continuous controllers and observers , 2012 .

[39]  David A. Lizárraga,et al.  Obstructions to the Existence of Universal Stabilizers for Smooth Control Systems , 2004, Math. Control. Signals Syst..

[40]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2006, IEEE Transactions on Robotics.