A Study on Vision-Based Backstepping Control for a Target Tracking System

This paper proposes a new method to control the pose of a camera mounted on a two-axis gimbal system for visual servoing applications. In these applications, the camera should be stable while its line-of-sight points at a target located within the camera’s field of view. One of the most challenging aspects of these systems is the coupling in the gimbal kinematics as well as the imaging geometry. Such factors must be considered in the control system design process to achieve better control performances. The novelty of this study is that the couplings in both mechanism’s kinematics and imaging geometry are decoupled simultaneously by a new technique, so popular control methods can be easily implemented, and good tracking performances are obtained. The proposed control configuration includes a calculation of the gimbal’s desired motion taking into account the coupling influence, and a control law derived by the backstepping procedure. Simulation and experimental studies were conducted, and their results validate the efficiency of the proposed control system. Moreover, comparison studies are conducted between the proposed control scheme, the image-based pointing control, and the decoupled control. This proves the superiority of the proposed approach that requires fewer measurements and results in smoother transient responses.

[1]  K. Ohnishi,et al.  Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing , 2004, IEEE/ASME Transactions on Mechatronics.

[2]  Zhi Liu,et al.  Adaptive Visual Tracking Control for Manipulator With Actuator Fuzzy Dead-Zone Constraint and Unmodeled Dynamic , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Maher Abdo,et al.  Research on the Cross-Coupling of a Two Axes Gimbal System with Dynamic Unbalance , 2013 .

[4]  Zhe Jiang,et al.  Anti-Disturbance Neural-Sliding Mode Control for Inertially Stabilized Platform With Actuator Saturation , 2019, IEEE Access.

[5]  Xiangyang Liu,et al.  Modeling and Robust Continuous TSM Control for an Inertially Stabilized Platform With Couplings , 2020, IEEE Transactions on Control Systems Technology.

[6]  Haitao Li,et al.  Anti-Disturbance Control Based on Cascade ESO and Sliding Mode Control for Gimbal System of Double Gimbal CMG , 2020, IEEE Access.

[7]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[8]  Qing-Chang Zhong,et al.  Robust Control of Time-delay Systems , 2006 .

[9]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  J. M. Hilkert,et al.  Inertially stabilized platform technology Concepts and principles , 2008, IEEE Control Systems.

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  Zdenek Hurák,et al.  Combined line-of-sight inertial stabilization and visual tracking: application to an airborne camera platform , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[13]  Oliver Bimber,et al.  Fast and robust CAMShift tracking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[15]  Young Bok Kim,et al.  Implementation of Tracking-Learning-Detection for Improving of a Stereo-Camera-based Marker-less Distance Measurement System for Vessel Berthing , 2020, 2020 16th IEEE International Colloquium on Signal Processing & Its Applications (CSPA).

[16]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[17]  Zdenek Hurák,et al.  Image-Based Pointing and Tracking for Inertially Stabilized Airborne Camera Platform , 2012, IEEE Transactions on Control Systems Technology.

[18]  Jungwon Yoon,et al.  Adaptive vision-based control of an unmanned aerial vehicle without linear velocity measurements. , 2016, ISA transactions.

[19]  M.K. Masten,et al.  Inertially stabilized platforms for optical imaging systems , 2008, IEEE Control Systems.

[20]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[21]  Xuebo Zhang,et al.  Visual Servoing of Wheeled Mobile Robots Without Desired Images , 2019, IEEE Transactions on Cybernetics.

[22]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Shihua Li,et al.  Robust predictive visual servoing control for an inertially stabilized platform with uncertain kinematics. , 2021, ISA transactions.

[25]  Karl J. Åström,et al.  Limitations on control system performance , 1997, 1997 European Control Conference (ECC).

[26]  Xinwu Liang,et al.  Image-Based Visual Servoing of a Quadrotor Using Virtual Camera Approach , 2017, IEEE/ASME Transactions on Mechatronics.

[27]  Peter J. Kennedy,et al.  Direct versus indirect line of sight (LOS) stabilization , 2003, IEEE Trans. Control. Syst. Technol..

[28]  R. Fuentes,et al.  Global analysis of the double-gimbal mechanism , 2008, IEEE Control Systems.

[29]  Sanjeev Kumar,et al.  Wireless hybrid visual servoing of omnidirectional wheeled mobile robots , 2016, Robotics Auton. Syst..

[30]  Teng Shang,et al.  Dynamic Modeling and Coupling Characteristic Analysis of Two-Axis Rate Gyro Seeker , 2018 .

[31]  Tariq Samad,et al.  Encyclopedia of Systems and Control , 2015 .

[32]  Ian D. Reid,et al.  Visual Tracking at Sea , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[33]  Rita Cunha,et al.  Landing of a Quadrotor on a Moving Target Using Dynamic Image-Based Visual Servo Control , 2016, IEEE Transactions on Robotics.