A switched systems approach to vision-based tracking control of wheeled mobile robots

Conventional methods for image-based guidance, navigation, and control of a wheeled mobile robot (WMR) require continuous, uninterrupted state feedback at all times. However, tracked features may be lost due to occlusions or the trajectory of the WMR. In this paper, a set of dwell time conditions that can be used for trajectory design have been developed to relax the constant visibility constraint, while maintaining the ability to self-localize and track a desired trajectory. The use of a predictor for state estimates when landmark features are not visible helps to extend the time before image feedback of landmark features is required. Using Lyapunov-based switched systems analysis methods, maximum and minimum dwell time conditions are derived for periods when features are visible or not. A simulation is performed with a trajectory formed by Bézier splines to demonstrate a globally uniformly ultimately bounded trajectory tracking result despite intermittent measurements.

[1]  Guoqiang Hu,et al.  Adaptive Homography-Based Visual Servo Tracking Control via a Quaternion Formulation , 2010, IEEE Transactions on Control Systems Technology.

[2]  Anup Parikh,et al.  A Switched Systems Approach to Image-Based Localization of Targets That Temporarily Leave the Camera Field of View , 2018, IEEE Transactions on Control Systems Technology.

[3]  Warren E. Dixon,et al.  Homography-based visual servo regulation of mobile robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Guoqiang Hu,et al.  Adaptive visual servo control to simultaneously stabilize image and pose error , 2012 .

[5]  Guoqiang Hu,et al.  Quaternion-Based Visual Servo Control in the Presence of Camera Calibration Error , 2007, 2007 IEEE International Conference on Control Applications.

[6]  Massimo Callegari,et al.  A Comparison between Position-Based and Image-Based Dynamic Visual Servoings in the Control of a Translating Parallel Manipulator , 2012, J. Robotics.

[7]  Patrick Rives,et al.  Applying visual servoing techniques to control a mobile hand-eye system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[8]  Dong-Soo Kwon,et al.  Mobile robots at your fingertip: Bezier curve on-line trajectory generation for supervisory control , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  Warren E. Dixon,et al.  Navigation function based visual servo control , 2005 .

[10]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Peter I. Corke,et al.  Performance tests of partitioned approaches to visual servo control , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  D. Mayne.  Nonlinear and Adaptive Control Design [Book Review] , 1996, IEEE Transactions on Automatic Control.

[13]  Guoqiang Hu,et al.  Multi-Reference Visual Servo Control of an Unmanned Ground Vehicle , 2008 .

[14]  Guoqiang Hu,et al.  Homography-Based Visual Servo Control With Imperfect Camera Calibration , 2009, IEEE Transactions on Automatic Control.

[15]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[17]  Warren E. Dixon,et al.  Euclidean Calculation of Feature Points of a Rotating Satellite: A Daisy Chaining Approach , 2007, ACC.

[18]  Bingxi Jia,et al.  Switched visual servo control of nonholonomic mobile robots with field-of-view constraints based on homography , 2015 .

[19]  Anup Parikh,et al.  Unified Tracking and Regulation Visual Servo Control for Wheeled Mobile Robots , 2014 .

[20]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Nicholas R. Gans,et al.  A Stable Vision-Based Control Scheme for Nonholonomic Vehicles to Keep a Landmark in the Field of View , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  N.R. Gans,et al.  Visual servoing to an arbitrary pose with respect to an object given a single known length , 2008, 2008 American Control Conference.

[23]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[24]  Gil Jin Yang,et al.  Smooth Trajectory Planning Along Bezier Curve for Mobile Robots with Velocity Constraints , 2013 .

[25]  Warren E. Dixon,et al.  Nonlinear Control of Engineering Systems , 2002 .

[26]  D. Dawson,et al.  Robust tracking and regulation control for mobile robots , 1999, Proceedings of the 1999 IEEE International Conference on Control Applications (Cat. No.99CH36328).

[27]  Wolfram Burgard,et al.  Kinodynamic motion planning for mobile robots using splines , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Warren E. Dixon,et al.  Adaptive homography-based visual servo tracking , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[29]  W. E. Dixon,et al.  Keeping multiple objects in the field of view of a single PTZ camera , 2009, 2009 American Control Conference.

[30]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.