Adaptive Trajectory Tracking of Nonholonomic Mobile Robots Using Vision-Based Position and Velocity Estimation

Despite tremendous efforts made for years, trajectory tracking control (TC) of a nonholonomic mobile robot (NMR) without global positioning system remains an open problem. The major reason is the difficulty to localize the robot by using its onboard sensors only. In this paper, a newly designed adaptive trajectory TC method is proposed for the NMR without its position, orientation, and velocity measurements. The controller is designed on the basis of a novel algorithm to estimate position and velocity of the robot online from visual feedback of an omnidirectional camera. It is theoretically proved that the proposed algorithm yields the TC errors to asymptotically converge to zero. Real-world experiments are conducted on a wheeled NMR to validate the feasibility of the control system.

[1]  Rita Cunha,et al.  Landing of a Quadrotor on a Moving Target Using Dynamic Image-Based Visual Servo Control , 2016, IEEE Transactions on Robotics.

[2]  Tao Liu,et al.  Adaptive Image-Based Trajectory Tracking Control of Wheeled Mobile Robots With an Uncalibrated Fixed Camera , 2015, IEEE Transactions on Control Systems Technology.

[3]  Warren E. Dixon,et al.  Homography-based visual servo regulation of mobile robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  René Vidal,et al.  Multiframe Motion Segmentation with Missing Data Using PowerFactorization and GPCA , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2006, IEEE Transactions on Robotics.

[6]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[7]  Rong Xiong,et al.  Stereo Visual-Inertial Odometry With Multiple Kalman Filters Ensemble , 2016, IEEE Transactions on Industrial Electronics.

[8]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[9]  Jian Chen,et al.  Trifocal Tensor-Based Adaptive Visual Trajectory Tracking Control of Mobile Robots , 2017, IEEE Transactions on Cybernetics.

[10]  Vijay Kumar,et al.  Real-time vision-based control of a nonholonomic mobile robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Renquan Lu,et al.  Vision-Based Human Tracking Control of a Wheeled Inverted Pendulum Robot , 2016, IEEE Transactions on Cybernetics.

[12]  Fumio Miyazaki,et al.  A stable tracking control method for a non-holonomic mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[13]  Yunhui Liu,et al.  Estimating Position of Mobile Robots From Omnidirectional Vision Using an Adaptive Algorithm , 2015, IEEE Transactions on Cybernetics.

[14]  Georges Bastin,et al.  Stability analysis of a vision-based control design for an autonomous mobile robot , 2006, IEEE Transactions on Robotics.

[15]  Steven Mills,et al.  Correcting Scale Drift by Object Recognition in Single-Camera SLAM , 2013, IEEE Transactions on Cybernetics.

[16]  Gwi-Tae Park,et al.  Improvement of the inertial sensor-based localization for mobile robots using multiple estimation windows filter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Yunhui Liu,et al.  Visual Servoing Trajectory Tracking of Nonholonomic Mobile Robots Without Direct Position Measurement , 2014, IEEE Transactions on Robotics.

[18]  Dongkyoung Chwa,et al.  Sliding-mode tracking control of nonholonomic wheeled mobile robots in polar coordinates , 2004, IEEE Transactions on Control Systems Technology.

[19]  Max Q.-H. Meng,et al.  A Bioinspired Neurodynamics-Based Approach to Tracking Control of Mobile Robots , 2012, IEEE Transactions on Industrial Electronics.

[20]  Angela P. Schoellig,et al.  Learning-based nonlinear model predictive control to improve vision-based mobile robot path-tracking in challenging outdoor environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Éric Marchand,et al.  3-D Model-Based Tracking for UAV Indoor Localization , 2015, IEEE Transactions on Cybernetics.

[22]  Nicholas R. Gans,et al.  Tracking Control of Mobile Robots Localized via Chained Fusion of Discrete and Continuous Epipolar Geometry, IMU and Odometry , 2013, IEEE Transactions on Cybernetics.

[23]  Chia-Feng Juang,et al.  Evolutionary Fuzzy Control and Navigation for Two Wheeled Robots Cooperatively Carrying an Object in Unknown Environments , 2015, IEEE Transactions on Cybernetics.

[24]  Giuseppe Oriolo,et al.  Visual servoing for path reaching with nonholonomic robots , 2011, Robotica.

[25]  Davide Scaramuzza,et al.  1-Point-RANSAC Structure from Motion for Vehicle-Mounted Cameras by Exploiting Non-holonomic Constraints , 2011, International Journal of Computer Vision.

[26]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[27]  Henk Nijmeijer,et al.  Tracking Control of Mobile Robots: A Case Study in Backstepping , 1997, Autom..

[28]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[29]  Emanuele Menegatti,et al.  A robust and easy to implement method for IMU calibration without external equipments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[30]  J. Slotine,et al.  On the Adaptive Control of Robot Manipulators , 1987 .

[31]  I-Ming Chen,et al.  3-D Localization of Human Based on an Inertial Capture System , 2013, IEEE Transactions on Robotics.

[32]  Farrokh Janabi-Sharifi,et al.  A Robust Vision-Based Sensor Fusion Approach for Real-Time Pose Estimation , 2014, IEEE Transactions on Cybernetics.