Visual Servoing of Wheeled Mobile Robots Without Desired Images

This paper proposes a novel monocular visual servoing strategy, which can drive a wheeled mobile robot to the desired pose without a prerecorded desired image. Compared with existing methods that adopt the teaching pattern for visual regulation, this scheme can still work well in the situation that the desired image has not been previously acquired. Thus, with the aid of this method, it is more convenient for mobile robots to execute visual servoing tasks. Specifically, to deal with nonexistence of the desired image, the reference frame is craftily defined by taking advantage of visual targets and the planar motion constraint, and the pose estimation algorithm is designed for the mobile robot with respect to the reference frame. Then, an adaptive visual regulation controller is developed to drive the mobile robot to the intermediate frame, where the parameter updating law is constructed for the unknown feature height based on the concurrent learning framework. Stability analysis shows that regulation errors and height identification error can converge simultaneously. Afterwards, the mobile robot is driven to the metric desired pose with the identified feature height. Both simulation and experimental results are provided to validate the performance of this strategy.

[1]  Xi Liu,et al.  Adaptive Active Visual Servoing of Nonholonomic Mobile Robots , 2012, IEEE Transactions on Industrial Electronics.

[2]  Xinwu Liang,et al.  Visual Servoing of Soft Robot Manipulator in Constrained Environments With an Adaptive Controller , 2017, IEEE/ASME Transactions on Mechatronics.

[3]  Rong Xiong,et al.  Stereo Visual-Inertial Odometry With Multiple Kalman Filters Ensemble , 2016, IEEE Transactions on Industrial Electronics.

[4]  Warren E. Dixon,et al.  Globally exponentially stable observer for vision-based range estimation , 2012 .

[5]  Dong Sun,et al.  Moving Groups of Microparticles Into Array With a Robot–Tweezers Manipulation System , 2012, IEEE Transactions on Robotics.

[6]  Xuebo Zhang,et al.  Visual Servoing of Nonholonomic Mobile Robots With Uncalibrated Camera-to-Robot Parameters , 2017, IEEE Transactions on Industrial Electronics.

[7]  Chaoli Wang,et al.  Adaptive tracking control for dynamic nonholonomic mobile robots with uncalibrated visual parameters , 2013 .

[8]  Guoqiang Hu,et al.  Homography-Based Visual Servo Control With Imperfect Camera Calibration , 2009, IEEE Transactions on Automatic Control.

[9]  Fabio Morbidi,et al.  Practical and accurate calibration of RGB-D cameras using spheres , 2015, Comput. Vis. Image Underst..

[10]  Chun-Yi Su,et al.  Vision-Based Model Predictive Control for Steering of a Nonholonomic Mobile Robot , 2016, IEEE Transactions on Control Systems Technology.

[11]  Warren E. Dixon,et al.  Range and Motion Estimation of a Monocular Camera Using Static and Moving Objects , 2016, IEEE Transactions on Control Systems Technology.

[12]  Abolfazl Mohebbi,et al.  Augmented Image-Based Visual Servoing of a Manipulator Using Acceleration Command , 2014, IEEE Transactions on Industrial Electronics.

[13]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2006, IEEE Transactions on Robotics.

[14]  Guoqiang Hu,et al.  Adaptive Task-Space Cooperative Tracking Control of Networked Robotic Manipulators Without Task-Space Velocity Measurements , 2016, IEEE Transactions on Cybernetics.

[15]  Antonio Bicchi,et al.  A Hybrid-Control Approach to the Parking Problem of a Wheeled Vehicle Using Limited View-Angle Visual Feedback , 2004, Int. J. Robotics Res..

[16]  Christophe Collewet,et al.  Photometric Visual Servoing , 2011, IEEE Transactions on Robotics.

[17]  Hsi-Yuan Chen,et al.  Homography based visual servo control with scene reconstruction , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[18]  Jianbo Su,et al.  Robust uncalibrated visual servoing control based on disturbance observer. , 2015, ISA transactions.

[19]  Antonio Bicchi,et al.  Shortest Paths for a Robot With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Robotics.

[20]  Yongchun Fang,et al.  Visual servoing of mobile robots for posture stabilization: from theory to experiments , 2015 .

[21]  Éric Marchand,et al.  Photometric visual servoing for omnidirectional cameras , 2013, Autonomous Robots.

[22]  Giuseppe Oriolo,et al.  Feature Depth Observation for Image-based Visual Servoing: Theory and Experiments , 2008, Int. J. Robotics Res..

[23]  Yunhui Liu,et al.  On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments , 2014, Int. J. Robotics Res..

[24]  Nicholas R. Gans,et al.  Tracking Control of Mobile Robots Localized via Chained Fusion of Discrete and Continuous Epipolar Geometry, IMU and Odometry , 2013, IEEE Transactions on Cybernetics.

[25]  Yunhui Liu,et al.  Visual Servoing Trajectory Tracking of Nonholonomic Mobile Robots Without Direct Position Measurement , 2014, IEEE Transactions on Robotics.

[26]  Yong Liu,et al.  Filtering Based Adaptive Visual Odometry Sensor Framework Robust to Blurred Images , 2016, Sensors.

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[29]  Guoqiang Hu,et al.  Lyapunov-Based Range Identification For Paracatadioptric Systems , 2006, IEEE Transactions on Automatic Control.

[30]  Graziano Chesi,et al.  Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations , 2009, IEEE Transactions on Robotics.

[31]  Guoqiang Hu,et al.  Adaptive visual servo control to simultaneously stabilize image and pose error , 2012 .

[32]  Xuebo Zhang,et al.  Visual Servo Regulation of Wheeled Mobile Robots With Simultaneous Depth Identification , 2018, IEEE Transactions on Industrial Electronics.

[33]  Éric Marchand,et al.  A Dense and Direct Approach to Visual Servoing Using Depth Maps , 2014, IEEE Transactions on Robotics.

[34]  Kamal K. Gupta,et al.  Randomized Kinodynamic Planning for Robust Visual Servoing , 2013, IEEE Transactions on Robotics.

[35]  Girish Chowdhary,et al.  Concurrent learning adaptive control of linear systems with exponentially convergent bounds , 2013 .

[36]  Ning Sun,et al.  Nonlinear Stabilizing Control for Ship-Mounted Cranes With Ship Roll and Heave Movements: Design, Analysis, and Experiments , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Geraldo F. Silveira,et al.  On Intensity-Based Nonmetric Visual Servoing , 2014, IEEE Transactions on Robotics.

[39]  Jian-Bo Su,et al.  Motion Planning and Coordination for Robot Systems Based on Representation Space , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  W. Wilson,et al.  Comparison of Basic Visual Servoing Methods , 2011, IEEE/ASME Transactions on Mechatronics.

[41]  Xiaogao Xie,et al.  Decision Making and Finite-Time Motion Control for a Group of Robots , 2013, IEEE Transactions on Cybernetics.

[42]  Jian Chen,et al.  Trifocal Tensor-Based Adaptive Visual Trajectory Tracking Control of Mobile Robots , 2017, IEEE Transactions on Cybernetics.

[43]  François Chaumette,et al.  Distance-Based and Orientation-Based Visual Servoing From Three Points , 2011, IEEE Transactions on Robotics.

[44]  Marilena Vendittelli,et al.  WMR control via dynamic feedback linearization: design, implementation, and experimental validation , 2002, IEEE Trans. Control. Syst. Technol..