Image-Based Position Control of Mobile Robots With a Completely Unknown Fixed Camera

In this paper, we consider the position control problem of nonholonomic mobile robots, i.e., the regulation of mobile robots to a desired position specified by the image position of a feature point onboard the mobile robot, by using visual feedback information from an overhead fixed camera. Many vision-based control approaches have been proposed for motion control of nonholonomic mobile robots, however, they usually assume that exact or approximate knowledge of full/partial intrinsic and/or extrinsic parameters of the camera can be available, and large or even very small errors in these parameters can deteriorate the control performance, reduce the control accuracy, and even affect the system stability. Hence, it is interesting and highly desirable to develop vision-based controllers without depending on the camera parameters, from both control performance and controller implementation perspectives. With this in mind, we propose novel image-based position control schemes for nonholonomic mobile robots completely without knowing the camera parameters. In the proposed schemes, neither accurate nor approximate knowledge about the camera intrinsic and extrinsic parameters is required, and the totally unknown camera can be mounted on the ceiling with an arbitrary pose, which can make the controller implementation very simple and flexible. Experimental results are provided to show the feasibility and effectiveness of the proposed schemes.

[1]  Hanlei Wang,et al.  Adaptive visual tracking for robotic systems without image-space velocity measurement , 2014, Autom..

[2]  Danica Kragic,et al.  Switching visual control based on epipoles for mobile robots , 2008, Robotics Auton. Syst..

[3]  Hanlei Wang Adaptive Visual Tracking for Robotic Systems Without Visual Velocity Measurement , 2014, ArXiv.

[4]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Warren E. Dixon,et al.  Adaptive tracking control of a wheeled mobile robot via an uncalibrated camera system , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Vijay Kumar,et al.  Real-time vision-based control of a nonholonomic mobile robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[8]  A. Bloch,et al.  Control and stabilization of nonholonomic dynamic systems , 1992 .

[9]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[10]  Nicholas R. Gans,et al.  A Stable Vision-Based Control Scheme for Nonholonomic Vehicles to Keep a Landmark in the Field of View , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[11]  Devin J. Balkcom,et al.  Time Optimal Trajectories for Bounded Velocity Differential Drive Vehicles , 2002, Int. J. Robotics Res..

[12]  Yunhui Liu,et al.  Visual Servoing Trajectory Tracking of Nonholonomic Mobile Robots Without Direct Position Measurement , 2014, IEEE Transactions on Robotics.

[13]  Antonio Bicchi,et al.  A Hybrid-Control Approach to the Parking Problem of a Wheeled Vehicle Using Limited View-Angle Visual Feedback , 2004, Int. J. Robotics Res..

[14]  Siddhartha S. Mehta,et al.  Visual Servo Control of an Unmanned Ground Vehicle via a Moving Airborne Monocular Camera , 2006 .

[15]  Guoqiang Hu,et al.  Model-Free Unified Tracking and Regulation Visual Servoing of Wheeled Mobile Robots , 2016, IEEE Transactions on Control Systems Technology.

[16]  Guoqiang Hu,et al.  Homography-Based Visual Servo Control With Imperfect Camera Calibration , 2009, IEEE Transactions on Automatic Control.

[17]  A. Astolfi Discontinuous control of nonholonomic systems , 1996 .

[18]  Zhong-Ping Jiang,et al.  A recursive technique for tracking control of nonholonomic systems in chained form , 1999, IEEE Trans. Autom. Control..

[19]  Warren E. Dixon,et al.  Adaptive tracking and regulation of a wheeled mobile robot with controller/update law modularity , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[20]  James P. Ostrowski,et al.  Visual motion planning for mobile robots , 2002, IEEE Trans. Robotics Autom..

[21]  Fang Yang,et al.  Adaptive Stabilization for Uncertain Nonholonomic Dynamic Mobile Robots Based on Visual Servoing Feedback , 2011 .

[22]  Xinwu Liang,et al.  Adaptive image-based visual servoing of wheeled mobile robots with fixed camera configuration , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[24]  Gonzalo López-Nicolás,et al.  A Sliding-Mode-Control Law for Mobile Robots Based on Epipolar Visual Servoing From Three Views , 2011, IEEE Transactions on Robotics.

[25]  Warren E. Dixon,et al.  Homography-based visual servo regulation of mobile robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Rafael Murrieta-Cid,et al.  Optimal Paths for Landmark-Based Navigation by Differential-Drive Vehicles With Field-of-View Constraints , 2007, IEEE Transactions on Robotics.

[27]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[28]  Ying Wang,et al.  A Hybrid Visual Servo Controller for Robust Grasping by Wheeled Mobile Robots , 2010, IEEE/ASME Transactions on Mechatronics.

[29]  Yunhui Liu,et al.  A unified design method for adaptive visual tracking control of robots with eye-in-hand/fixed camera configuration , 2015, Autom..

[30]  Helder Araújo,et al.  Visual servoing of mobile robots using non-central catadioptric cameras , 2014, Robotics Auton. Syst..

[31]  Xi Liu,et al.  Adaptive Active Visual Servoing of Nonholonomic Mobile Robots , 2012, IEEE Transactions on Industrial Electronics.

[32]  Yunhui Liu,et al.  Estimating Position of Mobile Robots From Omnidirectional Vision Using an Adaptive Algorithm , 2015, IEEE Transactions on Cybernetics.

[33]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2006, IEEE Transactions on Robotics.

[34]  Tao Liu,et al.  Adaptive Image-Based Trajectory Tracking Control of Wheeled Mobile Robots With an Uncalibrated Fixed Camera , 2015, IEEE Transactions on Control Systems Technology.

[35]  Xi Liu,et al.  Motion-Estimation-Based Visual Servoing of Nonholonomic Mobile Robots , 2011, IEEE Transactions on Robotics.

[36]  Guoqiang Hu,et al.  Quaternion-Based Visual Servo Control in the Presence of Camera Calibration Error , 2007, 2007 IEEE International Conference on Control Applications.

[37]  R. Kelly,et al.  Image-based visual control of nonholonomic mobile robots via velocity fields: Case of partially calibrated inclined camera , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[38]  Chien Chern Cheah,et al.  Task-space PD Control of Robot Manipulators: Unified Analysis and Duality Property , 2008, Int. J. Robotics Res..

[39]  Carlos Sagüés,et al.  A single visual-servo controller of mobile robots with super-twisting control , 2014, Robotics Auton. Syst..

[40]  Norihiko Adachi,et al.  Image-based visual adaptive tracking control of nonholonomic mobile robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).