Hybrid Position and Image Based Visual Servoing for mobile robots

Visual servoing requires the target object to be in the field of view of the camera all the time. At the same time, we also want to achieve optimal path planning and controllability of the robot pose. This paper presents a new hybrid fuzzy control method for visual servoing of mobile robots to meet these requirements. IBVS (Image Based Visual Servoing) calculates the motion plan directly from the image space using the inverse image Jacobian so that the target object always stays within the field of view. In contrast, PBVS (Position Based Visual Servoing) uses an image-to-work space transform to plan an optimal pose trajectory directly in the cartesian. The proposed fuzzy control then integrates these two types of visual servoing through a warning signal indicating the target may escape the field of view. Also, we use the neural network for the prediction of the target position for a robust timely tracking of the object. Simulation and real experimental work based on MORIS, our mobile robot test bed, verify the efficacy of this approach.

[1]  Masayuki Inaba,et al.  View-based approach to robot navigation , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[2]  F. Miyazaki,et al.  Visual servoing for non-holonomic mobile robots , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[3]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[4]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[5]  Domenico Prattichizzo,et al.  An auto-epipolar strategy for mobile robot visual servoing , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[6]  Christophe Collewet,et al.  Positioning a camera with respect to planar objects of unknown shape by coupling 2-D visual servoing and 3-D estimations , 2002, IEEE Trans. Robotics Autom..

[7]  Lixin Tang,et al.  Indoor navigation for mobile robots using memorized omni-directional images and robot's motion , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  James P. Ostrowski,et al.  Optimal motion planning in the image plane for mobile robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Se-Young Oh,et al.  Image-based visual servoing for mobile robots using neural networks and fuzzy-evolutionary methods , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[11]  Robin R. Murphy,et al.  Low-order-complexity vision-based docking , 2001, IEEE Trans. Robotics Autom..

[12]  Tieniu Tan,et al.  Mobile robot self-localization based on global visual appearance features , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[13]  Darius Burschka,et al.  Vision-based control of mobile robots , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[14]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Li-Xin Wang,et al.  A Course In Fuzzy Systems and Control , 1996 .

[16]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[17]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[18]  James L. Crowley,et al.  Appearance based process for visual navigation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.