Robust visual servo control of a mobile robot for object tracking in shape parameter space

In this paper, we develop a robust visual servo system for object tracking applications of a nonholonomic mobile robot. The system mainly consists of an adaptive shape tracking algorithm and a robust visual servo controller. The adaptive shape tracking algorithm is designed to automatically detect the shape contours of moving objects, extract the shape parameters, and continuously track the object in shape parameter space. Based on direct measurements of the shape parameters, the visual servo controller is designed by using the sliding mode control technique and is robust to uncertainties of the object's motion. Through a Lyapunov-based stability analysis, a sufficient condition on selection of control gains to achieve the tracking goal in finite time is provided.

[1]  Ju-Jang Lee,et al.  Visual tracking using Snake for object's discrete motion , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[2]  Cheng-Ming Huang,et al.  A robust visual servo system for tracking an arbitrary-shaped object by a new active contour method , 2004, Proceedings of the 2004 American Control Conference.

[3]  Fumio Miyazaki,et al.  Precise planar positioning using visual servoing based on coarse optical flow , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[4]  Chi-Cheng Cheng,et al.  Image following using the feature-based optical flow approach , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[5]  Norihiko Adachi,et al.  Image-based visual adaptive tracking control of nonholonomic mobile robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[6]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[7]  Li-Chen Fu,et al.  Robust real-time 3D trajectory tracking algorithms for visual tracking using weak perspective projection , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[8]  Andrew W. Fitzgibbon,et al.  Ellipse-specific direct least-square fitting , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[9]  Patrick Rives,et al.  Applying visual servoing techniques to control a mobile hand-eye system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[10]  Kevin Nickels,et al.  Model-based tracking of complex articulated objects , 2001, IEEE Trans. Robotics Autom..

[11]  Nikolaos Papanikolopoulos,et al.  The Minnesota robotic visual tracker: a flexible testbed for vision-guided robotic research , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[12]  Jitendra Malik,et al.  Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Dorin Comaniciu,et al.  Robust detection and tracking of human faces with an active camera , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[14]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[15]  Jong-Hann Jean,et al.  Adaptive visual tracking of moving objects modeled with unknown parameterized shape contour , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[16]  Peter K. Allen,et al.  Real-time visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[18]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[19]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[20]  F. Chaumette,et al.  Visual servoing using image features defined upon geometrical primitives , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[21]  Yasushi Yagi,et al.  Real-time human feature acquisition and human tracking by omnidirectional image sensor , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[22]  R. A. McLaughlin,et al.  Randomized Hough transform: better ellipse detection , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[23]  Danica Kragic,et al.  Tracking techniques for visual servoing tasks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[24]  Fan Xiaoping,et al.  Robotic visual servoing based on snakes , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).