A Framework for Visual Servoing Tasks

A general framework for visual servoing tasks is proposed. The objective of the paper is twofold: a) how a complicated servoing task might be composed from a multitude of simple ones, and b) how the integration of basic and simple visual algorithms can be used in order to provide a robust input estimate to a control loop for a mobile platform or a robot manipulator. For that purpose, voting schema and consensus theory approaches are investigated together with some initial vision based algorithms. Voting is known as a model–free approach to integration and therefore interesting for applications in real–world environments which are difficult to model. It is experimentally shown how servoing tasks like pick–and–place, opening doors and fetching mail can be robustly performed using the proposed approach.

[1]  Patrick Rives,et al.  Applying visual servoing techniques to control a mobile hand-eye system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[2]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[3]  Douglas M. Blough,et al.  Voting using predispositions , 1994 .

[4]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision: A New Breed of Technical Beings? , 1998, Artif. Intell..

[5]  Hans-Hellmut Nagel,et al.  3D Pose Estimation by Directly Matching Polyhedral Models to Gray Value Gradients , 1997, International Journal of Computer Vision.

[6]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[7]  Hector Garcia-Molina,et al.  The Reliability of Voting Mechanisms , 1987, IEEE Transactions on Computers.

[8]  W. M. Wonham,et al.  The control of discrete event systems , 1989 .

[9]  Martin D. Levine,et al.  Low Level Image Segmentation: An Expert System , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Gregory D. Hager,et al.  Joint probabilistic techniques for tracking objects using multiple visual cues , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[11]  Henrik I. Christensen,et al.  Decision-theoretic multisensor planning and integration for mobile robot navigation , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[12]  Gregory D. Hager,et al.  Calibration-free visual control using projective invariance , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Henrik I. Christensen,et al.  Application of voting to fusion of purposive modules: An experimental investigation , 1998, Robotics Auton. Syst..

[14]  Johannes R. Sveinsson,et al.  Hybrid consensus theoretic classification , 1996, IGARSS '96. 1996 International Geoscience and Remote Sensing Symposium.

[15]  Richard Y. Kain,et al.  Vote Assignments in Weighted Voting Mechanisms , 1991, IEEE Trans. Computers.

[16]  Danica Kragic,et al.  Integration of visual cues for active tracking of an end-effector , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[17]  B. Parhami.  Voting algorithms , 1994 .