Automatic selection of image features for visual servoing

The problem of automatically selecting the image features is an important aspect of visual servoing systems. This paper addresses the main issues relevant to automatic features selection in the context of visual servoing. The constraints imposed by the task, the feature extraction and state estimation processes are derived. The quality measures are formulated and a features selection strategy is introduced. In addition to the features selection, the proposed methodology provides the automatic selection of windows for the target features during the servoing. Also it can be applied for optimal vision sensor positioning. The design and implementation of an automatic CAD-based features selector (AFS) using the proposed methodology has been achieved. The experimental results are presented to demonstrate the effectiveness and correctness of the proposed framework.

[1]  Nikolaos Papanikolopoulos,et al.  Vision-guided robotic grasping: issues and experiments , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[2]  W. J. Wilson,et al.  Visual Servo Control of Robots Using Kalman Filter Estimates of Relative Pose , 1993 .

[3]  F. Chaumette,et al.  Visual servoing using image features defined upon geometrical primitives , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[4]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rahmat Shoureshi,et al.  Vision-based intelligent control for automated assembly , 1989, J. Intell. Robotic Syst..

[6]  William L. Wilson,et al.  VISUAL SERVO CONTROL OF ROBOTS USING KALMAN FILTER ESTIMATES OF ROBOT POSE RELATIVE TO WORK-PIECES , 1993 .

[7]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[8]  Robert M. Haralick,et al.  Automatic sensor and light source positioning for machine vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[9]  Roger Y. Tsai,et al.  Automated sensor planning for robotic vision tasks , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  W. J. Wilson,et al.  Vision Sensor Integration for Direct Manipulator End-Point Control , 1990 .

[11]  Antti J. Koivo,et al.  Real-time vision feedback for servoing robotic manipulator with self-tuning controller , 1991, IEEE Trans. Syst. Man Cybern..

[12]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[13]  D. Hearn,et al.  The Minimum Covering Sphere Problem , 1972 .

[14]  Nikolaos Papanikolopoulos.  Controlled active vision , 1992 .

[15]  Rajeev Sharma,et al.  On the observability of robot motion under active camera control , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[16]  William J. Wilson,et al.  Direct dynamic control of a robot using an end-point mounted camera and Kalman filter position estimation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Martti Mäntylä,et al.  Introduction to Solid Modeling , 1988 .

[18]  Farrokh Janabi-Sharifi,et al.  A supervisory intelligent robot control system for a relative pose-based strategy , 1995 .

[19]  William J. Wilson,et al.  An intelligent assembly robotic system based on Relative Pose measurements , 1995, J. Intell. Robotic Syst..

[20]  Roger Y. Tsai,et al.  Occlusion-Free Sensor Placement Planning , 1990 .

[21]  Joseph S.-C. Yuan.  A general photogrammetric method for determining object position and orientation , 1989, IEEE Trans. Robotics Autom..

[22]  Pradeep K. Khosla,et al.  Vision resolvability for visually servoed manipulation , 1996 .

[23]  William J. Wilson,et al.  Design of a real-time computer system for relative position robot control , 1992, Fourth Euromicro workshop on Real-Time Systems.